I haven’t seen more than maybe 32MB/s. The transfers I’ve done are all on my local network from my desktop to my NAS which is plugged into my router. I have samba installed, my NAS shows up as a network drive just fine and I’ve just been dragging/dropping on my desktop GUI. Before setting up RAID, when I did this I would get around 200MB/s. The Pi has 16GB of RAM and I’m using less than 1.5GB.
Comment on Apparent issues with ZFS on RPi 5
calamityjanitor@lemmy.world 1 day ago
sync=disabled will make ZFS write to disk every 5 seconds instead of when software demands it, which maybe explains your LED behavior.
Jeff Geerling found that writes with Z1 was 74 MB/sec using the Radxa Penta SATA HAT with SSDs. Any HDD should be that fast, the SATA hat is likely the bottleneck.
Are you performing writes locally, or over smb?
Can try iostat
or zpool iostat
to monitor drive writes and latencies, might give a clue.
How much RAM does the Pi 5 have?
ramenshaman@lemmy.world 1 day ago
Lemmchen@feddit.org 1 day ago
Those 200MB/s probably weren’t synchronous transfers. The OS tells you the write was complete, but it actually hasn’t committed the data to disk yet. (Wild guess)
calamityjanitor@lemmy.world 1 day ago
Ah kay, definitely not a RAM size problem then.
iostat -x 5
Will print out per drive stats every 5 seconds. The first output is an average since boot. Check all of the drives have similar values while performing a write. Might be one drive is having problems and slows everything down, hopefully unlikely if they are brand new drives.zpool iostat -w
Will print out a latency histogram. Check if any have a lot above 1s and if it’s in the disk or sync queues. Here’s mine with 4 HDDs in z1 working fairly happily for comparison: Here’s mine with 4 HDDs in z1 working fairly happily for comparisonThe
init_on_alloc=0
kernel flag I mentioned below might still be worth trying.
calamityjanitor@lemmy.world 1 day ago
After some googling:
I think it’s set to 1 on Raspberry Pi OS, you set it in
/boot/cmdline.txt
I think.[Exhaustive ZFS performance tuning guide](openzfs.github.io/openzfs-docs/Performance and Tuning/Workload Tuning.html)