Comment on Question - ZFS and rsync
isles@lemmy.world 8 months agoAwesome, thanks for giving some clues. It’s a new build, but I didn’t focus hugely on RAM, I think it’s only 32GB. I’ll try this out.
Comment on Question - ZFS and rsync
isles@lemmy.world 8 months agoAwesome, thanks for giving some clues. It’s a new build, but I didn’t focus hugely on RAM, I think it’s only 32GB. I’ll try this out.
sonstwas@sh.itjust.works 8 months ago
Based on this thread it’s the deduplication that requires a lot of RAM.
See also: wiki.freebsd.org/ZFSTuningGuide
Cyber@feddit.uk 8 months ago
Just another thought… Maybe just format the drives as a massive EXT4 JBOD (just for a temp test) and copy the data again - just to see if ZFS is the problem… maybe it’s something else altogether? Maybe - and I hope not - the USB source drive is failing after long reads?
isles@lemmy.world 8 months ago
I believe there’s another issue. ZFS has been using nearly all RAM (which is fine, I only need RAM for system and ZFS anyway, there’s nothing else running on this box), but I was pretty convinced while I was looking that I don’t have dedup turned on. Thanks for your suggestions and links!