I use BTRFS for the same. Being able to check for and repair silent corruptions is a must (and this is without needing to read the whole drives, only the actual files). I’ve had a lot of them over the years, including (but not only) because of a cheap USB controller also.
Comment on What are good harddrives to use with serves
avidamoeba@lemmy.ca 4 days ago
Buy recertified enterprise grade disks from serverpartdeals.com. Prices were around $160/16TB the last time I checked. Mix brands and models to reduce simultaneous failure. Use more than 1-disk redundancy. If you can’t buy from SPD, either find an alternative or buy external drives and shuck them. Use ZFS to know if your data is correct. I’ve been dealing with funny AMD USB controllers recently and the amount of data corruption I’d have gotten if not for ZFS is ridiculous.
pedroapero@lemmy.ml 4 days ago
femtech@midwest.social 4 days ago
Yep, I have 6 14tb drives from them in raid10.
avidamoeba@lemmy.ca 4 days ago
Three-way mirror?
femtech@midwest.social 4 days ago
I just keep adding 2 more drives as it gets full. Not sure if that’s the best thing.
TheHolm@aussie.zone 4 days ago
I would not trust these kind of dives in the mirror. IMHO RAID6 is the only way.
avidamoeba@lemmy.ca 4 days ago
Due to risk of failure or risk of data corruption because the mirror can’t tell which drive is right when there’s a difference?
peregus@lemmy.world 3 days ago
IMHO RAID6 is the only way.
Or SnapRaid
mumblerfish@lemmy.world 3 days ago
Oh, wow. Just ordered a new computer. I guess it have to include some more disks!
actual_pillow@programming.dev 4 days ago
Damn I just put 32 more TBs in my homelab and wish I would have known about this site.
Pacmanlives@lemmy.world 3 days ago
Holy cow these are way cheaper than anything I have seen before. I am in a RAID 5 setup so if a disk or two dies I am okay.
avidamoeba@lemmy.ca 3 days ago
Move to a RAID-equivalent setup with ZFS (preferred in my opinion) in order to also know about and fix silent data corruption. RAIDz1, RAIDz2 would do the equivalent to RAID5, RAID6.
Pacmanlives@lemmy.world 3 days ago
ZFS is a no go for me due to not being able to add larger disk and then expand my pool size on the fly. MDADM and LVM+XFS have treated me well the past few years. I started with an 12tb pool and now over 50 tb pool
avidamoeba@lemmy.ca 3 days ago
Not that I want to push ZFS or anything, mdraid/LVM/XFS is a fine setup, but for informational purposes - ZFS can absolutely expand onto larger disks. I wasn’t aware of this until recently. If all the disks of an existing pool get replaced with larger disks, the pool can expand onto the newly available space. E.g. a RAIDz1 with 4x 4T disks will have usable space of 12T. Replace all disks with 8T disks (one after another) and your pool will have 24T of space. Replace those with 16T and you get 48T, and so on. In addition you can expand a pool by adding another redundant topology just like you can with LVM and mdraid. Finally, expanding existing RAIDz with additional disks has recently landed too.
Loulou@lemmy.mindoki.com 4 days ago
This is incredible!
American sites like this so rarely ship to France, or it costs a litteral fortune just in shipping, here it’s 130€ for a 12TB shipping included!
Wow.
I Do Not Need A 12TB Hard drive.
I Do Not Need a 12 TB Hard drive!
I mean or do I?
Thanks 💖
avidamoeba@lemmy.ca 4 days ago
Get more drives, run higher redundancy 💪