Submitted 1 month ago by ryan_harg@discuss.tchncs.de to selfhosted@lemmy.world
I have quite an extensive collection of media that my server makes available through different means (Jellyfin, NFS, mostly). One of my harddrives has some concerning smart values so I want to replace it. What are good harddrives to buy today? Are there any important tech specs to look out for? In the past I didn’t give this too much attention and it didn’t bite me, yet. But if I’m gonna buy a new drive now, I might as well…
Thanks for any hints!
Check out blackblaze drive stats, www.backblaze.com/…/hard-drive-test-data
This. They provide outstanding insights and the articles they provide alongside the data are quite good.
Any hard drive can fail at any time with or without warning. Worrying too much about individual drive families’ reliability isn’t worth it if you’re dealing with few drives. Worry instead about backups and recovery plans in case it does happen.
Bigger drives have significantly lower power usage per TB, and cost per TB is lowest around 12-16TB. Bigger drives also lets you fit more storage in a given box. Drives 12TB and up are all currently helium filled which run significantly cooler.
Two preferred options in the data hoarder communities are shucking (external drives are cheaper than internal, so remove the case) and buying refurb or grey market drives from vendors like Server Supply or Water Panther. In both cases, the savings are usually big enough that you can simply buy an extra drive to make up for any loss of warranty.
Under US$15/TB is typically a ‘good’ price.
I’d start with Backblaze’s 2023 drive report
Interesting that Toshiba/Seagate has best 16TB stats and WDC bad ones in comparison, but for 14TB it’s reversed. My homelab disks apparently has 0.71% risk of dying after 22 months (seagate exos x16 st16000nm001g).
Those 14TB WD drives are workhorses. I run refurbished ones in my home server and have never had any issues. And they are significantly faster than the rest of my spinning rust drives.
After I had two WD drives fail in my old NAS, I switched to all Seagate on my next build. Currently running 9x 20TB Exos X20, though for only about a year now.
I think the most important thing is that you pick a drive that is meant for NAS/server use (so rated for running 24/7). And having manufacturere warrenty is also nice. My Seagate drives have 60 months (which is considerably more then the 36 months that my WD drives had).
m currently failing drive is a WD as well… 🥴
Switching wholesale from a brand or model to another could be counterproductive. There are myriad of reasons why drives can fail that aren’t related to the brand and the model. What if you unknowingly switch to a less reliable model because of such a reason? You’d end up worse off. For example according to Backblaze’s data, Seagate is generally worse than WD.
A better way to do this is to mix brands and models so that there’s less probability to fail at the same time. I have both WD and Seagate in a single storage pool, even if the Seagate model is objectively less reliable according to Backblaze.
+1 for seagate 🫡
I’ve heard very good things about resold HGST Helium enterprise drives and can be found fairly cheap for what they are on eBay.
I’m looking for something from 4TB upwards. I think I remember that drives with very high capacity are more likely to fail sooner - is that correct?
4TB isn’t even close to “very high capacity” these days. There’s like 32TB HDDs out there, just avoid the shingled archival drives. I believe the belief about higher capacity drives is a question of maturity of the technology rather than the capacity. 4TB drives made today are much better than the very first 4TB drives we made a long time ago when they were pushing the limits of technology.
Backblaze has pretty good drive reviews as well, with real world failure rate data and all.
I run only used hgst. I have 6 x 3tb drives that are all 90k hour plus and I recently expanded to some new to me 12tb hgst. I always do badblocks test when I get the drive which took 4 days on the 12 tbs. One of them failed and I returned it to Amazon they shipped another and the replacement was perfect. If they package it poorly just return it right away and choose a different distributor.
One thing no one will tell you HOW LOUD some HDDs are under load. You may not want any disks around if you’re keeping your server around your living spaces.
That’s a good hint, although I wouldn’t mind too mich. personally. My server is located in the basement.
Depending on the use, you may be able to spin then down when not in use, but that’s not always possible for some applications.
My last I have bought are the Toshiba N300 15tb helium drives.
Didnt write much to it but they were cheap and seemed quiet enough to have around in my room (where I also sleep)
Those are great drives but I would not want one of those in the room where I sleep haha
I have and while they sure are loud, dampening the NAS with foam tape (had some double adhesive tape from buying LED strips laying around) quietened it enough to be managable.
One important thing, ensure the drive is CMR, the reason is that you likely want a RAID, and non-CMR disks take so long to read the entire disk that the chances of a second failure while recovering from a disk failure is significant.
That being said, how are you keeping track of the disks state? I built my RAID recently, and your post made me realize that I have nothing to notify me if one of the disks shows early signs of problems.
I just use the built-in email function that comes with mdadm. If a drive fails, I’ll know right away and replace it with a spare. You do need your server to be able to send emails with something like postfix.
If you have hardware RAID, there’s often a monitoring tool that comes with it or at the very least a command-line utility that can report the RAID state which you can then use in a script.
I don’t keep track actively. I noticed problems when reading a file and looked at the drive with smartctl for that reason. Does anybody know how to keep track actively?
I use Seagate Ironwolf 4TB drives in mine. Bought them all used, $50-60 each. Check on eBay and Facebook marketplace
At home I use two Toshiba MG09ACA18TE’s and they work like a charm. I’ve bought them at around US$20/TB and it was the best price/TB offer at that time.
At work we use Exos X18’s and Exos X20’s with no problem at all.
I would say Seagate Exos or Western Digital Ultrastar.
I have an external usb hdd , wd passport 3TB from 10 years ago (healthy) connected to a Chinese N100 mini pc. I have proxmox on it, 5 lxc containers, 30 docker containers running apps, plex, calibre web.
I’m looking for something from 4TB upwards.
If you say “harddrive” … do you mean actual harddrives or are you using it synonymous with “storage”? If you really talk about actual harddrives, it’s hard to even find datacenter/server harddrives below 4 TB. Usually server HDDs start with 8 or 12 TB. You can even find HDDs with 20 TB - Seagate Exos series for example, starting at around 360 Euros (ca. 400 USD).
If you’re in for a general storage, preferably SSD, that’s another issue. There is the Samsung 870 QVO (8 TB) SSD that is often advertised as “datacenter SSD” (so I assume it would run well in a server that is active 24/7), but it is currently available with a maximum of 8 TB. The 870 QVO is at ca. 70 Euros per terabyte (ca. 77 USD) which, in my experience, is the current price range for SSDs. So it has a high price seen from the outside but it’s actually fine. It’s also a one-time investment.
For selfhosting I’d go with an SSD-only setup.
do any have particularly good or bad reputation?
From personal experience I’d say, stick with the “larger” brands like Samsung or Seagate.
I was thinking actual hard drives, not SSDs…
Okay, so … then maybe really look into the Seagate Exos drives. 20 TB should be pretty much fine for most selfhosting adventures.
SSD only?
Look at Mr Moneybags over here. That would increase my cost about 400%
Sorry, I can’t hear you under my enormous piles of money! 🙃
But yeah. You should do an SSD-only setup if this is within your budget. I assume that for most of us selfhosting is just some soft of hobby. If you’re willing to spend money on the latest and cooles tech: do it. If not, then it’s fine, too.
I would advice against using SSDs for storage of media and such. Not only because of their higher price, but also because flash memory cells tend to fade over time, causing read speeds to decrease considerably over time. This is particularily the case for mostly read-only workloads. For each read operation the flash memory cell being read loses a bit of its charge. Eventually the margin for the controller to be able to read the data will be so small, that it takes the controller lots of read operations to figure out the correct data. In the worst case this can lead to the SSD controller being unable to read some data alltogether.
avidamoeba@lemmy.ca 1 month ago
Buy recertified enterprise grade disks from serverpartdeals.com. Prices were around $160/16TB the last time I checked. Mix brands and models to reduce simultaneous failure. Use more than 1-disk redundancy. If you can’t buy from SPD, either find an alternative or buy external drives and shuck them. Use ZFS to know if your data is correct. I’ve been dealing with funny AMD USB controllers recently and the amount of data corruption I’d have gotten if not for ZFS is ridiculous.
Loulou@lemmy.mindoki.com 1 month ago
This is incredible!
American sites like this so rarely ship to France, or it costs a litteral fortune just in shipping, here it’s 130€ for a 12TB shipping included!
Wow.
I Do Not Need A 12TB Hard drive.
I Do Not Need a 12 TB Hard drive!
I mean or do I?
Thanks 💖
avidamoeba@lemmy.ca 1 month ago
Get more drives, run higher redundancy 💪
femtech@midwest.social 1 month ago
Yep, I have 6 14tb drives from them in raid10.
avidamoeba@lemmy.ca 1 month ago
Three-way mirror?
pedroapero@lemmy.ml 1 month ago
I use BTRFS for the same. Being able to check for and repair silent corruptions is a must (and this is without needing to read the whole drives, only the actual files). I’ve had a lot of them over the years, including (but not only) because of a cheap USB controller also.
actual_pillow@programming.dev 1 month ago
Damn I just put 32 more TBs in my homelab and wish I would have known about this site.
Pacmanlives@lemmy.world 1 month ago
Holy cow these are way cheaper than anything I have seen before. I am in a RAID 5 setup so if a disk or two dies I am okay.
avidamoeba@lemmy.ca 1 month ago
Move to a RAID-equivalent setup with ZFS (preferred in my opinion) in order to also know about and fix silent data corruption. RAIDz1, RAIDz2 would do the equivalent to RAID5, RAID6.
mumblerfish@lemmy.world 1 month ago
Oh, wow. Just ordered a new computer. I guess it have to include some more disks!