Submitted 7 months ago by lightrush@lemmy.ca to selfhosted@lemmy.world
https://lemmy.ca/pictrs/image/929f2d95-95fb-4475-aacf-0ca64de609f4.jpeg
Oh no.
Unfortunately I have a lot of experience with this: attaching permanent array members via USB is a bad idea. OP, if it’s not too late, and assuming you haven’t already and decided to double down on yolo, I’d recommend reading about the downsides of this approach. It is easy to find relevant discussions (and catastrophes) in r/zfs.
Thunderbolt enclosures are a bit more expensive, but they won’t periodically fuck up your shit just because.
Thanks for the warning ⚠️🙏
This isn’t my first rodeo with ZFS on USB. I’ve been running USB for a few years now. Recently I ran this particular box through a battery of tests and I’m reasonably confident that with my particular set of hardware it’ll be fine. It passed everything I threw at it, once connected to a good port on my machine. But you’re generally right and as you can see I discussed that in the testing thread, and I encountered some issues that I managed to solve. If you think I’ve missed something specific - let me know! 😊
Is it because USB doesn’t expose proper UUIDs or something?
Bus issues usually. Having a disk (or 4) drop out of a ZFS filesystem regularly isn’t a good time.
If you can find a combination of ports on the machine that doesn’t have bus issues you’re usually fine (assuming the enclosure is reliable and doesn’t have driver or firmware issues.)
Been on USB enclosures using Linux software raid for 20 years and never lost a bit so far.
Didn’t go cheap with USB jbod, and i have no idea if zfs is more sensitive to USB… But I don’t use zfs either so don’t know.
But again I have been using two jbods over USB:
All three raid are managed by Linux software raid stack.
The original one I think I started in the 2000’s, then upgraded disks many times and slowly moving to ssds to lower heat production and power usage.
Keep them COOL that’s important.
What an assertion - if you’re not using ZFS, how do you know you’ve “never lost a bit so far”?
I’ve been on the USB train since 2019. You’re exactly right, you gotta get devices with good USB-to-SATA chipsets, and you gotta keep them cool. From all my testing I’ve discovered that:
I like this box in particular because it uses a very straightforward design. It’s got 4x ASM235CM with cooling connected to a VIA hub. It’s got a built-in power supply, fan, it even comes with good cables. It fixes a lot of the system variables to known good values. You’re left with connecting it to a good USB host controller.
I imagine if someone had to do it this way for whatever reason, Thunderbolt would be more reliable? Assuming it’s true Thunderbolt using a SATA bridge?
Yes - and unless you treat each enclosure as its own failure domain, it will still be a compromise, but it’s a lot better.
What are you putting in them?
Sweet, just backing up the family photos then?
What are you connecting them to?
Two machines. A main server/workstation and a small off-site backup machine that runs the same services but hass less compute and RAM.
You should take a look at getting sas enclosures. They’re pretty cheap, like $200 for a 16 bay. That will be so much more reliable.
I thought about it, but it typically requires extra PCIe cards that I can’t rely on as there’s no space in one of the machines and no PCIe slots in the other. That’s why I did a careful search till I stumbled upon this particular enclosure and then I tested one with ZFS for over a week before buying the rest.
Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:
| Fewer Letters | More Letters |
|---|---|
| PCIe | Peripheral Component Interconnect Express |
| SATA | Serial AT Attachment interface for mass storage |
| ZFS | Solaris/Linux filesystem focusing on data integrity |
[Thread #668 for this sub, first seen 9th Apr 2024, 13:55] [FAQ] [Full list] [Contact] [Source code]
helenslunch@feddit.nl 7 months ago
0GB!
lightrush@lemmy.ca 7 months ago
That was the cheapest option. 🤭
helenslunch@feddit.nl 7 months ago
I just thought it was funny that they put it on a big sticker on front of the box instead of something like “storage not included” in small print somewhere.