How to transfer a lot of data?

Submitted ⁨⁨3⁩ ⁨weeks⁩ ago⁩ by ⁨dataprolet@lemmy.dbzer0.com⁩ to ⁨selfhosted@lemmy.world⁩

I just installed a 3 drive RAIDZ in my small home server to replace my old drives. But I don’t have enough SATA ports to also connect my old drives because the 4th SATA port is blocked when using a M.2 SSD, which I do as my boot drive. So I can’t transfer around 10 TB of files from my old drives to the ZFS pool. I have an external USB connector, but it’s really slow or I could boot from an USB stick, install ZFS and use all 4 SATA ports to transfer the files. I also have another PC to put the old drives in, but it would be quite a hassle.
Do you have any idea what would be the best solution to this?

source

Comments

Sort:hotnew top

Khanzarate@lemmy.world ⁨3⁩ ⁨weeks⁩ ago
I haven’t used raidz but a quick search tells me it supports single-drive expansion.

Maybe reconfigure your raidz as a 2-drive system, then copy over all your data into it, and expand it back into a 3-drive system after.

source
avidamoeba@lemmy.ca ⁨3⁩ ⁨weeks⁩ ago
USB 3 should be plenty fast. Even 4-disks per port do 600MB/s. Get some USB-SATA adapters, or a multibay box, or some enclosures, and a USB hub. I was running 2 4-bay boxes on 2 USB 3 5Gb ports with 8-disk RAIDz2. Peaks at 1.3GB/s.

source
Helmaar@lemmy.world ⁨3⁩ ⁨weeks⁩ ago
Maybe you could try Syncthing? It’s pretty fast over a local network and can do the job fairly well.

source
- nul9o9@lemmy.world ⁨3⁩ ⁨weeks⁩ ago
  At the root of it, network transfer is the best bet.
  
  source
  - doodledup@lemmy.world ⁨3⁩ ⁨weeks⁩ ago
    That would take 22 hours under ideal conditions on a 1gbit connection. If you copy files and not block data it’ll probaboy take 24h or more. Not fun.
    
    source