I might have a problem......

Submitted ⁨⁨1⁩ ⁨year⁩ ago⁩ by ⁨xtremeownage@lemmyonline.com⁩ to ⁨selfhosted@lemmy.world⁩

https://lemmyonline.com/pictrs/image/d624d9f6-a192-47a0-aea3-c3a8e070d5f2.webp

I can’t say for sure- but, there is a good chance I might have a problem.

The main picture attached to this post, is a pair of dual bifurcation cards, each with a pair of Samsung PM963 1T enterprise NVMes.

It is going into my r730XD. Which… is getting pretty full. This will fill up the last empty PCIe slots.

Image

But, knock on wood, My r730XD supports bifurcation! LOTS of Bifurcation.

Image

As a result, it now has more HDDs, and NVMes then I can count.

Image

What’s the problem you ask? Well. That is just one of the many servers I have laying around here, all completely filled with NVMe and SATA SSDs…

Figured I would share. Seeing a bunch of SSDs is always a pretty sight.

And- as of two hours ago, my particular lemmy instance was migrated to these new NVMes completely transparently too.

source

Comments

Sort:hotnew top

infinitevalence@discuss.online ⁨1⁩ ⁨year⁩ ago
I dont see any issues!

/me hides his 16 4tb 12g SAS drives…

source
- brygphilomena@lemmy.world ⁨1⁩ ⁨year⁩ ago
  I think I’m at 7x 18tb drives. I’m slowly replacing all the smaller 8tb disks in my server. Only 5 more to go. After that it’s a new server with more bays and/or a jbod shelf.
  
  source
  - infinitevalence@discuss.online ⁨1⁩ ⁨year⁩ ago
    the SAS drives are all SSD, I also have 8x 12tb in rust, and an LTO robot though its not currently in service.
    
    source
  - iesou@lemm.ee ⁨1⁩ ⁨year⁩ ago
    That’s my next step. I have 8 8tb drives I need to start swapping, 2x512 NVMEs for system/app cache, and 1 2tb NVME for media cache.
    
    source
Heggico@lemmy.world ⁨1⁩ ⁨year⁩ ago
I’m confused. Why do those cards have a heatsink? I needed a card like that because my motherboard did not support bifurcation. So had to use a splitting card. The cards I know that require bifurcation do not even need a controller or heatsink. They are just wired pretty much directly to the pci-e bus.

source
- xtremeownage@lemmyonline.com ⁨1⁩ ⁨year⁩ ago
  I actually looked up the chip numbers, and its a “splitter”.
  
  I, don’t know WHY there is a splitter, as a splitter isn’t needed, and these cards are advertised to only work on motherboards supporting bifurcation. However, there is indeed, a splitter.
  
  The documentation is also, REALLY horribly translated.
  
  Note: Without pcie splitter function in this host adapter (ASM1182E chip), so motherboard must support PCIe Bifurcation. Otherwise, only one M.2 PCIe SSD will be recognized. If you are not sure PCIe Bifurcation of your motherboard, please consult motherboard munufacture or contact us via amazon message
  
  Here is the documentation for the chip itself: www.asmedia.com.tw/product/…/b7FyQBCxz2URbzg0
  
  I, am not 100% certain how, where, or why it fits in there. Perhaps, its for link power management? Or something.
  
  But, I can confirm, these cards DO require bifurcation to be enabled. Without bifurcation, you only see the first drive.
  
  source
  - Heggico@lemmy.world ⁨1⁩ ⁨year⁩ ago
    Wierd, but thanks for the info. The card i’ve used before pretty much only has 2 slots and a few random components on it l, like capacitors and such. So I assumed it was never needed. My motherboard didn’t support bifurcation, so I never got that to work though, so maybe it couldn’t work at all… only found that out after installing it.
    
    source
    -> View More Comments
Millie@lemm.ee ⁨1⁩ ⁨year⁩ ago
I dream of this kind of storage. I just added a second m.2 with a couple of TB on it and the space is lovely but I can already see I’ll fill it sooner than I’d like.

source
platysalty@kbin.social ⁨1⁩ ⁨year⁩ ago
I'll gladly take those problems out of your hands for free

source
YonatanAvhar@programming.dev ⁨1⁩ ⁨year⁩ ago
This does seem like an issue, I can help you free up some PCIe slots if you’d like

source
joel@aussie.zone ⁨1⁩ ⁨year⁩ ago
Love this. Apart from hosting an instance, what are you using it for? Self-cloud?

source
- xtremeownage@lemmyonline.com ⁨1⁩ ⁨year⁩ ago
  I host a few handfuls of websites, some discord bots.
  
  I hoard Linux isos. I use it for general purpose learning and experimentation.
  
  There is also kubernetes running, source control, and a bit of everything else.
  
  source
  - tinysalamander@lemmy.world ⁨1⁩ ⁨year⁩ ago
    Amateur data hoarder here; teach me your ways
    
    source
    -> View More Comments
SuperSecretThrowaway@lemmynsfw.com ⁨1⁩ ⁨year⁩ ago
The only problem I see is using 8x slots instead of 16x slots for double the storage

source
- xtremeownage@lemmyonline.com ⁨1⁩ ⁨year⁩ ago
  Whats the problem?
  
  Each NVMe uses 4 lanes. For each of these x8 slots, they have two NVMes, for a total of 8 lanes.
  
  The x16 slot already has 4x NVMe in it, lol. The other x16 slot has a GPU, which is located in that particular slot due to the lovely 3d-printed fan shroud.
  
  source
  - feitingen@lemmy.world ⁨1⁩ ⁨year⁩ ago
    Does the plx introduce noticeable latency, and does it get hot?
    
    I want to get a few, but I don’t really have the airflow you do, so I’m a bit worried.
    
    source
    -> View More Comments
webuge@lemmy.dbzer0.com ⁨1⁩ ⁨year⁩ ago
Well this seems to be a good problem to have hahah. If you need to get rid of some of those ssds count with me.

source
Vake@lemmy.world ⁨1⁩ ⁨year⁩ ago
Wondering what software you’re running to have all the storage managed and then your containers and things on top? Is it all on the 730XD?

source
- towerful@programming.dev ⁨1⁩ ⁨year⁩ ago
  The picture of the GUI at the end is Proxmox.
  Proxmox is really powerful and great for a few servers.
  
  source
scottmeme@sh.itjust.works ⁨1⁩ ⁨year⁩ ago
Do you happen to have a link to those cards?

source