Be aware that you pay a significant performance penalty for going over occulink.
Even my old 3090 got a huge jump going from a PCIe 3.0 x16 riser to a PCIe 4.0 one.
Comment on Selfhosting Sunday! What's up?
irmadlad@lemmy.world 1 day ago
Well, let’s see…nothing really new on the server. Still waiting for something interesting besides *.arr. I did provision a new tower with the following specs:
- CPU: Ryzen 5 5600X
- GPU: ASUS ROG RX 580
- RAM: Came with 32 GB Corsair Vengeance RGB DDR4 / dropped another 96 GB in it.
- SSD: WD Black NVMe M.2 iirc it’s about a 1tb
- Asus motherboard
- Working on acquiring a GeForce RTX 5090 32GB GDDR7 mounted on a OCuLink external dock (tentative - may change)
brucethemoose@lemmy.world 1 day ago
- irmadlad@lemmy.world 23 hours ago
Be aware that you pay a significant performance penalty for going over occulink.
And that’s why it’s tentative. The reason I’m leaning towards the dock is that, while the 5090 will fit, physically in the case, I am worried about heat dissipation. Even now, when I fire up a moderate model and run it through some paces, I can see the temps rising fairly quickly. So, if I’m going to drop that kind of cabbage on a 5090, the one thing I don’t want to do is watch it turn into a shrink-i-dink.
brucethemoose@lemmy.world 14 hours ago
Duct it!
I have a 400W 3090 with zero case fans.
Its always cool, because I bought like $10 of weather stripping to “seal” its intakes against the edge of an SFF case. So it’s always sucking in ambient air:
You can also severely undervolt a 5090 to like 250-300W, with very little performance impact. Honestly its stock speeds are kind of crazy.
- irmadlad@lemmy.world 5 hours ago
Shit I deleted my post. Yes I have been enjoying some greenery so you just have to hear me out. I have an old countertop ice maker that stripped it’s gears. The refrigeration loop is fine. Pretty wild how small it is. I was wondering…what if I provisioned some brackets on which to mount a muffin fan of unknown CFM, to blow across the coils thru several sheets of mesh of varying gauges to collect moisture drained off to an unknown location, and duct that indirectly into the computer, like a miniature Liebert server room cooling unit. I worry about the moisture tho. Constructing a desiccant wheel seems improbable. I could reheat the cool air upstream or mix warmer air in with the stream to keep the so the outlet air doesn’t stay at a very low dew point and “rewet” downstream components. Perhaps with a small filament heat coil. HMMmmmmm
Cyber@feddit.uk 1 day ago
Nice. Did you have to sell a house to afford the parts?
LOL Not quite, however, I am choking on the 5090 but as I understand, that’s the better option, and 32 GB seems to be the sweetspot for AI.
brucethemoose@lemmy.world 1 day ago
First of all, I mean zero offense with any purchase decision. A 5090 is very good.
…But if I were paying that kind of money, I’d probably get a 4090 and a new motherboard/CPU instead. Maybe a used DRR4 threadripper system.
Hybrid (CPU + GPU) inference is where it’s at these days. It opens up a whole world of huge MoE models. And having a big CPU is much more important for that than having a 5090 instead of a 4090 or something.
Why you do this to me? LOL Injecting your options. But seriously thank you for the advice. I’m really green in the AI arena. So I’m trying to feel my way around, trying not to spend money on equipment I’ll regret later.