Comment on 1U mini PC for AI?
brucethemoose@lemmy.world 5 days ago
If you can swing $2K, get one of the new mini PCs with an AMD 395 and 64GB+ RAM (ideally 128GB).
They’re tiny, lower power, and the absolute best way to run the new MoEs like Qwen3 or GLM Air for coding.
princessnorah@lemmy.blahaj.zone 5 days ago
I think the mainboard from the Framework Desktop meets your requirements: frame.work/…/framework-desktop-mainboard-amd-ryze…
MalReynolds@piefed.social 5 days ago
Pretty sure that's a x4 PCIe slot (admittedly PCIe 5x4, but not many video cards speak PCIe5), would totally trade a usb4 for a x8, but these laptop chips are pretty constrained lanes wise.
brucethemoose@lemmy.world 5 days ago
It’s PCIe 4 :(.
Indeed. I read Strix Halo only has 16 PCIe 4 lanes in addition to its USB4, which is resonable given this isn’t supposed to be paired with discrete graphics. But I’d happily trade an NVMe slot (still leaving one) to for x8.
MalReynolds@piefed.social 5 days ago
Boo! Silly me thinking DDR5 implied PCIe5, what a shame.
Feels like they're testing the waters with Halo, hopefully a loud 'waters great, dive in' signal gets through and we get something a bit fitter for desktop use, maybe with more memory (and bandwidth) next gen. Still, gotta love the power usage, makes for one hell of a NAS / AI inference server (and inference isn't that fussy about PCIe bandwidth, hell eGPU works fine as long as the model / expert fits in VRAM.
brucethemoose@lemmy.world 5 days ago
Nah, it is only PCIe 4.0 4x, a bit slim for a dGPU :(