Comment on 1U mini PC for AI?
MalReynolds@piefed.social 1 day agoPretty sure that's a x4 PCIe slot (admittedly PCIe 5x4, but not many video cards speak PCIe5), would totally trade a usb4 for a x8, but these laptop chips are pretty constrained lanes wise.
brucethemoose@lemmy.world 1 day ago
It’s PCIe 4 :(.
Indeed. I read Strix Halo only has 16 PCIe 4 lanes in addition to its USB4, which is resonable given this isn’t supposed to be paired with discrete graphics. But I’d happily trade an NVMe slot (still leaving one) to for x8.
MalReynolds@piefed.social 1 day ago
Boo! Silly me thinking DDR5 implied PCIe5, what a shame.
Feels like they're testing the waters with Halo, hopefully a loud 'waters great, dive in' signal gets through and we get something a bit fitter for desktop use, maybe with more memory (and bandwidth) next gen. Still, gotta love the power usage, makes for one hell of a NAS / AI inference server (and inference isn't that fussy about PCIe bandwidth, hell eGPU works fine as long as the model / expert fits in VRAM.
brucethemoose@lemmy.world 1 day ago
Rumor is it’s successor is 384 bit, and after that their designs are even more modular:
techpowerup.com/…/amds-next-gen-udna-four-die-siz…
Hybrid inference actually is pretty sensitive to PCIe bandwidth, unfortunately, but again I don’t think many people intend on hanging an AMD GPU off these Strix Halo boards, lol.