Comment on 1U mini PC for AI?
princessnorah@lemmy.blahaj.zone 1 week agoCorrect me if I’m wrong here, but is the 395 not leagues ahead of something like a 4090 when it comes to performance per watt? Here’s a comparison graph of a 4090 against the Radeon 8060S, which is the 395’s iGPU:
Now that’s apparently running at the 395’s default TDP of 55W so that includes the CPU power. It’s also clear that a 4090 can trounce it on sheer performance when needed. But if we take a look at this next graph:
This shows that a 4090 has a third of the performance while still running at 130W, more than twice the TDP of the entire 395 APU.
brucethemoose@lemmy.world 1 week ago
Oh wow, that’s awesome! I didn’t know folks ran TDP tests like this, just that my old 3090 seems to have a minimum sweet spot around that same same ~200W based on my own testing, but I figured the 4000 or 5000 series might go lower. Apparently not, at least for the big die.
I also figured the 395 would draw more than 55W! That’s also awesome! I suspect newer, smaller GPUs like the 9000 or 5000 series still make the value proposition questionable, but still you make an excellent point.
And for reference, I just checked, and my dGPU hovers around 30W idle with no display connected.
princessnorah@lemmy.blahaj.zone 1 week ago
You can boost the 395 up to 120W, which might be where Framework is pushing it too, but those benchmarks are labelled 55W and that’s what AMD says is the default clock without adjustment. I’d love to see how the benchmarks compare at that higher boost but I’d imagine it’s diminishing returns similar to most GPUs. I think the benefit to using it in a lounge gaming PC would be the super low power draw, but you would need to figure out a display MUX switch and I don’t think that’s simple with desktop cards. Maybe something with a 5090 mobile would be the go at that point, but I have no idea how that compares to the 395 and whether it’s worth it.
brucethemoose@lemmy.world 1 week ago
Mobile 5090 would be an underclocked, binned desktop 5080, AFAIK:
en.wikipedia.org/…/List_of_Nvidia_graphics_proces…
In KCD2 (a fantastic CryEngine game, a great benchmark IMO), at QHD, the APU is about half as fast. For instance, 39 FPS in QHD vs 84 FPS for the mobile 5090:
notebookcheck.net/Nvidia-GeForce-RTX-5090-Laptop-…
notebookcheck.net/AMD-Radeon-8060S-Benchmarks-and…
Synthetic benchmarks between the two
But these are both presumably running at high TDP. Also, the mobile 5090 is catastrophically expensive and inevitably tied to a weaker CPU. So make of that what you will.