This is the type of processor companies want in things like VM servers that host large numbers of VMs.
GPU processing units are really good at only specific kinds of computation. These are still all-around processors.
TimeSquirrel@kbin.social 7 months ago
Isn't there some kind of diminishing returns on this, where it starts to make more sense to offload things to a GPU or something instead of piling on ever more CPU cores?
hamsterkill@lemmy.sdf.org 7 months ago
thelastknowngod@lemm.ee 7 months ago
Yep. I would LOVE one of these chips in a kubernetes node.
_s10e@feddit.de 7 months ago
The alternative to multiple cores is a single core that runs faster. We tried this and hit a limit. So, it’s many cores, now.
namingthingsiseasy@programming.dev 7 months ago
GPUs are still pretty bad at handling conditional logic and are more optimized towards doing mathematical operations instead.
But you are right in the sense that people are exploring different kinds of hardware for workloads that are getting increasingly specific. We’re not in a CPU vs GPU world anymore, but more like a “what kind of CPU do I need?” situation.
Blackmist@feddit.uk 7 months ago
One of their benchmark graphs is for Stable Diffusion, showing how much faster their CPU runs it than a 96 core AMD Epyc CPU. I’m like 99% sure that a GPU would run that at least 10 times faster.
agressivelyPassive@feddit.de 7 months ago
GPUs aren’t really suitable for many workloads. These CPUs are typically used in servers, you can’t really offload a docker container onto a GPU.