Comment on [deleted]
neatobuilds@lemmy.today 1 month agoSo if I had more memory channels it would be better to have say ollama use the cpu versus the gpu?
Comment on [deleted]
neatobuilds@lemmy.today 1 month agoSo if I had more memory channels it would be better to have say ollama use the cpu versus the gpu?
hendrik@palaver.p3x.de 1 month ago
Well, the numbers I find on google are: a Nvidia 4090 can transfer 1008 GB/s. And a i9 does something like 90 GB/s. So you'd expect the CPU to be roughly 11 times slower than that GPU at fetching numbers from memory.