Naji said the firm has also “developed the broadest ecosystem” of developers and software.
“And so it’s just so much easier to … build an application, build an AI model on top of those chips,” he said.
Comment on Why doesn't Nvidia have more competition?
iopq@lemmy.world 3 days ago
What a shit article. Doesn’t explain the software situation. While CUDA is the most popular, a lot of frameworks do support AMD chips.
Pro@programming.dev 3 days ago
Glitchvid@lemmy.world 3 days ago
Expounding, Nvidia has very deeply engrained itself in educational and research institutions. People learning GPU compute are being taught CUDA and Nvidia hardware. Researchers have access to farms of Nvidia chips.
AMD has basically gone the “build it and they will come” attitude, and the results to match.
brucethemoose@lemmy.world 3 days ago
Except they didn’t.
They repeatedly fumble the software with little mistakes (looking at you, Flash Attention). They price the MI300X and any high VRAM GPU through the roof, when they have every reason to be more competitive and undercut Nvidia. They have sad, incomplete software efforts divorced from what devs are actually doing, like their quantization framework or some inexplicably bad LLMs they trained themself.
They give no one any reason to give them a chance, and wonder why no one comes. Lisa Su could fix this with literally like two phone calls (remove VRAM restrictions on their OEMs, and fix stupid small bugs in ROCM), but they don’t.
Glitchvid@lemmy.world 3 days ago
That’s basically what I said in so many words. AMD is doing its own thing, if you want what Nvidia offers you’re gonna have to build it yourself. WRT pricing, I’m pretty sure AMD is typically a fraction of the price of Nvidia hardware on the enterprise side, from what I’ve read.
The biggest culprit from what I can gather is that AMD’s GPU side is basically still ATI camped up in Markham, divorced from the rest of the company in Austin that is doing great work with their CPU-side.
iopq@lemmy.world 3 days ago
It’s literally the most surface level take. Does not even mention what CUDA is or AMD’s efforts to run it
www.xda-developers.com/nvidia-cuda-amd-zluda/
But it is no longer funded by AMD or Intel
AMD GPUs are still supported by frameworks like PyTorch
rocm.docs.amd.com/…/pytorch-install.html
While Nvidia might be the fastest, they are not always the cheapest option, especially if you rent it in the cloud. When I last checked, it was cheaper to rent AMD GPUs
dumbpotato@lemmy.cafe 3 days ago
Do gamers even care about CUDA?
iopq@lemmy.world 3 days ago
No, this is about AI
Case@lemmynsfw.com 3 days ago
I’m a gamer, and I do…
Then again, I’m mostly excited about using CUDA cores for cracking hashes and the like, lol.
Alphane_Moon@lemmy.world 3 days ago
A comically bad “article”.