Comment on Looking to build my first PC in almost 30 years; What should I be on the look out for?
CeeBee@lemmy.world 4 months agogetting a few CUDA TPUs
Those aren’t “CUDA” anything. CUDA is a parallel processing framework.
Also, those devices are only good for inferencing smaller models for things like object detection. They aren’t good for developing AI models (in the sense of training). And they can’t run LLMs. Maybe you can run a smaller model under 4B, but those aren’t exactly great for accuracy.
At best you could hope for is to run a very small instruct model trained on very specific data (like robotic actions) that doesn’t need accuracy in the sense of “knowledge accuracy”.
And completely forgot any kind of generative image stuff.
jjlinux@lemmy.ml 4 months ago
Same reply. And you can add as many TPUs as you want to push it to whatever level you want. At 59 bucks a piece, they’ll blow any 4070 out of the water for the same or less cost.