Comment on Proton’s Lumo AI chatbot: not end-to-end encrypted, not open source
Zos_Kia@lemmynsfw.com 3 weeks agoThere’s absolutely a push for specialized hardware, look up that company called Groq !
Comment on Proton’s Lumo AI chatbot: not end-to-end encrypted, not open source
Zos_Kia@lemmynsfw.com 3 weeks agoThere’s absolutely a push for specialized hardware, look up that company called Groq !
KingRandomGuy@lemmy.world 3 weeks ago
Yes, but at this point most specialized hardware only really work for inference. Most players are training on NVIDIA GPUs, with the primary exception of Google who has their own TPUs, but even these have limitations compared to GPUs (certain kinds of memory accesses are intractably slow, making them unable to work well for methods like instant NGP).
GPUs are already quite good, especially with things like tensor cores.