Comment on Researchers figured out how to run a 120-billion parameter model across four regular desktop PCs
specialwall@midwest.social 3 days ago
Now, EPFL researchers Gauthier Voron, Geovani Rizk and Rachid Guerraoui, from the Distributed Computing Laboratory (DCL) in the School of Computer and Communication Sciences, have released new software that allows users to download open-source AI models and use them locally, with no need for the cloud to answer questions or complete tasks.
It’s cool that they got LLMs running on local clusters of computers, but with the way it’s written, they make it sound like people have not already been using local LLMs for a long time (including GPT-OSS 120B).