Comment on Kyutai is a French AI research lab with a $330 million budget that will make everything open source
cyd@lemmy.world 11 months agoThe context is that LLMs need a big up front capital expenditure to get started, because of the need to train these giant neural networks. This is a big barrier to the development of a fully open source LLM foundation model (once a foundation model is available, building on top of it is relatively cheaper).
So if the bulk of this €300M could go into training, it would go a long way to plugging the gap. But in reality, a lot of that sum is going to be dissipated into other expenses, so there’s going to be a lot less than €300M for actual capex.
interceder270@lemmy.world 11 months ago
Is there any way we can decentralize the training of neural networks?
I recall something being released awhile ago that let people use their computers for scientific computations. Couldn’t something similar be done for training AI?
dojan@lemmy.world 11 months ago
Folding at home.
I dunno. I wouldn’t lend my spare power to put people out of a job.
Sanyanov@lemmy.world 11 months ago
Btw yes! Why not include such project in something like BOINC and let people help training free AI?