Comment on Kyutai is a French AI research lab with a $330 million budget that will make everything open source

<- View Parent
cyd@lemmy.world ⁨11⁩ ⁨months⁩ ago

The context is that LLMs need a big up front capital expenditure to get started, because of the need to train these giant neural networks. This is a big barrier to the development of a fully open source LLM foundation model (once a foundation model is available, building on top of it is relatively cheaper).

So if the bulk of this €300M could go into training, it would go a long way to plugging the gap. But in reality, a lot of that sum is going to be dissipated into other expenses, so there’s going to be a lot less than €300M for actual capex.

source
Sort:hotnewtop