The article is about Kyutai, a French AI lab with an objective to compete with chatgpt and others with full open source (research papers, models, and training data).
They are aiming to also include the capability to use sound, image, etc… (according to this article (French) clubic.com/actualite-509350-intelligence-artifici…)
The post article also talks about some French context.
cyd@lemmy.world 11 months ago
Ideally, they’d just blow the entire $330M training an LLM, and release the weights. I’m reality, much of that money will probably go into paying salaries, various smaller research projects, etc.
Mahlzeit@feddit.de 11 months ago
Ideally, they wouldn’t be paying salaries? What?
AeroLemming@lemm.ee 11 months ago
I think what they mean is that ideally, the money wouldn’t be going towards a few executives’ multi-millionaire salaries.
cyd@lemmy.world 11 months ago
The context is that LLMs need a big up front capital expenditure to get started, because of the need to train these giant neural networks. This is a big barrier to the development of a fully open source LLM foundation model (once a foundation model is available, building on top of it is relatively cheaper).
So if the bulk of this €300M could go into training, it would go a long way to plugging the gap. But in reality, a lot of that sum is going to be dissipated into other expenses, so there’s going to be a lot less than €300M for actual capex.
Viking_Hippie@lemmy.world 11 months ago
Methinks cyd might be a libertarian 😄
5BC2E7@lemmy.world 11 months ago
?? Do you know people with enough time qualifications and money that are willing to work for free? I haven’t.
Honytawk@lemmy.zip 11 months ago
Good luck training an LLM without any developer.