Comment on Kyutai is a French AI research lab with a $330 million budget that will make everything open source

• AeroLemming@lemm.ee ⁨11⁩ ⁨months⁩ ago

  I think what they mean is that ideally, the money wouldn’t be going towards a few executives’ multi-millionaire salaries.

  source
• cyd@lemmy.world ⁨11⁩ ⁨months⁩ ago

  The context is that LLMs need a big up front capital expenditure to get started, because of the need to train these giant neural networks. This is a big barrier to the development of a fully open source LLM foundation model (once a foundation model is available, building on top of it is relatively cheaper).

  So if the bulk of this €300M could go into training, it would go a long way to plugging the gap. But in reality, a lot of that sum is going to be dissipated into other expenses, so there’s going to be a lot less than €300M for actual capex.

  source

  • interceder270@lemmy.world ⁨11⁩ ⁨months⁩ ago

    Is there any way we can decentralize the training of neural networks?

    I recall something being released awhile ago that let people use their computers for scientific computations. Couldn’t something similar be done for training AI?

    source

    • dojan@lemmy.world ⁨11⁩ ⁨months⁩ ago

      Folding at home.

      I dunno. I wouldn’t lend my spare power to put people out of a job.

      source
    • Sanyanov@lemmy.world ⁨11⁩ ⁨months⁩ ago

      Btw yes! Why not include such project in something like BOINC and let people help training free AI?

      source
• Viking_Hippie@lemmy.world ⁨11⁩ ⁨months⁩ ago

  Methinks cyd might be a libertarian 😄

  source
• 5BC2E7@lemmy.world ⁨11⁩ ⁨months⁩ ago

  ?? Do you know people with enough time qualifications and money that are willing to work for free? I haven’t.

  source

  • Thekingoflorda@lemmy.world ⁨11⁩ ⁨months⁩ ago

    I know a few people on a certain site that host a kind of reddit alternative in their free time.

    source

    • 5BC2E7@lemmy.world ⁨11⁩ ⁨months⁩ ago

      I still don’t know any.

      source

      • puppy@lemmy.world ⁨11⁩ ⁨months⁩ ago

        I think you just replied to one.

        source

        • -> View More Comments
  • interceder270@lemmy.world ⁨11⁩ ⁨months⁩ ago

    I don’t think many people were paid to work on the Fediverse.

    Or emulators.

    Or most free software.

    source

    • Honytawk@lemmy.zip ⁨11⁩ ⁨months⁩ ago

      That isn’t a job to them though, it is more like a hobby.

      If you want peoples undivided attention, you will have to pay them, no matter how utopian your vision.

      Which you can easily afford with 330 million funding.

      source