Comment on Kyutai is a French AI research lab with a $330 million budget that will make everything open source

cyd@lemmy.world ⁨1⁩ ⁨year⁩ ago

• Mahlzeit@feddit.de ⁨1⁩ ⁨year⁩ ago

  Ideally, they wouldn’t be paying salaries? What?

  source

  • AeroLemming@lemm.ee ⁨1⁩ ⁨year⁩ ago

    I think what they mean is that ideally, the money wouldn’t be going towards a few executives’ multi-millionaire salaries.

    source
  • cyd@lemmy.world ⁨1⁩ ⁨year⁩ ago

    The context is that LLMs need a big up front capital expenditure to get started, because of the need to train these giant neural networks. This is a big barrier to the development of a fully open source LLM foundation model (once a foundation model is available, building on top of it is relatively cheaper).

    So if the bulk of this €300M could go into training, it would go a long way to plugging the gap. But in reality, a lot of that sum is going to be dissipated into other expenses, so there’s going to be a lot less than €300M for actual capex.

    source

    • interceder270@lemmy.world ⁨1⁩ ⁨year⁩ ago

      Is there any way we can decentralize the training of neural networks?

      I recall something being released awhile ago that let people use their computers for scientific computations. Couldn’t something similar be done for training AI?

      source

      • dojan@lemmy.world ⁨1⁩ ⁨year⁩ ago

        Folding at home.

        I dunno. I wouldn’t lend my spare power to put people out of a job.

        source
      • Sanyanov@lemmy.world ⁨1⁩ ⁨year⁩ ago

        Btw yes! Why not include such project in something like BOINC and let people help training free AI?

        source
  • Viking_Hippie@lemmy.world ⁨1⁩ ⁨year⁩ ago

    Methinks cyd might be a libertarian 😄

    source
  • 5BC2E7@lemmy.world ⁨1⁩ ⁨year⁩ ago

    ?? Do you know people with enough time qualifications and money that are willing to work for free? I haven’t.

    source

    • Thekingoflorda@lemmy.world ⁨1⁩ ⁨year⁩ ago

      I know a few people on a certain site that host a kind of reddit alternative in their free time.

      source

      • 5BC2E7@lemmy.world ⁨1⁩ ⁨year⁩ ago

        I still don’t know any.

        source

        • -> View More Comments
    • interceder270@lemmy.world ⁨1⁩ ⁨year⁩ ago

      I don’t think many people were paid to work on the Fediverse.

      Or emulators.

      Or most free software.

      source

      • Honytawk@lemmy.zip ⁨1⁩ ⁨year⁩ ago

        That isn’t a job to them though, it is more like a hobby.

        If you want peoples undivided attention, you will have to pay them, no matter how utopian your vision.

        Which you can easily afford with 330 million funding.

        source
• Honytawk@lemmy.zip ⁨1⁩ ⁨year⁩ ago

  Good luck training an LLM without any developer.

  source