Comment on The Living Web: Will there eventually be a protocol on top of (or as a part of) ActivityPub to run distributed LLMs on instances, with the LLMs feeding on the data generated by the Fediverse?

<- View Parent
sparse_neuron@lemmy.world ⁨1⁩ ⁨year⁩ ago

What do you mean by “stay alive”? LLMs are statistical models that require a lot of number crunching in order to output a response. That’s not something you can just host without some major costs associated (Far more than any single Fediverse instance for sure, GPUs are not cheap to rent).

source
Sort:hotnewtop