Comment on At Davos, NVIDIA, Microsoft CEOs deny AI bubble
Tanoh@lemmy.world 1 week agoGet you hooked to the extreme convenience, much like a drug addict, and then pump up the price or flood every prompt with ads.
There is a big difference between “normal” SaaS and LLM.
In a normal SaaS you get a lot of benefit of being at scale. Going from 1000 to 10000 users is not that much harder than going from 10000 to 1000000. Once you have your scaling set up you can just add more servers and/or data centers. But most importantly, the cost per user goes waaay down.
With AI it just doesn’t scale at all, the 500000th user will most likely cost as much as the 5th. So doing a netflix/spotify/etc, I don’t think is going to work unless they can somehow make it a lot cheaper per user. OpenAI fails to turn a profit even on their most expensive tiers.
pipi1234@lemmy.world 1 week ago
Is this correct? I was under the impresion that the most expensive part of an llm is the training, and once that’s done the cost of running a prompt is negligible.
I get your point that this last part doesn’t scale well, but the far larger cost of training must get very diluted if they distribute it across a large user base.
cazssiew@lemmy.world 1 week ago
I agree, scaling users isn’t the issue, what is is the neverending chase for the mirage that is AGI. They’ll throw every processing cycle they can muster at that fever dream, that’s the financial black hole.
pipi1234@lemmy.world 1 week ago
Yes, but don’t underestimate the power of centralisation.
6 months ago you could set a server for running a decent local llm for under 800 euros.
By increasing the demands and pushing the price of hardware up, they are efectibly gate keeping access to llms.
I think the plan is that we will need to rely on this companies for compute power and llms services, and then they can do all sorts of nefarious things.