moto

@moto@programming.dev

This is a remote user, information on this page may be incomplete. View at Source ↗

⁨Comment⁩ on ⁨Oracle Layoffs: Tech giant to slash 30,000 jobs as banks pull out from financing AI data centres | Company Business News⁩ ⁨⁨1⁩ ⁨day⁩ ago⁩:
I like local LLMs as much as the next person but the issue is that doesn’t scale the way companies need it to.

As a personal assistant? Sure, I agree. They’re useful at times. But as soon as you need multiple to run simultaneously you’re gonna hit resource issues.

What Oracle and others were banking on is that you have engineers and others running a lot of agents in parallel composing different things together. Or having one input that multiple serverside agents take and execute numerous tasks on. That’s something you can’t run on an individual machine right now. And with the way they currently work I don’t envision they will anytime soon.