As you can probably see OP, AI doesn’t get much airplay here for some odd reason. I think it’s pretty damn amazing, tho I think it gets over hyped. For example an AI Rice Maker. AI is at it’s gimicky stage right now for the average, normal consumer, a selling point if you will. Kind of like when we discovered ‘the cloud’. Well we’ve been doing that for a while before the cloud became a selling point. Everyone and their brother trampled over each other to move entire operations to the cloud. Merely mentioning ‘the cloud’ in a board room meeting would make CEO’s jizz their pants. Then we figured out that not everything that can go in the cloud, should be in the cloud and so we regrouped. I see AI currently like that.
[deleted]
Submitted 10 months ago by nate4t@lemmy.world to selfhosted@lemmy.world
[deleted]
Comments
irmadlad@lemmy.world 10 months ago
just_another_person@lemmy.world 10 months ago
Naw
TheMightyCat@lemm.ee 10 months ago
I’m trying to understand how this is used, my current selfhosted setup is quite simple:
frontend - backend - vllmUsing the openai compatible api vllm returns with tool calls that need to be handeled by the backend, an results are then send to the frontend by the backend, the frontend never communicates with vllm directly.
Form what i can gather AG-UI is a way for the frontend to directly communicate with in my case vllm in a secure way? letting the frontend handle the tool calls?
sxan@midwest.social 10 months ago
It doesn’t. This is targeted at application builders. Could be an honest mistake; could be astroturfing.
30p87@feddit.org 10 months ago
My biggest headaches in the AI agent space, is it existing.
BroBot9000@lemmy.world 10 months ago
www.youtube.com/watch?v=AyH7zoP-JOg&t=3015s
Ai is a private nightmare.