Comment on Google's Agentic AI wipes user's entire HDD without permission in catastrophic failure
PmMeFrogMemes@lemmy.world 8 hours agoin your example tho it would be like the plumber asked you specifically if he could bone, and you were like “sure dawg sounds good”
Jhex@lemmy.world 8 hours ago
No, not at all
I get what you are saying but any reasonable entity would understand that telling someone at the door “come in”, does not mean “come in my wife’s ass”
Specifically the “without permission” in the title, relates to the fact the AI did not ask about it… it simply took a previously granted right to run commands and ran any/all commands without warning.
If you and I were working on a project together and nothing is working right, I could say “hmm let’s start over” and you would know it means “let’s start the project from scratch”, not “let’s wipe the data centre”
PumaStoleMyBluff@lemmy.world 5 hours ago
Inviting an agentic AI isn’t really asking them to do one task, though.
It’s more like offering a plumber a room in your house to stay in 24/7 so they can be on-call when you need them. And telling them they can use your food, dishes, clothes, and living room while they’re there and you’re at work.
Which makes it much less surprising when they get bored and bone your wife.
Jhex@lemmy.world 3 hours ago
Again I get your point… but no reasonable plumber would make that mistake.
If I invite the dumbest plumber alive into my home, show him the leaky tub and say “I have to work but do whatever you need”… they would understand the context to mean “do whatever you need to fix the tub”… I doubt they would go make themselves a sandwich, grab a beer from the fridge and invite their buddies for a BBQ at my place and then say “but you said I could do whatever I needed”
I absolutely understand what happened here. The point is there is no benefit to these Agentic AIs because they need to be as supervised as a monkey with a knife… why would I ever want that? let alone need that
partial_accumen@lemmy.world 2 hours ago
To extend your analogy, agentic AI isn’t the “reasonable plumber”, its the sketchy guy that says he can fix plumbing and upon arrival he admits he’s a meth addict that hasn’t slept in 3 days and is seeing “the shadow people” standing right there in the room with you.
I can see applications for agentic AI, but they can’t be handed the keys to the kingdom. You put them in an indestructible room with a hammer and a pile of rocks and say “please crush any rock I hand you to be no bigger than a walnut and no smaller than an almond”. In IT terms, the agenic AI could run under a restrictive service account so that even if they went off the rails they wouldn’t be able to damage any thing you cared about.