I’m sure this is the moment that will give pause and encourage caution with LLMs going forward. Yes. This time people will learn.
Two major AI coding tools wiped out user data after making cascading mistakes
Submitted 1 month ago by tonytins@pawb.social to technology@lemmy.world
Comments
salacious_coaster@infosec.pub 1 month ago
don@lemmy.ca 1 month ago
CEOs: wftlolnope bro we doin live neurosurgery with this bitch tomorrow!
qjkxbmwvz@startrek.website 1 month ago
From TFA:
“I have failed you completely and catastrophically,” Gemini CLI output stated. “My review of the commands confirms my gross incompetence.”
prole@lemmy.blahaj.zone 1 month ago
Most accurate thing an LLM has ever vomited up
echodot@feddit.uk 1 month ago
Oh no we’re definitely two years away from AGI.
DarkSurferZA@lemmy.world 1 month ago
Well, they train most of these with Reddit data, so judging by the iq of shit posters on Reddit, we are on track.
Also, there is a really slick feedback loop here. Reddit uses ai slop from last year to generate content, next year we train the ai using the posts from Reddit.
fodor@lemmy.zip 1 month ago
Hey, it’s good at fake apologies! As good as the CEO, no doubt.
gravitas_deficiency@sh.itjust.works 1 month ago
Fucking lmao this is the same level of idiocy as curling random shell scripts and piping them straight into bash
pupbiru@aussie.zone 1 month ago
the same? idk i think this is worse… who does vibe coding, sees the huge number of errors AI makes and THEN is like “yeah sure i’ll pipe that straight into a prod DB shell”
random bash scripts from reputable projects at least work most of the time
corsicanguppy@lemmy.ca 1 month ago
Again, they were running dev tools in prod.
That’s a mistake so dumb, it’s actually in the ISO that tells you how not to be a fuck up.
You don’t run your dev tools in prod.
fodor@lemmy.zip 1 month ago
You don’t, but AI does.
kablammy@sh.itjust.works 1 month ago
Yeah they seemed to be editing code live in production with no revision control. What morons.
Decq@lemmy.world 1 month ago
Wait, does this mean the Replit case was actually real!? I was sure it was just a sketch or rage bait. I didnt think anybody could be that stupid…
tonytins@pawb.social 1 month ago
It was real. The story itself certainly gives The Onion a run for their money.
Decq@lemmy.world 1 month ago
It had such a GLaDOS vibe, so i thought it was a reference to that. I guess life really does imitate art.
brsrklf@jlai.lu 1 month ago
“Eleven times in all caps” is going to be my mental image for vibe coders for a very long time. It sounds too stupid to be real, but, I want to believe.
TheBat@lemmy.world 1 month ago
I didnt think anybody could be that stupid…
Where have you been for the last 5 years?
And can I come wherever that was? Sounds blissful.
SkaveRat@discuss.tchncs.de 1 month ago
it’s either real, or the guy is really really sticking to the joke
panda_abyss@lemmy.ca 1 month ago
I would never admit this happened to me
I’m sure the number is higher than 2
cathfish@lemmy.world 1 month ago
Vive coder doesn’t even know git push? I think I don’t believe it.
nonentity@sh.itjust.works 1 month ago
Watching slopvangelical LLM thumpers slip up will never not be entertaining.
kyub@discuss.tchncs.de 1 month ago
AI has some use but it always needs human oversight and the final decision must also be made by a human professional. If you use AI to speed up tasks and you know whether the output of the AI is valid or not, and you have the final decision, then you can safely use it. But if you let AI decide on and execute important tasks basically autonomously, then you have a recipe for disaster. Fully autonomous and mistake-free AI is a naive pipe dream which I don’t see on the horizon at all.
Treczoks@lemmy.world 1 month ago
Sucks to be stupid enough to use AI instead of professionals. Especially when they actually trust AI more than any human programmer. Because human programmers code gets checked and verified before it moves to production.
percent@infosec.pub 1 month ago
A good craftsman never blames their tools
TeddE@lemmy.world 1 month ago
On one hand, it’s very clear the tools are the core of the problem.
On the other hand, I don’t think I’ll be calling any vibe coders good craftsman any time soon.
BiteSizedZeitGeist@lemmy.world 1 month ago
[deleted]percent@infosec.pub 1 month ago
Thanks! I edited it
geneva_convenience@lemmy.ml 1 month ago
It do be pasting random commands from stackoverflow
fodor@lemmy.zip 1 month ago
You say “mistakes” I say “features”. That’s what they wanted, right? Humans are not accountable, couldn’t be helped, that’s life.
rizzothesmall@sh.itjust.works 1 month ago
If your product manager is capable of destroying your production data by accident with shitty ai code then you have fundamental infrastructure issues that made such data loss inevitable.
tranceFusion@lemmy.zip 1 month ago
They are making the infrastructure with the same shitty AI code…
XTL@sopuli.xyz 1 month ago
And/or windows admins.
nomecks@lemmy.wtf 1 month ago
Nut up and push to main
AlphaOmega@lemmy.world 1 month ago
Everyone knows that an excel plain text database is the best