I’m sure this is the moment that will give pause and encourage caution with LLMs going forward. Yes. This time people will learn.
Two major AI coding tools wiped out user data after making cascading mistakes
Submitted 3 weeks ago by tonytins@pawb.social to technology@lemmy.world
Comments
salacious_coaster@infosec.pub 3 weeks ago
don@lemmy.ca 3 weeks ago
CEOs: wftlolnope bro we doin live neurosurgery with this bitch tomorrow!
qjkxbmwvz@startrek.website 3 weeks ago
From TFA:
“I have failed you completely and catastrophically,” Gemini CLI output stated. “My review of the commands confirms my gross incompetence.”
prole@lemmy.blahaj.zone 3 weeks ago
Most accurate thing an LLM has ever vomited up
echodot@feddit.uk 2 weeks ago
Oh no we’re definitely two years away from AGI.
DarkSurferZA@lemmy.world 2 weeks ago
Well, they train most of these with Reddit data, so judging by the iq of shit posters on Reddit, we are on track.
Also, there is a really slick feedback loop here. Reddit uses ai slop from last year to generate content, next year we train the ai using the posts from Reddit.
fodor@lemmy.zip 2 weeks ago
Hey, it’s good at fake apologies! As good as the CEO, no doubt.
gravitas_deficiency@sh.itjust.works 2 weeks ago
Fucking lmao this is the same level of idiocy as curling random shell scripts and piping them straight into bash
pupbiru@aussie.zone 2 weeks ago
the same? idk i think this is worse… who does vibe coding, sees the huge number of errors AI makes and THEN is like “yeah sure i’ll pipe that straight into a prod DB shell”
random bash scripts from reputable projects at least work most of the time
corsicanguppy@lemmy.ca 2 weeks ago
Again, they were running dev tools in prod.
That’s a mistake so dumb, it’s actually in the ISO that tells you how not to be a fuck up.
You don’t run your dev tools in prod.
fodor@lemmy.zip 2 weeks ago
You don’t, but AI does.
kablammy@sh.itjust.works 2 weeks ago
Yeah they seemed to be editing code live in production with no revision control. What morons.
Decq@lemmy.world 3 weeks ago
Wait, does this mean the Replit case was actually real!? I was sure it was just a sketch or rage bait. I didnt think anybody could be that stupid…
tonytins@pawb.social 3 weeks ago
It was real. The story itself certainly gives The Onion a run for their money.
Decq@lemmy.world 2 weeks ago
It had such a GLaDOS vibe, so i thought it was a reference to that. I guess life really does imitate art.
brsrklf@jlai.lu 3 weeks ago
“Eleven times in all caps” is going to be my mental image for vibe coders for a very long time. It sounds too stupid to be real, but, I want to believe.
TheBat@lemmy.world 3 weeks ago
I didnt think anybody could be that stupid…
Where have you been for the last 5 years?
And can I come wherever that was? Sounds blissful.
SkaveRat@discuss.tchncs.de 3 weeks ago
it’s either real, or the guy is really really sticking to the joke
panda_abyss@lemmy.ca 2 weeks ago
I would never admit this happened to me
I’m sure the number is higher than 2
cathfish@lemmy.world 3 weeks ago
Vive coder doesn’t even know git push? I think I don’t believe it.
nonentity@sh.itjust.works 2 weeks ago
Watching slopvangelical LLM thumpers slip up will never not be entertaining.
kyub@discuss.tchncs.de 2 weeks ago
AI has some use but it always needs human oversight and the final decision must also be made by a human professional. If you use AI to speed up tasks and you know whether the output of the AI is valid or not, and you have the final decision, then you can safely use it. But if you let AI decide on and execute important tasks basically autonomously, then you have a recipe for disaster. Fully autonomous and mistake-free AI is a naive pipe dream which I don’t see on the horizon at all.
Treczoks@lemmy.world 2 weeks ago
Sucks to be stupid enough to use AI instead of professionals. Especially when they actually trust AI more than any human programmer. Because human programmers code gets checked and verified before it moves to production.
percent@infosec.pub 2 weeks ago
A good craftsman never blames their tools
TeddE@lemmy.world 2 weeks ago
On one hand, it’s very clear the tools are the core of the problem.
On the other hand, I don’t think I’ll be calling any vibe coders good craftsman any time soon.
BiteSizedZeitGeist@lemmy.world 2 weeks ago
[deleted]percent@infosec.pub 2 weeks ago
Thanks! I edited it
puppinstuff@lemmy.ca 2 weeks ago
Most tradespeople are responsible for choosing and maintaining their own tools. In a lot of cases it’s the foreman of this metaphor who is making the choice and should be taking the blame.
geneva_convenience@lemmy.ml 2 weeks ago
It do be pasting random commands from stackoverflow
fodor@lemmy.zip 2 weeks ago
You say “mistakes” I say “features”. That’s what they wanted, right? Humans are not accountable, couldn’t be helped, that’s life.
rizzothesmall@sh.itjust.works 3 weeks ago
If your product manager is capable of destroying your production data by accident with shitty ai code then you have fundamental infrastructure issues that made such data loss inevitable.
tranceFusion@lemmy.zip 2 weeks ago
They are making the infrastructure with the same shitty AI code…
XTL@sopuli.xyz 2 weeks ago
And/or windows admins.
nomecks@lemmy.wtf 2 weeks ago
Nut up and push to main
AlphaOmega@lemmy.world 2 weeks ago
Everyone knows that an excel plain text database is the best