I’m sure this is the moment that will give pause and encourage caution with LLMs going forward. Yes. This time people will learn.
Two major AI coding tools wiped out user data after making cascading mistakes
Submitted 2 months ago by tonytins@pawb.social to technology@lemmy.world
Comments
salacious_coaster@infosec.pub 2 months ago
don@lemmy.ca 2 months ago
CEOs: wftlolnope bro we doin live neurosurgery with this bitch tomorrow!
qjkxbmwvz@startrek.website 2 months ago
From TFA:
“I have failed you completely and catastrophically,” Gemini CLI output stated. “My review of the commands confirms my gross incompetence.”
prole@lemmy.blahaj.zone 2 months ago
Most accurate thing an LLM has ever vomited up
echodot@feddit.uk 2 months ago
Oh no we’re definitely two years away from AGI.
DarkSurferZA@lemmy.world 2 months ago
Well, they train most of these with Reddit data, so judging by the iq of shit posters on Reddit, we are on track.
Also, there is a really slick feedback loop here. Reddit uses ai slop from last year to generate content, next year we train the ai using the posts from Reddit.
fodor@lemmy.zip 2 months ago
Hey, it’s good at fake apologies! As good as the CEO, no doubt.
gravitas_deficiency@sh.itjust.works 2 months ago
Fucking lmao this is the same level of idiocy as curling random shell scripts and piping them straight into bash
pupbiru@aussie.zone 2 months ago
the same? idk i think this is worse… who does vibe coding, sees the huge number of errors AI makes and THEN is like “yeah sure i’ll pipe that straight into a prod DB shell”
random bash scripts from reputable projects at least work most of the time
corsicanguppy@lemmy.ca 2 months ago
Again, they were running dev tools in prod.
That’s a mistake so dumb, it’s actually in the ISO that tells you how not to be a fuck up.
You don’t run your dev tools in prod.
fodor@lemmy.zip 2 months ago
You don’t, but AI does.
kablammy@sh.itjust.works 2 months ago
Yeah they seemed to be editing code live in production with no revision control. What morons.
Decq@lemmy.world 2 months ago
Wait, does this mean the Replit case was actually real!? I was sure it was just a sketch or rage bait. I didnt think anybody could be that stupid…
tonytins@pawb.social 2 months ago
It was real. The story itself certainly gives The Onion a run for their money.
Decq@lemmy.world 2 months ago
It had such a GLaDOS vibe, so i thought it was a reference to that. I guess life really does imitate art.
brsrklf@jlai.lu 2 months ago
“Eleven times in all caps” is going to be my mental image for vibe coders for a very long time. It sounds too stupid to be real, but, I want to believe.
TheBat@lemmy.world 2 months ago
I didnt think anybody could be that stupid…
Where have you been for the last 5 years?
And can I come wherever that was? Sounds blissful.
SkaveRat@discuss.tchncs.de 2 months ago
it’s either real, or the guy is really really sticking to the joke
panda_abyss@lemmy.ca 2 months ago
I would never admit this happened to me
I’m sure the number is higher than 2
cathfish@lemmy.world 2 months ago
Vive coder doesn’t even know git push? I think I don’t believe it.
nonentity@sh.itjust.works 2 months ago
Watching slopvangelical LLM thumpers slip up will never not be entertaining.
kyub@discuss.tchncs.de 2 months ago
AI has some use but it always needs human oversight and the final decision must also be made by a human professional. If you use AI to speed up tasks and you know whether the output of the AI is valid or not, and you have the final decision, then you can safely use it. But if you let AI decide on and execute important tasks basically autonomously, then you have a recipe for disaster. Fully autonomous and mistake-free AI is a naive pipe dream which I don’t see on the horizon at all.
Treczoks@lemmy.world 2 months ago
Sucks to be stupid enough to use AI instead of professionals. Especially when they actually trust AI more than any human programmer. Because human programmers code gets checked and verified before it moves to production.
percent@infosec.pub 2 months ago
A good craftsman never blames their tools
TeddE@lemmy.world 2 months ago
On one hand, it’s very clear the tools are the core of the problem.
On the other hand, I don’t think I’ll be calling any vibe coders good craftsman any time soon.
BiteSizedZeitGeist@lemmy.world 2 months ago
[deleted]percent@infosec.pub 2 months ago
Thanks! I edited it
geneva_convenience@lemmy.ml 2 months ago
It do be pasting random commands from stackoverflow
fodor@lemmy.zip 2 months ago
You say “mistakes” I say “features”. That’s what they wanted, right? Humans are not accountable, couldn’t be helped, that’s life.
rizzothesmall@sh.itjust.works 2 months ago
If your product manager is capable of destroying your production data by accident with shitty ai code then you have fundamental infrastructure issues that made such data loss inevitable.
tranceFusion@lemmy.zip 2 months ago
They are making the infrastructure with the same shitty AI code…
XTL@sopuli.xyz 2 months ago
And/or windows admins.
nomecks@lemmy.wtf 2 months ago
Nut up and push to main
AlphaOmega@lemmy.world 2 months ago
Everyone knows that an excel plain text database is the best