Right? It’s crazy to think these kinds of people exist, but they are real and they make decisions for other people.
“The [AI] safety stuff is more visceral to me after a weekend of vibe hacking,” Lemkin said. I explicitly told it eleven times in ALL CAPS not to do this. I am a little worried about safety now.
cyrano@lemmy.dbzer0.com 2 days ago
User used the same db for prod and dev, user has no backup, LLM with db access is deleting it, user interacts with the LLM like it’s a human and ask it to apologize and follow promises of not doing it…… Oh and user doesn’t use git or any code linting/control.
But yeah it is the llm fault /s What is scary is this is the tip of the iceberg. I foresee a lot of security problems in the future if software development goes that way.
PhilipTheBucket@quokk.au 2 days ago
He actually did have a backup, because the company is only normal-stupid and not deliberate-stupid, they had a DB checkpoint he could roll back to.
The LLM, of course, went with the path of least resistance once it started down the "oh no I fucked up" completion prompt, and claimed they had no such checkpoint.
Don't use LLM for fact things, kids.