Right? It’s crazy to think these kinds of people exist, but they are real and they make decisions for other people.
“The [AI] safety stuff is more visceral to me after a weekend of vibe hacking,” Lemkin said. I explicitly told it eleven times in ALL CAPS not to do this. I am a little worried about safety now.
cyrano@lemmy.dbzer0.com 10 months ago
User used the same db for prod and dev, user has no backup, LLM with db access is deleting it, user interacts with the LLM like it’s a human and ask it to apologize and follow promises of not doing it…… Oh and user doesn’t use git or any code linting/control.
But yeah it is the llm fault /s What is scary is this is the tip of the iceberg. I foresee a lot of security problems in the future if software development goes that way.
PhilipTheBucket@quokk.au 10 months ago
He actually did have a backup, because the company is only normal-stupid and not deliberate-stupid, they had a DB checkpoint he could roll back to.
The LLM, of course, went with the path of least resistance once it started down the "oh no I fucked up" completion prompt, and claimed they had no such checkpoint.
Don't use LLM for fact things, kids.