Comment

Comment on Google's Agentic AI wipes user's entire HDD without permission in catastrophic failure

The user can choose whether the AI can run commands on its own or ask first.

That implies the user understands every single code with every single parameters. That’s impossible even for experience programmers, here is an example :

rm *filename

versus

rm * filename

where a single character makes the entire difference between deleting all files ending up with filename rather than all files in the current directory and also the file named filename.

Of course here you will spot it because you’ve been primed for it. In a normal workflow then it’s totally difference.

Also IMHO more importantly if you watch the video ~7min the clarified the expected the “agent” to stick to the project directory, not to be able to go “out” of it.

source

Sort:hotnew top

Jhex@lemmy.world ⁨9⁩ ⁨hours⁩ ago

That implies the user understands every single code with every single parameters. That’s impossible even for experience programmers

I wouldn’t say impossible but I would say it completely defeats the purpose of these agentic AIs

Either I know and understand these commands so well I can safely evaluate them, therefore I really do not need the AI… or, I don’t really know them well and therefore I shouldn’t use the AI

source
- utopiah@lemmy.world ⁨9⁩ ⁨hours⁩ ago
  Yep. That’s exactly why I tend to never discuss “AI” with people who don’t have to actually have a PhD in the domain, or at least a degree in CS. It’s nothing against them specifically, it’s only that they are dangerously repeating what they heard during marketing presentations with no ability to criticize it and, in such cases, it can be quite dangerous.
  
  TL;DR: people who could benefit from it don’t need it, people who would shouldn’t.
  
  source
  - 87Six@lemmy.zip ⁨9⁩ ⁨hours⁩ ago
    100% agree with that tldr
    
    source
  - Jhex@lemmy.world ⁨8⁩ ⁨hours⁩ ago
    This is EXACTLY the YouTube woodworkers dilemma…
    
    TONs of YT channels to show people how to do woodwork would normally showcase $50K worth of equipment to show how to make a cutting board.
    
    The thing is, people with access to such equipment, already know how to make a cutting board and are learning nothing from you… on the other hand, newbies who what to know what is this “sanding” thing they have heard, will not benefit from the vid since they do not have those tools, they’d have crappy manual tools at most.
    
    Therefore, those videos are completely useless for learning… at best, they made for good background noise while people eat their lunches in their cubicles
    
    source
    utopiah@lemmy.world ⁨6⁩ ⁨hours⁩ ago
    I agree… but beside the point I have access to a dedicated workshop and a tool library www.tournevie.be which challenges this whole setup. It’s relatively unique though, unfortunately, so your example still stands, thanks for sharing.
    
    source