Comment on Claude has taken control of my computer...
FierySpectre@lemmy.world 3 weeks agoThat’s the crazy thing here, it is interacting with programs in a way that is wildly inefficient. At some point stuff like this will be properly integrated, and that both scares and excites me.
Hackworth@lemmy.world 3 weeks ago
Yeah, using image recognition on a screenshot of the desktop and directing a mouse around the screen with coordinates is definitely an intermediate implementation. Open Interpreter, Shell-GPT, LLM-Shell, and DemandGen make a little more sense to me for anything that can currently done from a CLI, but I’ve never actually tested em.