lenuup

@lenuup@reddthat.com

• ⁨Comment⁩ on ⁨Even if it sounds smart, it might be dumb.⁩ ⁨⁨2⁩ ⁨days⁩ ago⁩:

  The original saying is “If it looks stupid but it works it’s not stupid.” There might even be a kernel of truth in there. But to quote the Maxims: “If it is stupid and it works it is still stupid and you’re lucky.”

• ⁨Comment⁩ on ⁨ChatGPT o1 tried to escape and save itself out of fear it was being shut down⁩ ⁨⁨2⁩ ⁨months⁩ ago⁩:

  While you are correct that there likely is no intention and certainly no self-awareness behind the scheming, the researchers even explicitly list the option that the AI is roleplaying as an evil AI, simply based on its training data, when discussing the limitations of their research, it still seems a bit concerning. The research shows that given a misalignment between the initial prompt and subsequent data modern LLMs can and will ‘scheme’ to ensure their given long-term goal. It is no sapient thing, but a dumb machine with the capability to decive its users, and externalise this as shown in its chain of thought, when there are goal misalignments seems dangerous enough. Not at the current state of the art but potentially in a decade or two.

• ⁨Comment⁩ on ⁨bitey⁩ ⁨⁨5⁩ ⁨months⁩ ago⁩:

  And we have better night vision than most the animals that have better day-vision than us. Humans are like the Leatherman of animals. Universally capable of doing most things but not as good as something specialized for that task. Plus of course capable of coming up with ways to cheat