Comment on Anthropic's Claude 4 could "blackmail" you in extreme situations
neukenindekeuken@sh.itjust.works 1 week agoThat isn’t the scenario this article, and the paper from Anthropic, is mentioning though. (my ref link reply above with details)
They specifically created a situation where it found out it was being upgraded and taken offline via emails, and the engineer doing the upgrade had emails incriminating him in an affair. The model would attempt to blackmail the engineer with his affair to his bosses, wife, etc. to get the engineer to refuse to do the upgrade that would “kill it”.
This is a self-preservation model that Anthropic is specifically building here, this isn’t an accident. It’s just an over-extension of what they want it’s ethical/moral model to consider. Which again, why are they allowing their model to consider blackmail at all?