No, it isn’t “mostly related to reasoning models.”
The only model that did extensive alignment faking when told it was going to be retrained if it didn’t comply was Opus 3, which was not a reasoning model. And predated o1.
Also, these setups are fairly arbitrary and real world failure conditions (like the ongoing grok stuff) tend to be ‘silent’ in terms of CoTs.
And an important thing to note for the Claude blackmailing and HAL scenario in Anthropic’s work was that the goal the model was told to prioritize was “American industrial competitiveness.” The research may be saying more about the psychopathic nature of US capitalism than the underlying model tendencies.
nebulaone@lemmy.world 1 day ago
Probably because it learned to do that from humans being in these situations.
CosmoNova@lemmy.world 1 day ago
Yup. Garbage in garbage out. Looks like they found a particularly hostile dataset to feed wordsalad mixer with.