This is why I roll my eyes when people talk about “human preference models” with a straight face