It’s only in part trained on Twitter and it wouldn’t really matter either way what Twitter’s alignment was.

What matters is how it’s being measured.

Do you want a LLM that aces standardized tests and critical thinking questions? Then it’s going to bias towards positions held by academics and critical thinkers.

If you want an AI aligned to say that gender is binary and that Jews control the media, expect it to also say the earth is flat and lizard people are real.

Often reality has a ‘liberal’ bias.