having the purpose explained helps

But does it? I suppose it could be the opposite as well, right? It seems like there is some inherent hazard connected to the motivation of answering a “why” question. It can open Pandora’s box of misalignment.

I mean, what if I’m against malls? Then I could decide I want nothing to do with this button. (Or even purposefully sabotage it in some way.)

It’s hard to overstate how permanent and omnipresent this hazard is: Even if there was an objective truth about good vs. evil and it was accessible to any conscious being just by exploration and thinking, there still would be this hazard because one cannot know how close to this truth the other one is.

A crazy thought: Maybe that’s why we have all these kinds of weird social phenomena, from interpersonal struggles, mental illness to social structures like family, state, religion… all this inability of people to really pull together has something to do with nature managing this constant hazard of misalignment. It must be chaotic is because it’s evolution: the only strategy that works long-term is to have all kinds of strategies present all the time. Maybe it’s actually adaptive for society as a whole – that’s why trying to fix broken people and societies is such a steep uphill battle.

“Why” is scary.