Its probably not that people are shit talking behind backs and more that the people who really care are extremely vocal. Everyone that is indifferent or supportive probably doesn’t have the need to bring it up every chance they get. They have other things that worry them.