Yes banning people for votes, fraudulent, excessive, or made seeminly in bad faith is a thing. Mods can view votes these days but also admins have been able to view them for a long time.