I ban spam bots almost daily, but I could probably count on my fingers the times I’ve banned human accounts. Unless people start flinging personal abuse or break site rules, we’re usually happy to let the vote buttons do their thing.