I think it’s possible to have both in a federated system. Let the instance the user is on keep the tally of who upvoted what, and let the instance the post is on to know only the tally from other instances. Should be up to instances whether to show this data to users or not. This way it’d be easy to find and defederate single user instances manipulating votes.