I think in one sense it can be good. Sometimes it is counterproductive to downvote someone from 1 to 0. I think this would prevent that, as the first downvote is probably the most important one.

But I agree that making any data public will allow everyone to be categorized easily. “This person dislikes this content and likes other content.”

Remember, you are giving this info to everyone. Mark Zuckerberg will be able to see what you like and dislike in all public votes.