I think from the libertarian point of view, being compelled to do something is bad even if that thing itself isn’t all that difficult or unpleasant. I’m a pretty stubborn, libertarian-leaning person myself and I would resent doing even all my favorite things in the world if the government were making me do them.

(I still wouldn’t make the comparison to slavery myself.)