Society subjects people to a lot of things that people aren’t “perfectly fine with” but only some of them have wider implications for reputation, career chances, ostracizing,… and that is the main problem with this kind of technology.

Your assumption that people need deepfake technology to fantasize about people sexually who have no interest in being on the receiving end of that is at best naive and at worst arguing in bad faith.