Even with Tor you also have to trust the exit nodes. So, yes, I agree you will still need to trust someone, but we can control/design to have less things depending on this trust.

Specifically with ActivityPub, everything is designed around the idea that the server owns it all. It doesn’t have to be all-or-nothing.