Actually I misunderstood the way that GoToSocial attachment URLs work. Turns out attachments *are* being served from our CDN. So this is all done :)

You should hopefully notice that attachments load much faster, both when viewing posts from other users and when other users view posts from you. :)