They need the content to be available for Google indexing reasons, it can only really be blocked through the client.

A smart enough backend system can access/crawl/index it, just like Google can. And then make it available to the public without the front end annoyance.