The website would also have to display to users at the end of the day. It’s a similar problem as trying to solve media piracy. Worst comes to it, the crawlers could read the page like a person would.
The website would also have to display to users at the end of the day. It’s a similar problem as trying to solve media piracy. Worst comes to it, the crawlers could read the page like a person would.
acockworkorange@mander.xyz 5 weeks ago
You could have a server for open code access with very limited bandwidth and another for authenticated users with higher bandwidth.