Comment on Google Is the Only Search Engine That Works on Reddit Now Thanks to AI Deal
hotpot8toe@lemmy.world 3 months agoAlso, rate limiting. A publicly accessible website doesn’t mean that it will allow scrapers to read millions of pages each week. They can easily identify and block scrapers because of the pattern of their activity. I don’t know if Reddit has rate-limiting, but I wouldn’t be surprised if they implement one.