The Facebook bots are probably trying to make every lesser site feel bad about itself by comparing them to the much cooler and popular sites.
Comment on Meta is secretly building its own search engine.
vk6flab@lemmy.radio 2 weeks ago
Yeah, good luck with that. The Facebook bots are so bad, they literally hammer sites into the ground, to the point where they’re actively being blocked.
Boozilla@lemmy.world 2 weeks ago
purrtastic@lemmy.nz 2 weeks ago
Just yesterday I banned Facebook’s user agent that is supposedly only used to generate link previews. It was being extremely aggressive, making 20 requests per second. At the time I thought “I bet they’re actually building their own search index”, and here we are.