Comment on Google Using Generic & Undocumented Google Crawler

Flyswat@lemmy.dbzer0.com ⁨1⁩ ⁨week⁩ ago

Can we get rid of the current model where websites are financed by ads and have instead these AI companies pay the websites they crawl?

I could really do with less ads if they are going to crawl the web anyway.

source
Sort:hotnewtop