Old Protocol, New Problems: Robots.txt.

⁨4⁩ ⁨likes⁩

Submitted ⁨⁨3⁩ ⁨months⁩ ago⁩ by ⁨Tea@programming.dev⁩ to ⁨technology@lemmy.zip⁩

https://internet.exchangepoint.tech/old-protocol-new-problems-robots-txt/

Comments

Sort:hotnew top