Puts the full EU regulations in robot.txt
Can you just turn the robots.txt into a click wrap agreement to charge robots high fees for access above a certain threshold?
Valmond@lemmy.world 1 week ago
Can you just turn the robots.txt into a click wrap agreement to charge robots high fees for access above a certain threshold?
Puts the full EU regulations in robot.txt
carrylex@lemmy.world 1 week ago
why do a agreement when you can serve a zip bomb :D