Comment on Based on this graph, and this graph alone, guess at what time I completely blocked OpenAI crawlers

<- View Parent
Techlos@lemmy.dbzer0.com ⁨1⁩ ⁨week⁩ ago

Bingo, modern datasets are a list of URL’s with metadata rather than the files themselves. Every new team/individual wanting to work with the dataset becomes another DDoS participant.

source
Sort:hotnewtop