Comment on Based on this graph, and this graph alone, guess at what time I completely blocked OpenAI crawlers

<- View Parent
Techlos@lemmy.dbzer0.com ⁨4⁩ ⁨weeks⁩ ago

Bingo, modern datasets are a list of URL’s with metadata rather than the files themselves. Every new team/individual wanting to work with the dataset becomes another DDoS participant.

source
Sort:hotnewtop