Comment on I use Zip Bombs to Protect my Server
catloaf@lemm.ee 2 months agoCompetent ones, yes. Most developers aren’t competent, scraper writers even less so.
Comment on I use Zip Bombs to Protect my Server
catloaf@lemm.ee 2 months agoCompetent ones, yes. Most developers aren’t competent, scraper writers even less so.
idriss@lemm.ee 2 months ago
That’s true. Scrapping is a gold mine for the people that don’t know. I worked for a place which crawls the internet and beyond (fetches some internal dumps we pay for). There is no chance a zip bomb would crash the workers as there are strict timeouts and smell tests (even if a does it will crash an ECS task at worst and we will be alerted to fix that within a short time). We were as honest as it gets though, following GDPR, honoring the robots file, no spiders or scanners allowed, only home page to extract some insights.
I am aware of some big name EU non-software companies very interested in keeping an eye on some key things that are only possible with scraping.