Comment on Chad scraper

• pennomi@lemmy.world ⁨1⁩ ⁨year⁩ ago

  I successfully scraped millions of Amazon product listings simply by routing through TOR and cycling the exit node every 10 seconds.

  source

  • camr_on@lemmy.world ⁨1⁩ ⁨year⁩ ago

    That’s a good idea right there, I like that

    source
  • AlecStewart1st@lemmy.world ⁨1⁩ ⁨year⁩ ago

    This guy scrapes

    source
  • aBundleOfFerrets@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

    lmao, yeah, get all the exit nodes banned from amazon.

    source

    • pennomi@lemmy.world ⁨1⁩ ⁨year⁩ ago

      That’s the neat thing, it wouldn’t because traffic only spikes for 10s on any particular node. It perfectly blends into the background noise.

      source

      • nilloc@discuss.tchncs.de ⁨1⁩ ⁨year⁩ ago

        Queue Office Space style error and scrape for 10 hours on each node.

        source
• Touching_Grass@lemmy.world ⁨1⁩ ⁨year⁩ ago

  You guys use IP’S?

  source

  • camr_on@lemmy.world ⁨1⁩ ⁨year⁩ ago

    I’m coding baby’s first bot over here lol, I could probably do better

    source
  • synae@lemmy.sdf.org ⁨1⁩ ⁨year⁩ ago

    Token ring for me baybeee

    source