There this website that I highly value kellogg.umich.edu/theeyeshaveit/index.html I would like to crawl all pages within this website and save all pages on my PC.
You can get the internet archive extension and archive it for everyone forever
Submitted 10 months ago by Moxible@monyet.cc to technology@lemmy.world
There this website that I highly value kellogg.umich.edu/theeyeshaveit/index.html I would like to crawl all pages within this website and save all pages on my PC.
You can get the internet archive extension and archive it for everyone forever
That would be even better. I will look it up.
Try HTTrack: www.httrack.com
whaleross@lemmy.world 10 months ago
If you are comfortable with command line and want to learn the Swiss army knife of such uses for future scripting and whatnot - curl.
I’m on the fly right now but search for “curl crawl web pages” and you’ll find.