There this website that I highly value kellogg.umich.edu/theeyeshaveit/index.html I would like to crawl all pages within this website and save all pages on my PC.
You can get the internet archive extension and archive it for everyone forever
Submitted 9 months ago by Moxible@monyet.cc to technology@lemmy.world
There this website that I highly value kellogg.umich.edu/theeyeshaveit/index.html I would like to crawl all pages within this website and save all pages on my PC.
You can get the internet archive extension and archive it for everyone forever
That would be even better. I will look it up.
Try HTTrack: www.httrack.com
whaleross@lemmy.world 9 months ago
If you are comfortable with command line and want to learn the Swiss army knife of such uses for future scripting and whatnot - curl.
I’m on the fly right now but search for “curl crawl web pages” and you’ll find.