Have you ever tried writing a scrapper. I have for offline reference material. You’ll do that a few times and know. I usually only want a relatively small site (say a Khan Academy lesson which doesn’t save text offline, just videos) and put in a large delay between requests but I’ll still come back after thinking I have it down and it’s thrashed something