Comment on Chad scraper
Lemmesee@lemm.ee 8 months agoUsing Selenium for this is probably overkill. You might be better off sending direct HTTP requests with your form data. This way you don’t actually have to spin up an entire browser to perform that simple operation for you.
That said, if it works - it works!
kattenluik@feddit.nl 8 months ago
I’m guessing forms like this have CSRF protection, so you’d probably have to obtain that token and hope they don’t make a new one on every request.
Lemmesee@lemm.ee 8 months ago
Good point. This is also possible to overcome with one additional HTTP request and some HTML parsing. Still less overhead than running Selenium! In any event, I was replying in a general sense: Selenium is easy to understand and seems like an intuitive solution to a simple problem. In 99% of cases some additional effort will result in a more efficient solution.