Is scraping reddit’s HTML without using an API doable? I’m not sure if the reddit RSS feed has any notion of upvotes/popularity.
Comment on An idea for more content on Lemmy (and the fediverse): Relly (Relay+Lemmy)
djtech@lemmy.world 8 months agoYes, and the fact that it doesn’t post any link that was already posted in the last 48 hours avoid spamming.
I think that subreddits could be usable using the RSS feed system, as Reddit API are expensive and if we set up a RSS feed containing the top of 24 hours, we can extract links from there.
yote_zip@pawb.social 8 months ago
djtech@lemmy.world 8 months ago
I had to enter reddit (eeewww…,) but I found it: reddit.com/…/how_to_get_rss_feed_of_a_subreddit_w… Check the first comment.
djtech@lemmy.world 8 months ago
I should check, but if i remeber correctly, i had some subreddits that i read on newsboat using some kind of option in the RSS link in order to get the top. (something like
?top=24hrsor like that)
rglullis@communick.news 8 months ago
You can make basically any “read” operation on reddit without an API key. The problem is rate-limiting. You can at most make only 600 requests for every 10 minutes.