Comment on Community discovery on self hosted Lemmy instances
muddybulldog@mylemmy.win 10 months ago
I use [github.com/Fmstrat/lcs](Lemmy Community Seeder). Every four hours it checks the top posts on instances you specifies and automatically subscribes you to communities that appear there but you aren’t already subscribed to. You can tweak it to ignore specific communities or instances.
felix@lemmy.felixperron.com 10 months ago
That’s amazing! I’m gonna set it up on my instance
cstine@lemmy.uncomfortable.business 10 months ago
Keep in mind that you’re going to be retrieving and storing a huge amount of data running these scripts, and you should expect to need more than a $5 1gb of RAM vps to do it without it being a shitty broken experience for you.
We’re talking dozens of gigabytes of storage for the database, plus effectively a need for an infinite amount of storage for the image caching, plus enough RAM and CPU resources to effectively process the whole Threadiverse.
muddybulldog@mylemmy.win 10 months ago
True dat. I’ve been running it about seven weeks and am pulling about 700 communities. Most have near zero traffic but the high volume ones do add up.