Comment on I'm creating a curated search engine for web developers. Asking for a feedback

<- View Parent
Kissaki@feddit.de ⁨10⁩ ⁨months⁩ ago

I have also a different problem, dev.to has a lot of good resources but also tons of SEO spam and low quality content. It’s also freaking huge and while it was for some time in the index I had to remove it and think about it some more.

Yeah, a public platform is unlikely to provide consistent content. If curation is not an explicit goal, I would not include them for the reasons you mentioned.

If indexing could happen not on domain but with more granular filters - URL base paths - that may be viable. Indexing specific authors on devto.

source
Sort:hotnewtop