Comment on I'm creating a curated search engine for web developers. Asking for a feedback
onlinepersona@programming.dev 9 months ago
How is it specifically dev focused? How will the crawler know that the site or page is dev related?
Comment on I'm creating a curated search engine for web developers. Asking for a feedback
onlinepersona@programming.dev 9 months ago
How is it specifically dev focused? How will the crawler know that the site or page is dev related?
sznowicki@lemmy.world 9 months ago
The crawler takes only the sources that are defined in the crawler repo (it’s open source, check the github org or kukei-spider).
So in this way it’s “curated” in a sense that it would not add anything else to the index.