Comment on SearNGX should be a federated search engine

• kbal@fedia.io ⁨3⁩ ⁨months⁩ ago

  Ah, I wondered if something like that had been tried before. Looks like it is maybe still running: https://yacy.net/

  source

  • Buelldozer@lemmy.today ⁨3⁩ ⁨months⁩ ago

    There’s only been about 700 yacy peers online in the last 30 days which is pretty low for a “crowd sourced” search engine, especially when many of those are, I think, temporary peers that come and go. It looks like it has only maybe 200 “master” servers which wouldn’t be nearly enough to keep up with the Internet these days.

    The good news is that if there’s websites / urls that you care about you can point your own yacy instance at them and schedule the crawls to keep up with content changes.

    I remember reading about yacy some years ago and now that I’ve bumped it into again it’s sparked my interest. I may stand up a docker instance and play with it for awhile.

    source
  • Wxnzxn@lemmy.ml ⁨3⁩ ⁨months⁩ ago

    I ran an instance for a while out of curiosity a few years back - building the database seemed to work fine and appeared like a good idea, had a lot of fun to see the connections with other servers and my crawler filling holes of unknown spaces. But I think the search algorithm itself was (most likely is) not sophisticated enough, it just did not give relevant results often enough, and it was extremely vulnerable to very simple SEO tactics to push trash to the top.

    source