Comment on SearNGX should be a federated search engine
fmstrat@lemmy.nowsci.com 3 months agoWell, I am, including products in the Fediverse. And I never said federate the search queries.
Trying to build an index of the web by querying other search engines is not an efficient or sensible way to do things.
Never made this suggestion.
On the other hand a distributed web crawler that puts its results in a free and decentralized database
Now you’re getting there.
kbal@fedia.io 3 months ago
Okay, sorry! Still a long way to go before the idea becomes sufficiently well-specified to make much sense to me though. Perhaps an examination of yacy could provide you a concrete example of the ways in which such things are complicated. One would need to do much better to end up with a suitable replacement for the ways many of us use searx.
It was wanting to use ActivityPub and the "I fail to see any downside" which led me to read the rest of your post in a way that might've been overly pessimistic about its merits.
fmstrat@lemmy.nowsci.com 3 months ago
Yea, another user has suggested passing along the request to other instances when API limits are hit. That sounds like a better model for SearXNG specifically.