Looks like for the hardware requirements for self hosting some of the open source options, I’ll be saving up quite a bit for SSDs.
A look at search engines with their own indexes
Submitted 3 weeks ago by paequ2@lemmy.today to technology@lemmy.world
https://seirdy.one/posts/2021/03/10/search-engines-with-own-indexes/
Comments
sorghum@sh.itjust.works 3 weeks ago
frezik@lemmy.blahaj.zone 3 weeks ago
FWIW, I gave YaCy a try a while back, and I agree with the article on that one. Shit tier results that make ancient AltaVista look good. Might be fine for intranet search. I like the idea of its distributed hosting, but pass on this one.
Other poster mentioned SearXNG, and while I haven’t delved into that too much, it’s probably worth a check. Pass on YaCy.
whaleross@lemmy.world 3 weeks ago
SearXNG is a meta search entirely reliant on other services.
swelter_spark@reddthat.com 2 weeks ago
I really like Yacy’s results, personally. It seems good for the kinds of sites I care about. My biggest problem with it is that the newest version is so memory-hungry.
fmstrat@lemmy.nowsci.com 3 weeks ago
Consider self-hosting SearXNG, which can aggregate results and filter.
sorghum@sh.itjust.works 3 weeks ago
Already am, but it still pulls results from the companies I want to separate myself from. I’d rather see what it takes/how well it performs to have my own indexer.
RecursiveParadox@lemmy.world 3 weeks ago
That was a good read, well done! I’d be interested if you ever reconsider Startpage. I’ve had good success with that on my work computer.
frongt@lemmy.zip 3 weeks ago
The plural of index is indices.
paequ2@lemmy.today 3 weeks ago
indexes
is valid: www.merriam-webster.com/dictionary/indexaBundleOfFerrets@sh.itjust.works 2 weeks ago
The article addresses that in a footnote
Glitchvid@lemmy.world 3 weeks ago
Great article, appreciate that I’m not the only one concerned around some of the ethical choices Kagi has been making.
Jack_Burton@lemmy.ca 3 weeks ago
I got a sub to Kagi a few months ago. It seems pretty good but I’m behind on the news. I’ve read a few things here and there, but can you explain a bit about the ethics?
Glitchvid@lemmy.world 3 weeks ago
Last I saw they still paid Yandex for access to that index (weigh how important that is yourself), they also pushed back on suicide warnings if you ask Kagi how to kill yourself, and I learned from this article that they may be using additional data sources that contain higher levels of homophobic sentiment.
Basically, the company’s tagline is “Humanize the Web”, but I don’t think their actions thus far show we agree on what Humanize means.
isaaclyman@lemmy.world 2 weeks ago
Same. I use Kagi because search is an essential function of my job and I can’t extract decent results from Google anymore, but if there were another engine with equally good results and a better ethical track record I’d switch.
(There isn’t. I’ve tried Qwant, Ecosia, DuckDuckGo and a handful of others. Was not impressed.)
Glitchvid@lemmy.world 2 weeks ago
I share the sentiment. The results are acceptable, and being able to custom rank sites in results is very useful, but the killer feature is not having ads or forcing AI down my throat.
tuckerm@feddit.online 3 weeks ago
Great list! I've been wanting to start using a smaller search engine with its own index, just for the sake of making sure there's an alternative to GBY. (Also, there's a new and useful acronym, haha.) Mojeek was the only one I was aware of before today.
BTW, exalead.com doesn't seem to be a search engine anymore. I recognized that one because I remember discovering it a while ago...in 2007, maybe? But it looks like it's not available as a regular search engine now.
oce@jlai.lu 3 weeks ago
It should mention that Qwant (France) and Ecosia (Germany), announced last year a joint project for an independent European search index, although only for French and German according to this publication. …qwant.com/…/ecosia-and-qwant-join-forces-to-deve…
grue@lemmy.world 3 weeks ago
On doit apprendre le français (ou l’allemand) pour rechercher le web sans indices Américains? Défi accepté!