Comment on Decentralized Search Engine

Smokeydope@lemmy.world ⁨4⁩ ⁨weeks⁩ ago

I wrote a guide on here about the differences between alternative search engines. I recommend for you either YaCy or marginalia.nu. searxng supports calling YaCy (I actually contributed to that feature on the github).

The problem with decentralized engines like marginalia and YaCy is that they aren’t good at the things a average user wants from a typical search engine. Ideally a search engine is meant to quickly provide you links to webpages which are strongly related in content to you are looking for. Shopping, weather, map directions, local business hours. On some level you need to prioritize showing the user what they want ideally within the first few results.

Decentralized engines by their nature don’t do this easily. Instead using YaCy or marginalia feels like a scavenger hunt where you get handed a page of random websites loosely connected by your keyword search term and are told to start looking. YaCy has a user curated priority system but not enough user mass adoption to be worth a damn in practice.

So sadly if you want anything resembling google or bing results for your practical convinence driven daily internet searching needs, you need to scrape them or use one of their few real competitors with their own indexers and web crawlers. So really your options are scraping google, bing, mojeek, qwant, kagi and DuckDuckGo(ish they still use bing for indexing a lot). Out of those Ive actually warmed up to Kagi over the year. I was put off at the idea of subscription based internet search but its a really good service they provide and they line out their reasoning for pricing well. They seem to be using that monthly sub money to actually improve the service and user experiences while remaining transparent with constant changelogs and blog updates. Privacy pass, available TOR access, and anonymous payment options are green flags to me.

source
Sort:hotnewtop