Comment on Why are Google's Assistant(s) so bad nowadays?
claesj@lemmy.org 1 year ago
I’m wondering if there’s a paid and private-ish personal assistent. I’m turning away from all the software where I’m the product. Any ideas?
Hmmm I couldn’t really find anything. The only way to guarantee that is to have models that run purely locally, but until very recently that wasn’t feasible.
Smaller AI models that could ruin a phone are now doable, but making them useful requires a lot of dev time and only giant data-guzzling companies have tried so far.
Have you heard of Ollama? It’s an LLM engine that you can run at home. The speed, model size, context length, etc. that you can achieve really depends on your hardware. I’m using a low-mid graphics card and 32GB of RAM and get decent performance. Not lightning quick like ChatGPT but fine for simple tasks.
CaptDust@sh.itjust.works 1 year ago
I’ve been doing a 90 day test of perplexity pro and so far it’s my front runner. They recently launched an assistant that can launch instead of google assistants, can limit what info they collect, they don’t sell your data, and it connects to multiple models.