How is Ollama compared to GPT models? I used the paid tier for work and I’m curious how this stacks up.
Comment on Google quietly released an app that lets you download and run AI models locally
AmbiguousProps@lemmy.today 3 weeks agoThat’s fair, but I think I’d rather self host an Ollama server and connect to it with an Android client in that case. Much better performance.
OhVenus_Baby@lemmy.ml 3 weeks ago
AmbiguousProps@lemmy.today 3 weeks ago
It’s decent, with the deepseek model anyway. It’s not as fast and has a lower parameter count though. You might just need to try it and see if it fits your needs or not.
Greg@lemmy.ca 3 weeks ago
Yes, that’s my setup. But this will be useful for cases where internet connection is not reliable