Comment on Ollama not using AMD GPU on Arch Linux
possiblylinux127@lemmy.zip 5 weeks agoBecause that is way more complicated?
It is really easy to run ollama in a container.
Comment on Ollama not using AMD GPU on Arch Linux
possiblylinux127@lemmy.zip 5 weeks agoBecause that is way more complicated?
It is really easy to run ollama in a container.
30p87@feddit.org 5 weeks ago
Really easy to start running it
Then everything goes wrong, from configuration over logs to cuda. And the worst fucking debugging ever.
possiblylinux127@lemmy.zip 5 weeks ago
On Linux you can download Alpaca. I think it is CPU only but it is simpler.
30p87@feddit.org 5 weeks ago
Ollama is simple too, I meant that containers make everything a nightmare to maintain.
possiblylinux127@lemmy.zip 5 weeks ago
If containers are the hard part you are doing it wrong. Containers should make it much easier.