Comment on Ollama not using AMD GPU on Arch Linux
30p87@feddit.org 5 weeks agoReally easy to start running it
Then everything goes wrong, from configuration over logs to cuda. And the worst fucking debugging ever.
Comment on Ollama not using AMD GPU on Arch Linux
30p87@feddit.org 5 weeks agoReally easy to start running it
Then everything goes wrong, from configuration over logs to cuda. And the worst fucking debugging ever.
possiblylinux127@lemmy.zip 5 weeks ago
On Linux you can download Alpaca. I think it is CPU only but it is simpler.
30p87@feddit.org 5 weeks ago
Ollama is simple too, I meant that containers make everything a nightmare to maintain.
possiblylinux127@lemmy.zip 5 weeks ago
If containers are the hard part you are doing it wrong. Containers should make it much easier.