Comment on Why is my home server using so much RAM for cache + buffer?
A9nWGzYt@lemmy.dbzer0.com 5 days agoThanks for the tip. I have been looking into commenting out the ollama portion of the docker-compose.yml file and setting up llama.cpp instead for some time now. I suspect I don’t usually use features such as ollama pull to justify a fully-featured application.
Here is my experience wiki.gardiol.org/7-services/llamacpp
No ads no monetization just a wiki I keep for my future reference.
Never been happier than moving to llamacpp from ollama.