andyburke@fedia.io 
Shimitar@downonthestreet.euLlama CPP can run models offloading with CPU (es MoE models), you have much more control over how you run your models, and overall it’s very much actively developed.
For starters and people without too much willingness to mess up with stuff, ollama is a great choice. Llama.cpp gives you that extra power and flexibility that is so much worth for people who like to tweak and do more.
My personal opinion, of course. But based on having used both and ditched ollama for llama.cpp, so I am also biased, keep in mind.
But I will hardly go back to ollama now :)
slazer2au@lemmy.world 3 weeks ago
It has been a while since I looked but Ollama use to be llama.CCP with a cloud wrapper before they forked it and rewrote it. In the same way postman is curl with a cloud wrapper.
Tossing the extra bit will make it use less resources and support the actual project not someone forking oss, slapping on a paint job, rewriting a core function and still calling it oss.