Comment on Everybody’s talking about Mistral, an upstart French challenger to OpenAI
GBU_28@lemm.ee 6 months agoAre you running llama.cpp and a gguf format of the model?
Comment on Everybody’s talking about Mistral, an upstart French challenger to OpenAI
GBU_28@lemm.ee 6 months agoAre you running llama.cpp and a gguf format of the model?
daredevil@kbin.social 6 months ago
I believe I was when I tried it before, but it's possible I may have misconfigured things
GBU_28@lemm.ee 6 months ago
Have you checked out llama-cpp-python? The API is very simple, from the readme
daredevil@kbin.social 6 months ago
I haven't, but I'll keep this in mind for the future -- thanks.