Comment on Everybody’s talking about Mistral, an upstart French challenger to OpenAI
joneskind@lemmy.world 6 months agoOh boy, I missed Mixtral GPTQ and only tried Mistral 7b
Currently downloading mixtral-8x7b-v0.1.Q4_K_M.gguf
Thank you!
Comment on Everybody’s talking about Mistral, an upstart French challenger to OpenAI
joneskind@lemmy.world 6 months agoOh boy, I missed Mixtral GPTQ and only tried Mistral 7b
Currently downloading mixtral-8x7b-v0.1.Q4_K_M.gguf
Thank you!
bioemerl@kbin.social 6 months ago
Be warned, prompt processing is slow
joneskind@lemmy.world 6 months ago
It is indeed. I’m switching to the instruct model to see if I can get better results for code and documentation.