Comment on Everybody’s talking about Mistral, an upstart French challenger to OpenAI
joneskind@lemmy.world 9 months agoYou download the model and it’s on your computer for as long as you want. The whole point is to be able to use it locally.
Comment on Everybody’s talking about Mistral, an upstart French challenger to OpenAI
joneskind@lemmy.world 9 months agoYou download the model and it’s on your computer for as long as you want. The whole point is to be able to use it locally.
cheese_greater@lemmy.world 9 months ago
So it is entirely local? Schweet! How large is it?
joneskind@lemmy.world 9 months ago
I use
mistral-7b-instruct-v0.1.Q3_K_L.gguf3.82GB on the MBANote that it might crash sometimes during computation. Just push the button “reload” then “continue” and the model finish its sentence as if nothing happened. I don’t know if its related to MLStudio (the app using the model) or the model itself though.