Comment on Everybody’s talking about Mistral, an upstart French challenger to OpenAI
joneskind@lemmy.world 11 months agoYou download the model and it’s on your computer for as long as you want. The whole point is to be able to use it locally.
Comment on Everybody’s talking about Mistral, an upstart French challenger to OpenAI
joneskind@lemmy.world 11 months agoYou download the model and it’s on your computer for as long as you want. The whole point is to be able to use it locally.
cheese_greater@lemmy.world 11 months ago
So it is entirely local? Schweet! How large is it?
joneskind@lemmy.world 11 months ago
I use
mistral-7b-instruct-v0.1.Q3_K_L.gguf3.82GB on the MBANote that it might crash sometimes during computation. Just push the button “reload” then “continue” and the model finish its sentence as if nothing happened. I don’t know if its related to MLStudio (the app using the model) or the model itself though.