Comment on Everybody’s talking about Mistral, an upstart French challenger to OpenAI

• joneskind@lemmy.world ⁨9⁩ ⁨months⁩ ago

  So it is entirely local? Absolutely

  How large is it? 12 models of quantization, from 3.08GB to 7.70GB

  I use mistral-7b-instruct-v0.1.Q3_K_L.gguf 3.82GB on the MBA

  Note that it might crash sometimes during computation. Just push the button “reload” then “continue” and the model finish its sentence as if nothing happened. I don’t know if its related to MLStudio (the app using the model) or the model itself though.

  source