Comment

Comment on Everybody’s talking about Mistral, an upstart French challenger to OpenAI

I'm looking forward to the day where these tools will be more accessible, too. I've tried playing with some of these models in the past, but my setup can't handle them yet.

source

Sort:hotnew top

joneskind@lemmy.world ⁨6⁩ ⁨months⁩ ago
You should definitely try Mistral. It runs on a potato

source
- daredevil@kbin.social ⁨6⁩ ⁨months⁩ ago
  I'll give it a shot later today, thanks
  
  source
GBU_28@lemm.ee ⁨6⁩ ⁨months⁩ ago
Are you running llama.cpp and a gguf format of the model?

source
- daredevil@kbin.social ⁨6⁩ ⁨months⁩ ago
  I believe I was when I tried it before, but it's possible I may have misconfigured things
  
  source
  - GBU_28@lemm.ee ⁨6⁩ ⁨months⁩ ago
    Have you checked out llama-cpp-python? The API is very simple, from the readme
    
    source
    daredevil@kbin.social ⁨6⁩ ⁨months⁩ ago
    I haven't, but I'll keep this in mind for the future -- thanks.
    
    source