Open source is always one step ahead. But they don’t have the resources and brand hype so people assume oai is cutting edge still
Comment on Advanced OpenAI models hallucinate more than older versions, internal report finds
vivendi@programming.dev 1 year ago
Fuck ClosedAI
I want everyone here to download an inference engine (use llama.cpp) and get on open source and open data AI RIGHT NOW!
KeenFlame@feddit.nu 1 year ago
Valmond@lemmy.world 1 year ago
Any pointers on how to do that?
Also, what hardware do you need for this kind of stuff?
vivendi@programming.dev 1 year ago
First, please answer, do you want everything FOSS or are you OK with a little bit of proprietary code because we can do both
Valmond@lemmy.world 1 year ago
I love FOSS but I’m in the check out stage so at the moment the easiest is the best I guess.
vivendi@programming.dev 1 year ago
download “LM Studio” and you can download models and run them through it
I recommend something like an older Mistral model (FOSS model) for beginners, then move on to Mistral Small 24B, QwQ 32B and the likes