Open source is always one step ahead. But they don’t have the resources and brand hype so people assume oai is cutting edge still
Comment on Advanced OpenAI models hallucinate more than older versions, internal report finds
vivendi@programming.dev 11 months ago
Fuck ClosedAI
I want everyone here to download an inference engine (use llama.cpp) and get on open source and open data AI RIGHT NOW!
KeenFlame@feddit.nu 11 months ago
Valmond@lemmy.world 11 months ago
Any pointers on how to do that?
Also, what hardware do you need for this kind of stuff?
vivendi@programming.dev 11 months ago
First, please answer, do you want everything FOSS or are you OK with a little bit of proprietary code because we can do both
Valmond@lemmy.world 11 months ago
I love FOSS but I’m in the check out stage so at the moment the easiest is the best I guess.
vivendi@programming.dev 11 months ago
download “LM Studio” and you can download models and run them through it
I recommend something like an older Mistral model (FOSS model) for beginners, then move on to Mistral Small 24B, QwQ 32B and the likes