Comment on I've just created c/Ollama!
WhirlpoolBrewer@lemmings.world 1 day agoThis is all new to me, so I’ll have to do a bit of homework on this. Thanks for the detailed and linked reply!
Comment on I've just created c/Ollama!
WhirlpoolBrewer@lemmings.world 1 day agoThis is all new to me, so I’ll have to do a bit of homework on this. Thanks for the detailed and linked reply!
brucethemoose@lemmy.world 1 day ago
I was a bit mistaken, these are the models you should consider:
huggingface.co/mlx-community/Qwen3-4B-4bit-DWQ
huggingface.co/AnteriorAI/…/main
huggingface.co/unsloth/Jan-nano-GGUF (specifically the UD-Q4 or UD-Q5 file)
These are state-of-the-art, as far as I know.
WhirlpoolBrewer@lemmings.world 1 day ago
Awesome, I’ll give these a spin and see how it goes. Much appreciated!