Comment on I've just created c/Ollama!

<- View Parent
brucethemoose@lemmy.world ⁨1⁩ ⁨day⁩ ago

I was a bit mistaken, these are the models you should consider:

huggingface.co/mlx-community/Qwen3-4B-4bit-DWQ

huggingface.co/AnteriorAI/…/main

huggingface.co/unsloth/Jan-nano-GGUF (specifically the UD-Q4 or UD-Q5 file)

These are state-of-the-art, as far as I know.

source
Sort:hotnewtop