Comment on gpt-oss: OpenAI releases 2 open-source models
jeena@piefed.jeena.net 4 weeks ago
I tried the 20b on my PC with ollama and Open WebUI and I have to say for some of my use cases it preforms similar to the online version, I was impressed.
glimse@lemmy.world 4 weeks ago
What card are you running it on?
jeena@piefed.jeena.net 4 weeks ago
Nvidia rtx 3060 the 12GB Vram one
glimse@lemmy.world 4 weeks ago
Not bad. Does it use all the VRAM?
jeena@piefed.jeena.net 4 weeks ago
I need to check with that model but usually yes.