gpt-oss: OpenAI releases 2 open-source models

Comments

• jeena@piefed.jeena.net ⁨1⁩ ⁨month⁩ ago

  I tried the 20b on my PC with ollama and Open WebUI and I have to say for some of my use cases it preforms similar to the online version, I was impressed.

  source

  • glimse@lemmy.world ⁨1⁩ ⁨month⁩ ago

    What card are you running it on?

    source

    • jeena@piefed.jeena.net ⁨1⁩ ⁨month⁩ ago

      Nvidia rtx 3060 the 12GB Vram one

      source

      • -> View More Comments
• thoon@feddit.nl ⁨1⁩ ⁨month⁩ ago

  Finally, their company name is starting to make SOME sense

  source
• nymnympseudonym@lemmy.world ⁨1⁩ ⁨month⁩ ago

  It’s awesome but that 128k context window is a throwback to Llama3 days

  I bet the closed $ource model has like 2MB context

  source
• fubarx@lemmy.world ⁨1⁩ ⁨month⁩ ago

  Ran the 20B on a Mac under LMStudio. Pretty zippy and did OK on basic coding tasks.

  source
• Mwa@thelemmy.club ⁨1⁩ ⁨month⁩ ago

  Crazy but sure ig

  source