Comment on NVIDIA’s new AI chatbot runs locally on your PC

• GenderNeutralBro@lemmy.sdf.org ⁨1⁩ ⁨year⁩ ago

  Ooh nice. Looking at the change logs, looks like they added Vulkan acceleration back in September. Probably not as good as CUDA/Metal on supported hardware though.

  source

  • Oha@lemmy.ohaa.xyz ⁨1⁩ ⁨year⁩ ago

    getting around 44 iterations/s (or whatever that means) on my gpu

    source