Comment on NVIDIA’s new AI chatbot runs locally on your PC
Oha@lemmy.ohaa.xyz 4 months agoGpt4all somehow uses Gpu acceleration on my rx 6600xt
Comment on NVIDIA’s new AI chatbot runs locally on your PC
Oha@lemmy.ohaa.xyz 4 months agoGpt4all somehow uses Gpu acceleration on my rx 6600xt
GenderNeutralBro@lemmy.sdf.org 4 months ago
Ooh nice. Looking at the change logs, looks like they added Vulkan acceleration back in September. Probably not as good as CUDA/Metal on supported hardware though.
Oha@lemmy.ohaa.xyz 4 months ago
getting around 44 iterations/s (or whatever that means) on my gpu