Comment on Sam Altman says ChatGPT should be 'much less lazy now'

<- View Parent
akrot@lemmy.world ⁨4⁩ ⁨months⁩ ago

I have a ryzen apu, so I was curious. I tried yesterday to fiddle with it, and managed to up the “vram” to 16gb. But installing xformers and flash-attention for LLM support on igpus is not officially supported and was not possible to install anything past pytorch. It’s step further for sure, but still needs lots of work.

source
Sort:hotnewtop