Comment on Can I use my Nvidia card for cuda related ai stuff?

youCanCallMeDragon@lemmy.world ⁨6⁩ ⁨months⁩ ago

I have been on my laptop with 4Gb nvidia gpu. If you’re using the webgui there’s optimization parameters like xformers and I think opt.sdp.attention or something that uses about half the amount of memory. I had to update the graphics card to get it working first.

source
Sort:hotnewtop