Can I use my Nvidia card for cuda related ai stuff?

Submitted ⁨⁨11⁩ ⁨months⁩ ago⁩ by ⁨AnarchistsForDemocracy@lemmy.world⁩ to ⁨nostupidquestions@lemmy.world⁩

https://lemmy.world/pictrs/image/5bcdeb3a-b892-48f5-91d9-4c0e75d52fa1.png

I’m on a GNU/Linux and I have a second gfx card that is nvidia but not plugged in to anything other than my Motherboard, can I use this still for cuda based ai stuff?

source

Comments

Sort:hotnew top

what@lemmy.world ⁨11⁩ ⁨months⁩ ago
I’ve been using cuda for cracking hashes without issue. Now if someone at Nvidia could work on not making their driver suck at daily driving on Linux it would be great

source
- cyberpunk007@lemmy.ca ⁨11⁩ ⁨months⁩ ago
  Nvidia: 😂
  
  source
- AnarchistsForDemocracy@lemmy.world ⁨11⁩ ⁨months⁩ ago
  AMD is boss
  
  source
PeterPoopshit@lemmy.world ⁨11⁩ ⁨months⁩ ago
Actually I got an nvidia card working on easy diffusion on Debian. The barrier for getting a chat ai working in gpu acceleration mode is actually thr fact that I don’t have the patience to deal with all that python venv nonsense so I use llamacpp. It runs in c++ which means no python dependencies to fuck you with at the cost of cpu-only generation.

source
youCanCallMeDragon@lemmy.world ⁨11⁩ ⁨months⁩ ago
I have been on my laptop with 4Gb nvidia gpu. If you’re using the webgui there’s optimization parameters like xformers and I think opt.sdp.attention or something that uses about half the amount of memory. I had to update the graphics card to get it working first.

source
QaspR@lemmy.world ⁨11⁩ ⁨months⁩ ago
Yeah, for sure. I use my GTX 1070 for CUDA stuff all the time.

source
Enzy@lemm.ee ⁨11⁩ ⁨months⁩ ago
Yes just rotate it and connect it to the cpu bearings

source
PlanetOfOrd@lemmy.world ⁨11⁩ ⁨months⁩ ago
Yup, start by running nvidia-smi to get the details on your Nvidia. Then install pytorch. The rest is up to you!

source
nomecks@lemmy.world ⁨11⁩ ⁨months⁩ ago
Like not plugged to power, or not plugged to a display?

source
- AnarchistsForDemocracy@lemmy.world ⁨11⁩ ⁨months⁩ ago
  Not plugged to display, still plugged into the motherboard.
  
  source
  - nomecks@lemmy.world ⁨11⁩ ⁨months⁩ ago
    I can’t speak to compatibility with AMD but having a display connected isn’t a requirement
    
    source
    -> View More Comments
- AnarchistsForDemocracy@lemmy.world ⁨11⁩ ⁨months⁩ ago
  I’m sorry I misremebered everything. Seems like my nvidia is hooked up to my screens it’s just the amd that is plugged into the mother board while not plugged into any screens. Can I use the amd card for ai stuff as well? I was trying to use pytorch for now
  
  source
  - rufus@discuss.tchncs.de ⁨11⁩ ⁨months⁩ ago
    AMD’s compute stack is called ROCm.
    
    rocm.docs.amd.com/en/latest/
    
    source
    -> View More Comments