Comment

Comment on What's the bang for the buck go to for AI image generation and LLM models?

<- View Parent

Fisch@discuss.tchncs.de ⁨2⁩ ⁨months⁩ ago

I actually use an AMD card for running image generation and LLMs on my PC on Linux. It’s actually not hard to set up.

source

Sort:hotnew top

s38b35M5@lemmy.world ⁨2⁩ ⁨months⁩ ago
Details on your setup?

source
- russjr08@bitforged.space ⁨2⁩ ⁨months⁩ ago
  I’m not the original person you replied to, but I also have a similar setup. I’m using a 6700XT, with both InvokeAI and stable-diffusion-webui-forge setup to run without any issues. While I’m running Arch Linux, I have it setup in Distrobox so its agnostic to the distro I’m running (since I’ve hopped between quite a few distros) - the container is actually an Ubuntu based container.
  
  The only hiccup I ran into is that while ROCm does support this card, you need to set an environmental variable for it to be picked up correctly. At the start of both sd-webui and invokeai’s launch scripts, I just use:
  
  export HSA_OVERRIDE_GFX_VERSION=10.3.0
  
  In order to set that up, and it works perfectly. This is the link to the distrobox container file I use to get that up and running.
  
  source
  - s38b35M5@lemmy.world ⁨2⁩ ⁨months⁩ ago
    Thx. I’m dabbling rn with a 2015 Intel i5 SFF and a low profile 6400 GPU, but it looks like I’ll be getting back to all my gear soon, and was curious to see what others are having success running with.
    
    I think I’m looking at upgrading to a 7600 or greater GPU in a ryzen 7, but still on the sidelines watching the ryzen 9k rollout.
    
    I still haven’t tried any image generation, have only used llamafile and LM studio, but would like to did a little deeper, while accounting for my dreaded ADHD that makes it miserable to learn new skills…
    
    source
- Fisch@discuss.tchncs.de ⁨2⁩ ⁨months⁩ ago
  I have Fedora installed on my system (don’t know how the situation is on other distros regarding rocm) and my GPU is an RX 6700 XT. For image generation I use stable duffusion webui and for LLMs I use text generation webui. Both installed everything they needed by themselves and work perfectly fine on my AMD GPU. I can also give you more info if there’s anything else you wanna know.
  
  source