I finally got TruNas running an LLM on my AMD GPU!!!

Submitted ⁨⁨2⁩ ⁨months⁩ ago⁩ by ⁨RagingHungryPanda@lemm.ee⁩ to ⁨selfhosted@lemmy.world⁩

And I’m making everyone go to my gotosocial post because the server is running, so I’m going to use it!

Comments

Sort:hotnew top

possiblylinux127@lemmy.zip ⁨2⁩ ⁨months⁩ ago
You missed an e

source
- RagingHungryPanda@lemm.ee ⁨2⁩ ⁨months⁩ ago
  Because it doesn’t feel real 😉
  
  source
  - possiblylinux127@lemmy.zip ⁨2⁩ ⁨months⁩ ago
    I think you are still missing an e in the title.
    
    Cool project though
    
    source
JigglySackles@lemmy.world ⁨2⁩ ⁨months⁩ ago
Congrats!!

source
- RagingHungryPanda@lemm.ee ⁨2⁩ ⁨months⁩ ago
  Thank you! This took so long to figure out
  
  source
  - JigglySackles@lemmy.world ⁨2⁩ ⁨months⁩ ago
    I bet! That’s a lot of technical info to sort through, understand and create.
    
    source
liliumstar@lemmy.dbzer0.com ⁨2⁩ ⁨months⁩ ago
Congrats! I just got a similar running on Arch with a 5700 XT. When I looked at it a couple years ago, it wasn’t really possible. Now, smooth sailing.

source
Condiment2085@lemm.ee ⁨2⁩ ⁨months⁩ ago
That’s so cool!!

source