Comment

Comment on Is there any actual standalone AI software?

Ziggurat@sh.itjust.works ⁨1⁩ ⁨month⁩ ago

There is tons of “standalone” software that you can run on your own PC

For Text generation, the easiest way is to get GPT4All package which allows you to run text generation model in CPU on your own PC
For image generation, you can try to get Easy difusion package which is an easy to use stable diffusion package, then if you like-it, time to try the “comfyUI”

You can check !localllama@sh.itjust.works and !imageai@sh.itjust.works for some more information

Sort:hotnew top

deranger@sh.itjust.works ⁨1⁩ ⁨month⁩ ago
I’ve wanted to try these out for shits and giggles - what would I expect with a 3090, is it going to take a long time to make some shitposts?

source
- chicken@lemmy.dbzer0.com ⁨1⁩ ⁨month⁩ ago
  3090s are ideal because the most important factor is vram, and those are at the top of the plateau for vram until you get into absurdly expensive server hardware. Expect around 3 seconds for generating a 512x512 image or 4 words per second generating text at around GPT 3.5 quality.
  
  source
- Ziggurat@sh.itjust.works ⁨1⁩ ⁨month⁩ ago
  With SD 1.5 my old GTX 970was doing fine (30 second per image) I upgraded to a Radeon 7060 and with SDXL get like 4 images in these 30 seconds (but sometimes crash my Pac when loading a model)
  
  source
- tyler@programming.dev ⁨1⁩ ⁨month⁩ ago
  I did a bunch of image generation on my 3080 and it felt extremely fast. Enough that I was able to set it up as a shared node in one of those image generation nets and it outperformed most other people in the net.
  
  source
  - yo_scottie_oh@lemmy.ml ⁨5⁩ ⁨weeks⁩ ago
    
    shared nice in one of those image generation nets
    
    You mean like AI Horde?
    
    source
    tyler@programming.dev ⁨5⁩ ⁨weeks⁩ ago
    Yeah I couldn’t remember what it was called lol
    
    source