Comment on Self-Hosted AI is pretty darn cool
chagall@lemmy.world 6 months agoYeah, I have an NVDIA GPU and it is magic. The best part is if you are using it, open a second terminal window and enter the command, watch -n 0.5 nvidia-smi
and you can see your GPU usage go up and down in real-time as you ask the GPT questions. Pretty cool.
Hopefully they get the ARC folks up and running soon.