NVIDIA GPU on a docker headless system

Submitted ⁨⁨11⁩ ⁨months⁩ ago⁩ by ⁨Trincapinones@lemmy.world⁩ to ⁨selfhosted@lemmy.world⁩

Hi there! I have an old pc that I use as a server (I use Ubuntu Server) and I would like to add a NVIDIA 1050 to it (for jellyfin and guacamole), in the past I tried to do it and somehow I corrupted the system when installing the video drivers, I have always had complications when installing NVIDIA drivers on Linux, could any of you help me know what is the right way to install the video drivers on a headless system and use it correctly with docker compose? Thanks in advance 😄

source

Comments

Sort:hotnew top

vynlwombat@lemmy.world ⁨11⁩ ⁨months⁩ ago
What went wrong last time you tried installing the drivers?

Ubuntu has Nvidia drivers in the official repos: cyberciti.biz/…/ubuntu-linux-install-nvidia-drive…

Nvidia also has a docker image for GPUs: docs.nvidia.com/datacenter/…/install-guide.html

source
- Trincapinones@lemmy.world ⁨11⁩ ⁨months⁩ ago
  Thanks for the help! I’m trying to install the driver from the official repo but I don’t know what version shoud I use for a headless docker setup with a 1050.
  
  I think that’s what went wrong last time, I tried to install the driver from the NVIDIA documentation thinking that “I’ll just work” just like in windows 😓
  
  source
fraydabson@sopuli.xyz ⁨11⁩ ⁨months⁩ ago
Once you do get the drivers installed properly as per your OS, here are the steps to give docker access to it: docs.nvidia.com/datacenter/…/install-guide.html

If you are using arch then the whole process can be found on the arch wiki. wiki.archlinux.org/title/docker#Run_GPU_accelerat…

source
- dandroid@dandroid.app ⁨11⁩ ⁨months⁩ ago
  I recently did this and found those instructions to be beyond useless. The repository URIs were all old and dead. Not sure if they updated this doc since then, but they combined all the deb-based distros into one repo and and all the rpm-based distros into another repo.
  
  source
  - fraydabson@sopuli.xyz ⁨11⁩ ⁨months⁩ ago
    Yeah thankfully I use Arch Linux. Their wiki guide was much better.
    
    source
- Trincapinones@lemmy.world ⁨11⁩ ⁨months⁩ ago
  Thank you! Last time I used the official desktop drivers because most guides recommended them. When I install the NVIDIA Container Toolkit, I can include the GPU in the runtime of the container and it should work, right?
  
  source
  - fraydabson@sopuli.xyz ⁨11⁩ ⁨months⁩ ago
    I used the desktop drivers as well (on arch from the extra repo) for my headless arch server.
    
    Regarding nvidia container toolkit once it was installed I added this to my Jellyfin docker compose:
    
    deploy: resources: reservations: devices: - driver: nvidia capabilities: [gpu]
    
    source
possiblylinux127@lemmy.zip ⁨11⁩ ⁨months⁩ ago
A assume you already have the Nvidia card? If you are buying one go for amd

source
netwren@lemmy.world ⁨11⁩ ⁨months⁩ ago
Not docker but you could do k3s and use the Nvidia GPU operator to manage installing video drivers for you on your single node cluster.

source
- notfromhere@lemmy.one ⁨11⁩ ⁨months⁩ ago
  Do you have a link to a tutorial on this? I’ve been thinking about adding my amd64 server with an nVidia GPU to my Raspberry Pi K3s cluster.
  
  source
  - netwren@lemmy.world ⁨11⁩ ⁨months⁩ ago
    No! Maybe I should work on this because it was fairly simple for me to do after some research.
    
    source
    -> View More Comments
- Trincapinones@lemmy.world ⁨11⁩ ⁨months⁩ ago
  I didn’t know about it, thanks! I’ll give it a try 😄
  
  source
  - netwren@lemmy.world ⁨11⁩ ⁨months⁩ ago
    It actually was pretty straightforward. Saying this from experience as I used a tensortt container image with a 1060 for image clarification
    
    source