What are your homelab stats?

Submitted ⁨⁨10⁩ ⁨months⁩ ago⁩ by ⁨DeltaTangoLima@reddrefuge.com⁩ to ⁨selfhosted@lemmy.world⁩

I just spent a good chunk of today migrating some services onto new docker containers in Proxmox LXCs.

As I was updating my network diagram, I was struck by just how many services, hosts, and LXCs I’m running, so counted everything up.

116 docker containers
- Running on 25 docker hosts
- 50 are “repeat” containers, like Watchtower and Portainer agent
38 Proxmox LXCs (19 are docker hosts)
8 physical servers
7 VLANs
5 SSIDs
2 NASes

So, it got me wondering about the size of other people’s homelabs. What are your stats?

source

Comments

Sort:hotnew top

redcalcium@lemmy.institute ⁨10⁩ ⁨months⁩ ago
Dude, are you living on your company’s server room?

source
- DeltaTangoLima@reddrefuge.com ⁨10⁩ ⁨months⁩ ago
  Lol - not quite. It sounds like a lot, but all of this runs on a couple of HP DL360s, a handful of Raspberry Pis, a nettop box, and a couple of consumer NASes.
  
  source
  - Lem453@lemmy.ca ⁨10⁩ ⁨months⁩ ago
    “i swear it’s not a lot”
    
    Goes on the describe an infrastructure setup comparable to most medium sized businesses
    
    I love this community!
    
    source
    -> View More Comments
MolochAlter@lemmy.world ⁨10⁩ ⁨months⁩ ago
116 docker containers

Running on 25 docker hosts

50 are the same on each docker host - Watchtower and Portainer agent

38 Proxmox LXCs (19 are docker hosts)

8 physical servers

7 VLANs

5 SSIDs

2 NASes

And a partridge in a pear treeeee.
source
- DeltaTangoLima@reddrefuge.com ⁨10⁩ ⁨months⁩ ago
  Lol - Merry Christmas, my anonymous friend. 🎅
  
  source
Vintercon@lemmy.world ⁨10⁩ ⁨months⁩ ago
When I read lists like this, I often wonder, what is this person doing with all these containers and such? Do they actually use all of them regularly?

I’ve got:

1 proxmox machine serving - Openmediavault - 2 shares (jellyfin, general smb shares) Homeassistant Uptimekuma for monitoring Jellyfin

And some misc VMs for trying out things.

1 pi4b - pihole 1 pi3a+ tailscale subnet router / exit node

I often look at lists of things i can host and think to myself “do I need this?”. This br8ngs me back to huge lists of services like this and my curiosity. Do folks actually interact with all these services regularly? Honest question, no shade intended.

source
- DeltaTangoLima@reddrefuge.com ⁨10⁩ ⁨months⁩ ago
  
  Do folks actually interact with all these services regularly?
  
  In my case, yep. I believe in as much separation between services as possible, so each service essentially resides on its own docker host, whether physical or Linux container.
  
  That said, some of my services are stacks of multiple containers. For example. my DNS service is a pair of Pi-hole DNS servers, each running their own Pi-hole container, but each one also running containers for Cloudflare tunnel and telemtry export to Prometheus.
  
  Immich has a stack of 6 containers, Piped a stack of 5. So, out of the 66 containers (that aren’t Portainer agent or Watchtower), it probably condenses down to around half that number (eg. the 25 docker hosts I have, plus a handful or two others).
  
  source
  - atzanteol@sh.itjust.works ⁨10⁩ ⁨months⁩ ago
    
    each service essentially resides on its own docker host, whether physical or Linux container.
    
    This is the way. Multiple simple dedicated systems is so much easier to maintain than a single “do everything” server.
    
    source
    -> View More Comments
- MSgtRedFox@infosec.pub ⁨10⁩ ⁨months⁩ ago
  Do folks actually interact with all these services regularly?
  
  Regularly, probably not, just depends.
  
  If you only spin things us to setup or learn something, no.
  
  I run:
  
  VMware ESXi, vCenter, VMware Log Insight, VMware OPS
  
  DMVPN to remote locations like a desk switch at work and family member houses
  
  Sophos UTM
  
  Active Directory for my home computers
  
  hybrid sync to MS Entra (Azure Active Directory) with Entra Connect
  
  hybrid Exchange on Premise and Exchange online
  
  Active Directory for management network
  
  Security Onion VMs for IDS
  
  Network monitoring like Elastiflow, PRTG
  
  Docker, gitlab, OpenSalt / Saltstack
  
  Trellix ePO for AV
  
  Nessus vult scanners
  
  Team Awareness Kit (TAK) server
  
  Active Directory Certificate Services
  
  Home media applications
  
  source
i_am_not_a_robot@discuss.tchncs.de ⁨10⁩ ⁨months⁩ ago
How do people get to so many Docker containers before moving to Kubernetes? I only have 76 containers across 68 pods and that’s far too much for me to manage in Docker.

source
- DeltaTangoLima@reddrefuge.com ⁨10⁩ ⁨months⁩ ago
  Honestly, anything not mission critical (network/internet and home automation, mainly) gets auto-updated by Watchtower. I have Watchtower set to pull latest images of everything on a weekly basis, and specific containers that are set to monitor only. Every Saturday morning, I check the Slack channel for notifications of containers that need controlled updating.
  
  source
- aard@kyu.de ⁨10⁩ ⁨months⁩ ago
  Not really doing much docker, but a lot of LXC - everything scripted with ansible. I define basic container metadata in a yaml parsed by a custom inventory plugin - and that is sufficient for deploying a container before doing provisioning in it.
  
  source
Rootiest@lemmy.world ⁨10⁩ ⁨months⁩ ago
8 Hosts (6 physical/local, 2 VPS/remote)

72 Docker containers

Pi-hole (3 of them, 2 local, 1 on a VPS)

Orbital-sync (keeps the pi-holes synced up)

Searxng (search engine)

Kutt (URL shortener)

LenPaste (Pastebin-like)

Ladder (paywall bypass)

Squoosh (Image converter, runs fully in browser but I like hosting it anyway)

Paperless-ng (Document management)

CryptPad (Secure E2EE office colaboration)

Immich (Google Photos replacement)

Audiobookplayer (Audiobook player)

Calibre (Ebook management)

NextCloud (Don’t honestly use this one much these days)

VaultWarden (Password/2FA/PassKey management)

Memos (Like Google Keep)

typehere (A simple scratchpad that stores in browser memory)

librechat (Kind of like chatgpt except self-hosted and able to use your own models/api keys)

JellyFin (Video streaming)

Matrix (E2EE Secure Chat provider)

IRC (oldschool chat service)

FireFlyIII (finance management)

ActualBudget (another finance thing)

TimeTagger (Time tracking/invoicing)

Firefox Sync (Use my own server to handle syncing between browsers)

LibreSpeed (A few instances, to speed testing my connection to the servers)

Probably others I can’t think of right now
source
- Scrath@lemmy.dbzer0.com ⁨10⁩ ⁨months⁩ ago
  
  Audiobookplayer
  
  Which program do you mean with this? I’m only familiar eith audiobookshelf
  
  source
  - Rootiest@lemmy.world ⁨10⁩ ⁨months⁩ ago
    Ah yeah that’s the one, sorry
    
    source
pete_the_cat@lemmy.world ⁨10⁩ ⁨months⁩ ago
You’ve got like a whole DCs worth of stuff. I’ve downscaled the hardware in my server a lot, but it’s still just a single Threadripper 2970wx with 128 GB RAM and 50 TB of ZFS storage and 50 TB of cloud based object storage in a midtower case. I have like 20 containers running, one is a Caddy webserver which acts as a reverse proxy for all the others.

I love to do things to excess as much as the next geek, but I could never find a reason to run as much as you have.

source
- DeltaTangoLima@reddrefuge.com ⁨10⁩ ⁨months⁩ ago
  Honestly, it’s because I like to play. I don’t need PEAP auth for my wireless network, but I run a radius server providing MAC and user auth, anyway.
  
  source
  - pete_the_cat@lemmy.world ⁨10⁩ ⁨months⁩ ago
    I hear ya, the answer to “why?” is usually “because I can” 😂
    
    About 8 months ago I had 20x HDDs and 8x NVME drives in my server, totaling 187 TB across three ZFS pools. I could write to the largest pool (2 RAIDZ1 striped vdevs, 6 drives wide) at 250 MB/sec and read from it at over a GB/sec and that was from spinning rust with NVME “special devices”.
    
    What was I doing with all of this? Pirating movies and TV shows and running a media server for my friends and family.
    
    source
iluminae@lemmy.world ⁨10⁩ ⁨months⁩ ago
33 nomad jobs, most being containers

12 physical nomad clients

3 amd64 poweredge

2 pi4

6 Nano Pi r5c

1 odroid M1

Ceph: (nomad orchestrated)

8 OSD

50TB total raw disk
source
- DeltaTangoLima@reddrefuge.com ⁨10⁩ ⁨months⁩ ago
  Ah - I’ve been meaning to look into Nomad. I have plenty of admiration for Hashicorp’s products. How are you finding it?
  
  source
  - 1984@lemmy.today ⁨10⁩ ⁨months⁩ ago
    At my day job, we took a look at nomad and now we are planning to run everything in nomad. It’s just so simple to understand and a joy to use.
    
    source
  - iluminae@lemmy.world ⁨10⁩ ⁨months⁩ ago
    My day job is a lot of kube/openshift so nomad is refreshing. Having the template blocks are amazing and makes it so that much of what helm gave me is not required. Parameterized jobs are the best once you find a good use case for them!
    
    source
Decronym@lemmy.decronym.xyz ⁨10⁩ ⁨months⁩ ago
Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:

Fewer Letters More Letters

DNS Domain Name Service/System

HTTP Hypertext Transfer Protocol, the Web

NAS Network-Attached Storage

nginx Popular HTTP server

[Thread #370 for this sub, first seen 24th Dec 2023, 07:35] [FAQ] [Full list] [Contact] [Source code]

source
crony@lemmy.cronyakatsuki.xyz ⁨10⁩ ⁨months⁩ ago
I don’t have a homelab ( space contrains ) but I do have 2 vps that I use to host in total 13 docker containers, mail server and an xmpp server.

What I’m more interesting in is what is it that you selfhost to have so many docker containers?

source
- DeltaTangoLima@reddrefuge.com ⁨10⁩ ⁨months⁩ ago
  
  What I’m more interesting in is what is it that you selfhost to have so many docker containers?
  
  Well, lots of services are stacks of containers - Immich has 6 containers and Piped has 5, for example - so it’s easy for the container count to get up there.
  
  Other “services” are groups of containers/hosts to provide a complete capability - Home Assistant; esphome; Node-RED, for example. Then there’s just the stuff that, due to my desire for loose coupling, are spread across multiple docker hosts/containers - 5 x Sonarr/Radarr instances, for example.
  
  source
JustEnoughDucks@feddit.nl ⁨10⁩ ⁨months⁩ ago
A single SFF desktop setup in a Node306. 2700x, 32 GB RAM, Arc A380, some WD reds.

Homeassistant & associated packages for esphome and Zwave stuff

Jellyfin

*art suite + transmission

yacht

uptimekuma

paperless

immich

authelia with SSO for containers where possible

traefik for reverse proxy

Nexcloud

valheim server

boinc in the winter

syncthing forum phone sync

more services for keeping up the others

Soon a pihole to come.

I want to expand my smart home setup. My project this spring is integrating my smart gas and electric meters into homeassistant. We are completely stripping the house so I am wiring up everything with KNX with a nee Zwave devices where needed. Greatly expanding the smartish home.

I also have to set up a proper network. Right now I am using my Proximus Internet Box from the ISP which admittedly is pretty customizable.
source
- iamnotdunningkruger@lemmy.world ⁨10⁩ ⁨months⁩ ago
  *art suite + transmission
  
  *arr suite?
  
  source
- DeltaTangoLima@reddrefuge.com ⁨10⁩ ⁨months⁩ ago
  Love this! Lot of similarity to what I use - Authelia’s awesome, especially paired with a free push 2FA like Duo.
  
  source
- thickconfusion@lemmy.world ⁨10⁩ ⁨months⁩ ago
  
  boinc in the winter Lol. I really doubt an extra Watt or two during winter helps, and probably not saving much than just running it the whole year.
  
  Good post though
  
  source
  - JustEnoughDucks@feddit.nl ⁨10⁩ ⁨months⁩ ago
    Well, considering going from a 40W idle system to 80 to 100W is a >100% increase in power.
    
    In Belgium we pay 0.30€ per kWh, so running the entire year at 80W average is approximately 150€ difference with idle the entire year. That definitely helps. That is 1/3 the cost of a lawnmower or a month of groceries.
    
    source
    -> View More Comments
  - Cyber@feddit.uk ⁨10⁩ ⁨months⁩ ago
    No, I (respectfully) disagree… When I had a tower PC under my desk, I upped Boinc to use ~50% idle CPU (from memory… might’ve been more) and that would just keep the chill off my office so that I didn’t need to heat it (unless it was really cold).
    
    In the Summer I would drop Boinc down to ~25% as it was getting too hot in there.
    
    source
EonNShadow@pawb.social ⁨10⁩ ⁨months⁩ ago
I’m able to get a lot of gear secondhand through my job, so I’ve got:

One 2u Intel server running proxmox in a ‘cluster’ (circa 2013ish. Added RAM and upgraded the CPU/storage.)

One Intel nuc with an i7-7th gen as the other host in the cluster - only one VM is set to fail over between the two if needed.

VMs:

Plex

2x PiHoles (one of these is the failover VM) (these also have a few docker containers like Uptime Kuma.)

Windows arr box (I know it’s blasphemy but I felt more comfortable doing that stuff in windows)

anything else I want to mess with because the server really doesn’t run that hard.

Network:

Sonicwall TZ 300 (incl a perpetual VPN license)

Unifi 24 port switch (it’s gigabit and POE but doesn’t output enough power for the…)

single Unifi AP.

All acquired over the last couple years for the low low price “it was going into the trash anyway”
source
- DeltaTangoLima@reddrefuge.com ⁨10⁩ ⁨months⁩ ago
  Nice! There’s nothing better than finding new life for old tech.
  
  source
fuckwit_mcbumcrumble@lemmy.world ⁨10⁩ ⁨months⁩ ago
I have a NAS and it runs deluge to download torrents, and hosts two very basic websites.

source
bjoern_tantau@swg-empire.de ⁨10⁩ ⁨months⁩ ago
I’ve got one headless cheap desktop PC sitting under my desk.

source
MSgtRedFox@infosec.pub ⁨10⁩ ⁨months⁩ ago
-3 DL360G8 Esxi -1 DL380G8 TrueNAS -1 DL360G7 Veeam -Delln5070 Extended PVE SophosnUTM -48 Port Catalyst

Cisco 2921

50+ VMs and containers. More enterprise than some enterprises.

Image
source
- ReducedArc@lemmy.world ⁨10⁩ ⁨months⁩ ago
  
  86Ghz
  
  Woah
  
  source
  - chiisana@lemmy.chiisana.net ⁨10⁩ ⁨months⁩ ago
    Most likely some sum of (cores x Ghz) each processor in all servers? While it kind of makes sense, it feels like a much higher clock speed than what I’m used to seeing.
    
    I have a single quad sock E5-4640 server, I think in terms of me having 4 processors with 8 cores at base 2.4Ghz each; I don’t regularly (or ever, for that matter) think in terms of me having 76.8Ghz.
    
    360G8s should be single or dual sock E5 v2 processors. I can’t really math right now (insufficient caffeine), but I can’t seem to make the math work, so I’d imagine something that to be an aggregated across all three systems, not individual systems?
    
    source
    -> View More Comments
- DeltaTangoLima@reddrefuge.com ⁨10⁩ ⁨months⁩ ago
  Love it! I’m gonna grab a 32RU rack soon. Got most of my stuff in a small ~14RU wall cabinet right now. I was originally aiming for low power everything - RasPis, etc. But I’ve since bought a couple DL360s, and you just can’t beat the sheer grunt factor, especially when paired with Proxmox.
  
  source
ShellMonkey@lemmy.socdojo.com ⁨10⁩ ⁨months⁩ ago
Currently 3 physical boxes down from 4 and aiming for 2. It pretty well comes down to a hypervisor and a NAS and the regular aux gear like a switch and modem. They’re big boxes though with about 35 TB storage, .5 TB RAM, and 72 cores between them so lots of space to make imaginary computers in.

Right now my goal is reducing the power footprint. Kill-a-watt places the whole set at 650 watts today and I should knock about 150 off when I get the other box virtualized.

source
- DeltaTangoLima@reddrefuge.com ⁨10⁩ ⁨months⁩ ago
  Nice - have you got anything setup to monitor power consumption? I’ve got a few of those “smart” plugs running on Tuya (localised through Home Assistant) but I’m not 100% convinced of their accuracy just yet…
  
  source
  - ShellMonkey@lemmy.socdojo.com ⁨10⁩ ⁨months⁩ ago
    Just the kill-a-watt plug that the main power block is attached to. The servers have stats visible via the IDRAC (R730XD & R820) to break out for those, but nothing that shows a dashboard or such.
    
    source
    -> View More Comments
reddit_sux@lemmy.world ⁨10⁩ ⁨months⁩ ago
One laptop, 2 ssd, 4 Proxmox lxcs, 3 docker containers, 2 routers.

source
neurospice@lemmy.dbzer0.com ⁨10⁩ ⁨months⁩ ago
I have a very modest 7 docker containers on a vm on my gaming rig and I have a raspberry pi for my DNS server. Honestly my setup is quite scuffed (in comparison to yours), but it does what I need it to do

source
- DeltaTangoLima@reddrefuge.com ⁨10⁩ ⁨months⁩ ago
  Mine’s not as fancy as it sounds - a couple second hand enterprise boxes and a handful of Raspberry Pis, mostly.
  
  source
NonDollarCurrency@monero.town ⁨10⁩ ⁨months⁩ ago
Dang, how does your isp feel about that many machines talking out to the internet, have they made you pay for business plans yet?

source
- DeltaTangoLima@reddrefuge.com ⁨10⁩ ⁨months⁩ ago
  Lol - I’m on unlimited 1Gbps fibre here. So far, they haven’t raised any concerns.
  
  source
  - NonDollarCurrency@monero.town ⁨10⁩ ⁨months⁩ ago
    That’s awesome, best of luck it stays that way!
    
    source
possiblylinux127@lemmy.zip ⁨10⁩ ⁨months⁩ ago
What are you running in docker

source
- DeltaTangoLima@reddrefuge.com ⁨10⁩ ⁨months⁩ ago
  There’s a lot not worth mentioning, but broadly…
  
  Home automation
  
  Home Assistant
  
  esphome
  
  Node-RED
  
  MQTT
  
  Frigate
  
  Homelab/management
  
  2 x Pi-hole (plus supporting services - Cloudflare tunnel, for example)
  
  Grafana
  
  Prometheus
  
  Shellinabox
  
  Prometheus
  
  Forgejo (git)
  
  Netbox
  
  VScode
  
  Media/entertainment
  
  2 x Sonarr
  
  3 x Radarr
  
  Calibre
  
  Piped
  
  Minecraft
  
  other supporting *arrs
  
  Data
  
  Paperless-ngx
  
  Immich
  
  Social
  
  Lemmy
  
  Mastodon
  
  source
  - possiblylinux127@lemmy.zip ⁨10⁩ ⁨months⁩ ago
    That’s a lot. Impressive
    
    source
brygphilomena@lemmy.world ⁨10⁩ ⁨months⁩ ago
I’ve pared mine down a lot. The biggest hurdle for me has been storage.

It used to be 5 2u servers running a ceph cluster, but that got to be expensive and unruly.

Now it’s mainly a small half depth supermicro for my firewall, a half depth supermicro for home assistant, a 2u Dell for unraid, and a small NAS.

Unraid houses Plex and the *arrs. Along with a handful of other useful services like immich.

I do colo a 1u HP though that houses my pbx, web server, unifi controller, jirai server, nextcloud, email, and a bunch of other servers that I run.

Now, I’ve got a lot of spare hardware though. 7 Dell 1u servers, 2 Dell 2u, a supermicro 3u, an HP 2u and a bunch of things clients that I might turn into replacements for my rokus.

source
lemann@lemmy.dbzer0.com ⁨10⁩ ⁨months⁩ ago
Mine’s pretty moderate in comparison to yours lol

2 cloud VPSes

2 physical locations

4 physical servers

~20-30 docker containers across the servers

3 VMs

3 managed switches

5 VLANs (2 with internet access)

2 SSIDs
source
tuhriel@infosec.pub ⁨10⁩ ⁨months⁩ ago
2 Raspberry Pi 4 with a few services running (some directly, some via docker): pihole, pialert, gitlab plantuml, munin, restic rest server, jupyter instance, airsonic-advanced. And an old synology NAS which serves as document and media server

source
darkan15@lemmy.world ⁨10⁩ ⁨months⁩ ago
Old laptop, Debian with docker running nextcloud, navidrome, jellyfin, gitea, librespeed, wireguard, dnsmasq, and nginx as a reverse proxy.

source
jubilationtcornpone@sh.itjust.works ⁨10⁩ ⁨months⁩ ago
I’ve got an old Dell Poweredge tower server with dual 6-Core Xeons, 128 GB Ram, and 21 TB combined Raid 5 storage.

10 VM’s

Veeam Backups

All behind a Mikrotik RB3011 I run one service per VM because I like being able to nuke the whole thing without bringing down any other services.

You can get some good hardware on eBay if you know what you’re looking at. The HDD and SDD’s cost more than the server. Electricity probably runs about $16/mo.

Biggest problem I’ve got coming up is what I’m going to do for backups once I exceed Veeam community editions 10 VM limit.

Three most important VM’s are Jellyfin (whole family uses every day), Paperless-ngx (I use every day), and Jitsi (kids use to video call Grandma and Grandpa). Most of the other stuff is non-essential.
source
giddy@aussie.zone ⁨10⁩ ⁨months⁩ ago
Wow I am not in your league

I am currently migrating from a dedicated docker host to a proxmox host with multiple LXC containers.

old host - 23 docker containers, 128GB system drive, 4TB data drive

backup server - 1 docker container, 1TB disk

proxmox - 3 LXC containers, one of which has 3 docker containers. 500GB system drive, 4TB media drive (not LVM)

The plan is to migrate the loads on the old host to the proxmox host. I also have another 4TB drive coming with the intent of setting up a RAID with 2 of the 4TB drives.

source

Fewer Letters	More Letters
DNS	Domain Name Service/System
HTTP	Hypertext Transfer Protocol, the Web
NAS	Network-Attached Storage
nginx	Popular HTTP server