Comments

• squirrel@piefed.zip ⁨2⁩ ⁨weeks⁩ ago

  Let’s tinker around and accidentally break something.

  source

  • wersooth@lemmy.ml ⁨2⁩ ⁨weeks⁩ ago

    and debug it until you have to reinstall your entire stack from scarch

    source

    • SpikesOtherDog@ani.social ⁨2⁩ ⁨weeks⁩ ago

      GET OUT OF MY HOUSE!

      source
    • rosco385@lemmy.wtf ⁨2⁩ ⁨weeks⁩ ago

      Are you implying it’s possible to debug without having to reinstall from scratch? Preposterous! 😂

      source
    • Bibip@programming.dev ⁨2⁩ ⁨weeks⁩ ago

      Scarched arth

      source
    • Dultas@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

      Guess this is a good time to test my infrastructure automation.

      source
  • cenzorrll@piefed.ca ⁨2⁩ ⁨weeks⁩ ago

    “Damn, I’ve got this Debian server shit down. I wonder how an opensuse server would work out” *installs tumbleweed *

    True story

    source
  • FreshLight@sh.itjust.works ⁨2⁩ ⁨weeks⁩ ago

    My man person!

    source
• truthfultemporarily@feddit.org ⁨2⁩ ⁨weeks⁩ ago

  Have you tried introducing unnecessary complexity?

  source

  • Sabata11792@ani.social ⁨2⁩ ⁨weeks⁩ ago

    If you know how your setup works, then that’s a great time for another project that breaks everything.

    source

    • cenzorrll@piefed.ca ⁨2⁩ ⁨weeks⁩ ago

      Saturday morning: “Incus and podman seem interesting. I bet I could swap everything over while the family is out this afternoon”

      Sunday evening: “Dad, when will the lights work again?”

      source

      • -> View More Comments
  • InnerScientist@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    Infrastructure diagram? No! In this homelab we refer to the infrastructure hyperdodecahedron.

    source

    • tal@lemmy.today ⁨2⁩ ⁨weeks⁩ ago

      It seems like a good time to learn graphviz’s dot format for the network layout diagrams, with automated layout.

      blog.ipspace.net/kb/…/40-Network-Diagrams/

      source

      • -> View More Comments
  • non_burglar@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    Haha too right mate

    source
  • irmadlad@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    unnecessary complexity?

    I can help with that. It’s a skill I have. LOL

    source
  • Zink@programming.dev ⁨2⁩ ⁨weeks⁩ ago

    This is just as true in my non-computer hobbies that involve physical systems instead of code and configs!

    If I had to just barely meet the requirements using as little budget as possible while making it easy for other people to work on, that would be called “work.” My brain needs to indulge in some over-engineering and “I need to see it for myself” kind of design decisions.

    source
• nonentity@sh.itjust.works ⁨2⁩ ⁨weeks⁩ ago

  If it’s stable, it’s not a lab.

  That’s infrastructure.

  source

  • cenzorrll@piefed.ca ⁨2⁩ ⁨weeks⁩ ago

    I’ve moved my homelab twice because it became stable, I really liked the services it was running, and I didn’t want to disturb the last lab*cough*prod server.

    My current homelab will be moar containers. I’m sure I’ll push it to prod instead of changing the IP address and swapping name tags this time.

    source
• Prunebutt@slrpnk.net ⁨2⁩ ⁨weeks⁩ ago

  When’s the last time you checked if your backup solution works?

  source

  • Ek-Hou-Van-Braai@piefed.social ⁨2⁩ ⁨weeks⁩ ago

    But if my backups actually work then I miss out on the joy of rebuilding everything from scratch and explaining to my wife why non of the lights in the house work anymore.

    source

    • Tangent5280@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

      Carry around a candle in one of those old timey holders like Scrooge Mcduck

      source
  • JetpackJackson@feddit.org ⁨2⁩ ⁨weeks⁩ ago

    Yesterday! Switched my media server from freebsd to alpine and got the arr stack all set up using the backup zip files

    source
  • halcyoncmdr@piefed.social ⁨2⁩ ⁨weeks⁩ ago

    Backup? Psh… That’s what the lab is for.

    source
  • piranhaconda@mander.xyz ⁨2⁩ ⁨weeks⁩ ago

    What’s a backup solution…? (I’m only being half sarcastic, I really need to set one up, but it’s not as “fun” as the rest of my homelab, send suggestions)

    source

    • Prunebutt@slrpnk.net ⁨2⁩ ⁨weeks⁩ ago

      No mercy for you, then. ;)

      source

      • -> View More Comments
• tal@lemmy.today ⁨2⁩ ⁨weeks⁩ ago

  logging is probably down

  You do, of course have a dedicated rsyslogd server? An isolated system to which logs are sent, so that if someone compromises your other systems, they can’t wipe traces of that compromise from those systems?

  Oh. You don’t. Well, that’s okay. Not every lab can be complete. That Raspberry Pi over there in the corner isn’t actually doing anything, but it’s probably happy where it is. You know, being off, not doing anything.

  source

  • probable_possum@leminal.space ⁨2⁩ ⁨weeks⁩ ago

    Ah. The approach that squirrel@piefed.zip suggested. ;)

    Thanks for the tutorial though.

    source
  • cenzorrll@piefed.ca ⁨2⁩ ⁨weeks⁩ ago

    Hmmm. My pi{VPN,hole,dhcp,HA} has a little bit of overhead left…

    source
• Coleslaw4145@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

  No try migrating all your docker containers to podman.

  source

  • fossilesque@mander.xyz ⁨2⁩ ⁨weeks⁩ ago

    Don’t encourage me.

    source

    • epicshepich@programming.dev ⁨2⁩ ⁨weeks⁩ ago

      And then try turning on SELinux!

      source

      • -> View More Comments
  • SexualPolytope@lemmy.sdf.org ⁨2⁩ ⁨weeks⁩ ago

    Just did that last weekend. Nothing to do anymore. 😢

    source

    • exu@feditown.com ⁨2⁩ ⁨weeks⁩ ago

      Did you do Quadlets?

      source

      • -> View More Comments
  • emerald@lemmy.blahaj.zone ⁨2⁩ ⁨weeks⁩ ago

    And then migrate all your podman containers to proxmox

    source
• PHLAK@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

  Time to start documenting it!

  source

  • irmadlad@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    At 71, I have to document. I started a long time ago. I worked for a mec. contractor long ago, and the rule was: ‘If you didn’t write it down, it didn’t happen.’ That just carried over to everything I do.

    source

    • Vile_port_aloo@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

      Do you write down what you write down on the internet?

      source

      • -> View More Comments
  • BuboScandiacus@mander.xyz ⁨2⁩ ⁨weeks⁩ ago

    NEVER1!!!11!!

    source
  • sibannac@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    Don’t look too closely you can jinx it.

    source
• tal@lemmy.today ⁨2⁩ ⁨weeks⁩ ago

  You have remote power management set up for the systems in your homelab, right? A server set up that you can reach to power-cycle other servers, so that if they wedge in some unusable state and you can’t be physically there, you can still reboot them? A managed/smart PDU or something like that? Something like one of these guys?

  Oh. You don’t. Well, that’s probably okay. I mean, nothing will probably go wrong and render a device in need of being forcibly rebooted when you’re physically away from home.

  source

  • FauxLiving@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    Oh. You don’t. Well, that’s probably okay. I mean, nothing will probably go wrong and render a device in need of being forcibly rebooted when you’re physically away from home.

    *furiously adds a new item to the TODO list*

    source
  • lemming741@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    Does a $12 Shelly plug count?

    source

    • TerHu@lemmy.dbzer0.com ⁨2⁩ ⁨weeks⁩ ago

      if you can cycle your home assistant with the shelly plug whilst your home assistant is down, yes. from experience it’s really quite annoying to have a smart plug switch off HA…

      source

      • -> View More Comments
  • Fmstrat@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    I built an 8 outlet version of those with relays and wall outlets for… a lot less.

    source
  • sytone@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    Tal just got the chaotic evil tag today.

    source
  • tychosmoose@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    If you do have the smart PSU and power management server you probably also went down the rabbit hole of scripting the power cycling, right? Maybe made that server hardened against power loss disk corruption so it can be run until UPS battery exhaustion.

    What if there is a power outage and NUT shuts everything down? Would be nice to have everything brought back up in an orderly way when power returns. Without manual intervention. But keeping you informed via logging and push notifications.

    source
• DownByLaw@sh.itjust.works ⁨2⁩ ⁨weeks⁩ ago

  Have you already tried implementing an identity provider like Authentik, so you can add OIDC and ldap for all your services, while you are the only one that’s using them? 🤔

  source

  • PumpkinEscobar@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    Behind a traefik reverse proxy with lets encrypt for ssl even though the services aren’t exposed to the internet?

    source

    • DownByLaw@sh.itjust.works ⁨2⁩ ⁨weeks⁩ ago

      Don’t forget about Anubis and crowdsec to make it even safer inside your LAN

      source
    • diablomnky666@lemmy.wtf ⁨2⁩ ⁨weeks⁩ ago

      To be fair a lot of apps don’t handle custom CAs like they should. Looking at you Home Assistant! 😠

      source
    • suicidaleggroll@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

      Who cares if it’s exposed to the internet?

      1. Encrypting your local traffic is still valuable to protect your systems from any bad actors on your local network (neighbor kid cracks your wifi password, some device on your network decides to start snooping on your local traffic, etc)

      2. Many services require HTTPS with a valid cert to function correctly, eg: Bitwarden. Having a real cert for a real domain is much simpler and easier to maintain than setting up your own CA

      source
  • tal@lemmy.today ⁨2⁩ ⁨weeks⁩ ago

    Probably a good idea to switch over to WPA-Enterprise using Authentik’s RADIUS server support and let all of the users of your wireless access point log in with their own network credentials, while you’re at it.

    source
  • epicshepich@programming.dev ⁨2⁩ ⁨weeks⁩ ago

    Hey my wife uses some of them too!

    source
• tal@lemmy.today ⁨2⁩ ⁨weeks⁩ ago

  All of those systems in your homelab…they aren’t all pulling down their updates multiple times over your network link, right? You’re making use of a network-wide cache? For Debian-family systems, something like Apt-Cacher NG?

  Oh. You’re not. Well, that’s probably okay. I mean, not everyone can have their environment optimized to minimize network traffic.

  source

  • the_tab_key@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    I set this up years ago, but then decided it was better to just install different distros on each of my computers. Problem solved?

    source
  • panda_abyss@lemmy.ca ⁨2⁩ ⁨weeks⁩ ago

    You can forgejo with a container index enabled, I don’t know if there’s a way to use that as a proxy for downloading containers though.

    source
• Abbysimons@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

  The rare moment when everything actually works. 😄

  source
• FauxLiving@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

  The comments in this thread have collectively created thousands of person-hours worth of work for us all…

  source
• MonkeMischief@lemmy.today ⁨2⁩ ⁨weeks⁩ ago

  Don’t worry, you’re one Docker pull away from having to look up how to manually migrate Postgres databases within running containers!

  (Looks at my PaperlessNGX container still down. Still irritated.)

  source
• damnthefilibuster@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

  Backups. You’re forgetting them.

  source
• paequ2@lemmy.today ⁨2⁩ ⁨weeks⁩ ago

  Actually, one thing I want to do is switch from services being on a subdomain to services being on a path.

  immich.myserver.com -> myserver.com/immich
  jellyfin.myserver.com -> myserver.com/jellyfin
  

  I’m getting tired of having to update DNS records every time I want to add a new service.

  I guess the tricky part will be making sure the services support this kind of routing…

  source
• Bakkoda@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

  I should do some breaking network changes… While tunneled in.

  source
• tal@lemmy.today ⁨2⁩ ⁨weeks⁩ ago

  You have an intrusion detection system set up, right? A server watching your network’s traffic, looking for signs that systems on your network have been compromised, and to warn you?

  Oh. You don’t. Well, that’s probably okay. I mean, probably nothing on your network has been compromised. And probably nothing in the future will be.

  source
• Avicenna@programming.dev ⁨2⁩ ⁨weeks⁩ ago

  You can always configure your vim further

  source
• nucleative@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

  Never run:

  docker compose down && docker compose up -d ```
  
  Right before the end of your day. Ask me how I know 😂
  
  

  source
• Fedegenerate@fedinsfw.app ⁨2⁩ ⁨weeks⁩ ago

  Going into spring/summer that’s ideal, I wanna go places do things. Mid winter, I’m feature creeping till something breaks.

  source
• tal@lemmy.today ⁨2⁩ ⁨weeks⁩ ago

  All of your systems are set up, but are they capable of being redeployed using a configuration management software package? Ansible or something like that?

  Oh. They’re not. Well, that’s probably okay. I mean, you could probably go manually reproduce configurations, more or less.

  source
• jeffep@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

  Can’t believe nobody here mentioned nixOS so far? How about moving all of your configs in a flake and manage all of your systems with it?

  source
• tal@lemmy.today ⁨2⁩ ⁨weeks⁩ ago

  You have all your devices attached to a console server with a serial port console set up on the serial port, and if they support accessing the BIOS via a serial console, that enabled so that you can access that remotely, right? Either a dedicated hardware console server, or some server on your network with a multiport serial card or a USB to multiport serial adapter or something like that, right? So that if networking fails on one of those other devices, you can fire up minicom or similar on the serial console server and get into the device and fix whatever’s broken?

  Oh, you don’t. Well, that’s probably okay. I mean, you probably won’t lose networking on those devices.

  source
• tal@lemmy.today ⁨2⁩ ⁨weeks⁩ ago

  You have squid or some other forward http proxy set up to share a cache among all the devices on your network set up to access the Web, to minimize duplicate traffic?

  And you have a shared caching DNS server set up locally, something like BIND?

  Oh. You don’t. Well, that’s probably okay. I mean, it probably doesn’t matter that your devices are pulling duplicate copies of data down. Not everyone can have a network that minimizes latency and avoids inefficiency across devices.

  source
• Admax@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

  Then it turns out your monitoring system failed and FUCK IT’S BEEN A MONTH SINCE THE LAST PROPER BACKUP

  source
• fleem@piefed.zeromedia.vip ⁨2⁩ ⁨weeks⁩ ago

  heck i really wish we could all throw a party together. part swap, stories swap. show off cool shit for everyone to copy.

  help each other fill in the missing pieces

  y’all seem like cool peeps meme-ing about shit nobody else gets!

  time to test the backups!

  source
• AkatsukiLevi@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

  Do you have a spinning fish display in front of your homelab server, right? We all know the spinning fish improves performance and security, it is a indispensable part of homelabbing

  source
• Egonallanon@feddit.uk ⁨2⁩ ⁨weeks⁩ ago

  Buy a UPS and setup a NUT server on the spare raspberry pi you have lying around.

  source
• Petter1@discuss.tchncs.de ⁨2⁩ ⁨weeks⁩ ago

  You should use Arch, then you can update every 15 minutes 🤭

  source
• rumba@lemmy.zip ⁨2⁩ ⁨weeks⁩ ago

  Nothing to install? Not with that attitude!

  Start a 10" rack.

  source