thirdBreakfast

@thirdBreakfast@lemmy.world

• ⁨Comment⁩ on ⁨Let's Encrypt is 10 years old today !⁩ ⁨⁨2⁩ ⁨days⁩ ago⁩:

  It’s mind-bogglingly convenient, especially compared to the before times. Consider donating to them if you can.

• ⁨Comment⁩ on ⁨What are some self hosted services that you think are essential?⁩ ⁨⁨3⁩ ⁨days⁩ ago⁩:

  No one’s mentioned Forgejo yet? Solid git and artifact repository.

• ⁨Comment⁩ on ⁨Who was our worst Prime Minister and why? Any notable state leaders we need to add?⁩ ⁨⁨2⁩ ⁨weeks⁩ ago⁩:

  Harold Holt just fucked off one day.

• ⁨Comment⁩ on ⁨What would tools/services would you recommend for hosting without self hosting?⁩ ⁨⁨3⁩ ⁨weeks⁩ ago⁩:

  Build anything small into a container on your laptop, push it to DockerHub or the Github package registry then host it on fly.io for free.

• ⁨Comment⁩ on ⁨Set up Tailscale with NGINX Proxy Manager⁩ ⁨⁨3⁩ ⁨weeks⁩ ago⁩:

  Great write up, thanks. For video learners, Wolfgang does a good step-by-step on YouTube

• Beware Hollywood’s digital demolition: it’s as if your favourite films and TV shows never existedwww.theguardian.com ↗
  Submitted ⁨⁨1⁩ ⁨month⁩ ago⁩ to ⁨selfhosted@lemmy.world⁩ | ⁨120⁩ ⁨comments⁩
• ⁨Comment⁩ on ⁨I don't know the difference between hay and straw⁩ ⁨⁨1⁩ ⁨month⁩ ago⁩:

  Great question (and we are reaching the outside edge of my knowledge here). Something like 3-5% of carbon in plants is taken up from the soil by plant roots. I don’t fully understand the mechanism, but the organic carbon percentage is an important competent in the calculation of how much artificial nitrogen a crop is going to need, so I guess it’s probably some biochemical process for making the nitrogen available.

  The organic carbon percentage is closely watched by farmers and is something of an indication of soil health. ie if your crop rotation is reducing the OC% over time then you probably need to reconsider it. It’s one of the reasons burning crop stubbles is a much rarer practice now.

• ⁨Comment⁩ on ⁨I don't know the difference between hay and straw⁩ ⁨⁨1⁩ ⁨month⁩ ago⁩:

  Hay is cut from any sort of cereal plant early in it’s lifecycle, specifically before the plant starts concentrating it’s energy into the seeds. At this stage the plant stalk is sweeter (even to a human - give it a bite). After flowering, the plant is concentrating it’s energy into the seeds. By the time it’s fully done this (which takes a number of weeks), there is very little protein in the stalk, and it’s far less palatable (or nutritious) to animals. The plant stalk is now essentially ‘straw’.

  Commercial hay can be mowed from a meadow (in Australia usually ryegrass) in which case it will have all sorts mixed in, or from crops intended for making good hay (in Australia usually oats or wheat). Commercial straw (which has a tiny market) is cut after the grain has been harvested from the top of the plant. In commercial broadacre cropping in poor soil areas (the bulk of Australia’s grain areas) it’s usually better economics to keep your crop residue including straw since the cost to replace the carbon would be higher that what you’d get for the straw after the cost of harvesting it.

  Source: I play a lot of Minecraft

• ⁨Comment⁩ on ⁨Adding storage - Best options? (External USB drives, automatic decryption, media, etc.)⁩ ⁨⁨3⁩ ⁨months⁩ ago⁩:

  Love the effort you’ve put into this question. You’ve clearly done some quality research and thinking.

  When I asked myself this same question a couple of years ago, I ended up just buying a second hand Synology NAS to use alongside my mini-pc. That would meet your criteria, and avoids the (I’m not sure what magnitude) reliability risk of using disks connected over USB. It’s more proprietary than I’d like, but it’s battle tested and reliable for me.

• ⁨Comment⁩ on ⁨Question about Australian towns⁩ ⁨⁨3⁩ ⁨months⁩ ago⁩:

  Yep, it’d have to be a tiny town to not have a war memorial. If there’s no war memorial there’s probably an honour bord with the names of the fallen in the hall or RSL. Since ANZAC it’s been a part of Australian culture that those who died in service of their country is a sort of sacred thing. It’s significance has ebbed and flowed a bit over the years. Our pride in the services was especially damaged in the Vietnam war years, when ANZAC day crowds shrunk quite a bit and you could have imagined at the time that it might all die out. It’s had a bit of a resurgence since.

  After most big wars, the federal government has put a bit of money into war memorials, and it was pretty much just a matter of the local RSL or town council writing a letter to get a decommissioned artillery piece of some sort, or an old torpedo for the local park as a centrepiece for your ANZAC day ceremony. Also, if you read the plaques on 1950’s or 60’s buildings in the bush, you’ll often see many of them are “War Memorials”. War Memorial swimming pools and sports grounds are common ones. The reason communities did this is that at the time donations to “war memorials” were tax deductible.

  You’ve made an interesting observation. For Aussies this is probably something they’ve never noticed. It’s probably not an indication that we’re very war worshipping, just that for a small country, the deaths involved in the wars we’ve been part of were significant, and perhaps especially so for little country towns where the surnames on the honour board match some of the street names and the bloke you were just chatting to at the post office.

• ⁨Comment⁩ on ⁨Uses for local AI?⁩ ⁨⁨3⁩ ⁨months⁩ ago⁩:

  starcoder2:latest       	f67ae0f64584	1.7 GB	3 days ago 	
  phi3:latest             	d184c916657e	2.2 GB	3 weeks ago	
  deepseek-coder-v2:latest	8577f96d693e	8.9 GB	3 weeks ago	
  llama3:8b-instruct-q8_0 	1b8e49cece7f	8.5 GB	3 weeks ago	
  dolphin-mistral:latest  	5dc8c5a2be65	4.1 GB	3 weeks ago	
  codeqwen:latest         	df352abf55b1	4.2 GB	3 weeks ago	
  llama3:latest           	365c0bd3c000	4.7 GB	4 weeks ago
  

  I mostly use starcoder2 with Continue for code autocomplete, the big deepseek coder is a bit slow (I can feel it thinking), but it and the regular llama3 are good for chatbot type programming questions.

  I don’t really have anything to compare the M1 performance to. I guess the 8GB models output text a little slower than the web versions of the same models, and the 4GB ones about the same. Using ollama in the terminal, there’s sometimes a 0.5-2 second pause before it starts outputting. Not with phi3 though - it’s surprisingly snappy for the quality of answers.

• ⁨Comment⁩ on ⁨What's the bang for the buck go to for AI image generation and LLM models?⁩ ⁨⁨3⁩ ⁨months⁩ ago⁩:

  An M1 MacBook with 16GB cheerfully runs llama3:8b outputting about 5 words a second. FA second hand MacBook like that probably costs half to a third of a secondhand RTX3090.

  It must suck to be a bargain hunting gamer. First bitcoin, and now AI.

• ⁨Comment⁩ on ⁨Uses for local AI?⁩ ⁨⁨3⁩ ⁨months⁩ ago⁩:

  I use the Continue VS Code plugin with Ollama to use a couple of different models (deepseek-coder-v2 & starcoder2) to recreate a local only Github Copilot type experience for coding. This is on an M1 Apple Silicon though. For autocomplete the generation needs to be pretty brisk - I’m not sure how that would go in a VM without a GPU.

• ⁨Comment⁩ on ⁨Do you poweroff your server during night / unused times?⁩ ⁨⁨4⁩ ⁨months⁩ ago⁩:

  My NAS and production server run 24/7, I’ve got a dev server that I turn off if I’m not expecting to use it for a week or so. Usually when I do that, I immediately need it for something and I’m away from home. I have chosen equipment to try and minimize energy use to allow for constant running.

  My view on UPS is it’s a crucial part of getting your availability percentage up. As my home lab turned into crucial services I used to replace commercial cloud options, that became more important to me. Whether it is to you will depend on what you’re running and why.

  I’ve heard that one of the most likely times for hard drives to fail is on power up, and it also makes sense to me that the heating/cooling cycles would be bad for the magnetic coating, so my NAS is configured to keep them spinning, and it hasn’t been turned off since I last did a drive change.

• ⁨Comment⁩ on ⁨[deleted]⁩ ⁨⁨4⁩ ⁨months⁩ ago⁩:
  • Climate change contributing to
  • Climate refugees contributing to
  • Breakdown in social cohesion contributing to
  • Populism, oligarchs, and authoritarianism contributing to
  • Breakdown of international cooperation contributing to
  • Inter-nation conflict contributing to
  • GOTO 10
• ⁨Comment⁩ on ⁨Is it practically impossible for a newcomer selfhost without using centralised services, and get DDOSed or hacked?⁩ ⁨⁨4⁩ ⁨months⁩ ago⁩:

  Yeah na, put your home services in Tailscale, and for your VPS services set up the firewall for HTTP, HTTPS and SSH only, no root login, use keys, and run fail2ban to make hacking your SSH expensive. You’re a much smaller target than you think - really it’s just bots knocking on your door and they don’t have a profit motive for a DDOS.

  From your description, I’d have the website on a VPS, and Immich at home behind TailScale. Job’s a goodun.

• ⁨Comment⁩ on ⁨Is it practically impossible for a newcomer selfhost without using centralised services, and get DDOSed or hacked?⁩ ⁨⁨4⁩ ⁨months⁩ ago⁩:

  +1 for the main risk to my service reliability being me getting distracted by some other shiny thing and getting behind on maintenance.

• ⁨Comment⁩ on ⁨Self hosting is hard. How do you overcome?⁩ ⁨⁨4⁩ ⁨months⁩ ago⁩:

  I started as more “homelab” than “selfhosted” as first - so I was just stuffing around playing with things, but then that seemed sort of pointless and I wanted to run real workloads, then I discovered that was super useful and I loved extracting myself from commercial cloud services (dropbox etc). The point of this story is that I sort of built most of the infrastructure before I was running services that I (or family) depended on - which is where it can become a source of stress rather than fun, which is what I’m guessing you’re finding yourself in.

  There’s no real way around this (the pressure you’re feeling), if you are running real services it is going to take some sysadmin work to get to the point where you feel relaxed that you can quickly deal with any problems. There’s lots of good advice elsewhere in this thread about bit and pieces to do this - the exact methods are going to vary according to your needs. Here’s mine (which is not perfect!).

  • I’m running on a single mini PC & a Synology NAS setup for RAID 5
  • I’ve got a nearly identical spare mini PC, and swap over to it for a couple of weeks (originally every month, but stretched out when I’m busy). That tests my ability to recover from that hardware failure.
  • All my local workloads are in LXC containers or VM’s on Proxmox with automated snapshots that are my (bulky) backups, but allow for restoration in minutes if needed.
  • The NAS is backed up locally to an external USB that’s not usually plugged in, and to a lower speced similar setup 300km away.
  • All the workloads are dockerised, and I have a standard directory structure and compose approach so if I need to upgrade something or do some other maintenance of something I don’t often touch, I know where everything is with out looking back to the playbook
  • I don’t use a script or Terrafrom to set those up, I’ve got a proxmox template with docker and tailscale etc installed that I use, so the only bit of unique infrastructure is the docker compose file which is source controlled on Forgejo
  • Everything’s on UPSs
  • A have a bunch of ansible playbooks for routine maintenance such as apt updates, also in source control
  • all the VPS workloads are dockerised with the same directory structure, and behind NGINX PM. I’ve gotten super comfortable with one VPS provider, so that’s a weakness. I should try moving them one day. They are mostly static websites, plus one important web app that I have a tested backup strategy for, but not an automated one, so that needs addressed.
  • I use a local and an external UptimeKuma for monitoring, enhanced by running a tiny server on every instance that just exposes a disk free and memory free api that can be consumed by Uptime.

  I still have lots of single points of failure - Tailscale, my internet provider, my domain provider etc, but I think I’ve addressed the most common which would be hardware failures at home. My monitoring is also probably sub-par, I’m not really looking at logs unless I’m investigating a problem. Maybe there’s a Netdata or something in my future.

  You’ve mentioned that a syncing to a remote server for backups is a step you don’t want to take, if you mean managing your own is a step you don’t want to take, then your solutions are a paid backup service like backblaze or, physically shuffling external USB drives (or extra NASs) back and forth to somewhere - depending on what downtime you can tolerate.

• ‘My whole library is wiped out’: what it means to own movies and TV in the age of streaming serviceswww.theguardian.com ↗
  Submitted ⁨⁨6⁩ ⁨months⁩ ago⁩ to ⁨selfhosted@lemmy.world⁩ | ⁨138⁩ ⁨comments⁩
• ⁨Comment⁩ on ⁨How much maintenance do you find your self-hosting involves?⁩ ⁨⁨6⁩ ⁨months⁩ ago⁩:

  I run two local physical servers, one production and one dev (and a third prod2 kept in case of a prod1 failure), and two remote production/backup servers all running Proxmox, and two VPSs. Most apps are dockerised inside LXC containers (on Proxmox) or just docker on Ubuntu (VPSs). Each of the three locations runs a Synology NAS in addition to the server.

  Backups run automatically, and I manually run apt updates on everything each weekend with a single ansible playbook. Every host runs a little golang program that exposes the memory and disk use percent as a JSON endpoint, and I use two instances of Uptime Kuma (one local, and one on fly.io) to monitor all of those with keywords.

  So - weekly: 10 minutes to run the update playbook, and I usually ssh into the VPS’s, have a look at the Fail2Ban stats and reboot them if needed. I also look at each of the Proxmox GUIs to check the backs have been working as expected. Monthly: stop the local prod machine and switch to the prod2 machine (from backups) for a few days. Probably 30 minutes each way, most of it waiting for backups. From time to time (if I hear of a security update), but generally every three months: Look through my container versions and see if I want to update them. They’re on docker compose so the steps are just backup the LXC, docker down, pull, up - probs 5 minutes per container. Yearly: consider if I need to do operating systems - eg to Proxmox 8, or a new Debian or Ubuntu LTS Yearly: visit the remotes and have a proper check/clean up/updates

• ⁨Comment⁩ on ⁨Network loss after 24hrs on Docker LXC⁩ ⁨⁨7⁩ ⁨months⁩ ago⁩:

  My ‘good reason’ is just that it’s super convenient - for backups and painlessly moving apps around between nodes with all their data.

  I would run plain LXCs if people nicely packaged up their web apps as LXC templates and made them available on LXCHub for me to run with lxc compose up, but they generally don’t.

  I guess another alternate future would be if Proxmox added docker container supervision to their web interface, but you’re still not going to have the self-contained neat snapshot system that includes the data.

  In theory you should be able to convert an OCI container layer by layer into an LXC, so I bet there’s projects out there that attempt this.

  Image

• ⁨Comment⁩ on ⁨Network loss after 24hrs on Docker LXC⁩ ⁨⁨7⁩ ⁨months⁩ ago⁩:

  No answer, but just to say I run most of my services with this setup - Docker in a Debian LXC under Proxmox, and don’t have this issue. The containers are ‘privileged’, and I have ‘nesting’ ticked on, but apart from that all defaults.

• ⁨Comment⁩ on ⁨Self hosting courses on Udemy⁩ ⁨⁨7⁩ ⁨months⁩ ago⁩:

  There are a heap of general “Linux Administration” courses which will patch a lot of holes in the knowledge of almost all self-taught self hosters. I’d been using Linux for a while but didn’t know you could tab to complete file names in commands till I learned it on Udemy ¯_(ツ)_/¯

• ⁨Comment⁩ on ⁨Does anyone speak hairdresser? I need help communicating.⁩ ⁨⁨7⁩ ⁨months⁩ ago⁩:

  #2 back and sides, finger length on top

• ⁨Comment⁩ on ⁨MIT License text becomes viral “sad girl” piano ballad generated by AI⁩ ⁨⁨7⁩ ⁨months⁩ ago⁩:

  Twitter video link

• ⁨Comment⁩ on ⁨Basic docker networking?⁩ ⁨⁨7⁩ ⁨months⁩ ago⁩:

  I routinely run my homelab services as a single Docker inside an LXC - they are quicker, and it makes backups and moving them around trivial. However, while you’re learning, a VM (with something conventional like Debian or Ubuntu) is probably advised - it’s a more common experience so you’ll get more helpful advice when you ask a question like this.

• ⁨Comment⁩ on ⁨NUC, Proxmox and HA (a noob seeking for help)⁩ ⁨⁨7⁩ ⁨months⁩ ago⁩:

  how to access the NAS and HA separately from the outside knowing that my access provider does not offer a static IP and that access to each VM must be differentiated from Proxmox.

  Tailscale, it will take about 5 minutes to set up and cost nothing.

• ⁨Comment⁩ on ⁨What's Your Preferred Server Monitoring Method?⁩ ⁨⁨8⁩ ⁨months⁩ ago⁩:

  For light touch monitoring this is my approach too. I have one instance in my network, and another on fly.io for the VPSs (my most common outage is my home internet). To make it a tiny bit stronger, I wrote a Go endpoint that exposes the disk and memory usage of a server including with mem_okay and disk_okay keywords, and I have Kuma checking those.

  I even have the two Kuma instances checking each other by making a status page and adding checks for each other’s ‘degraded’ state. I have ntfy set up on both so I get the Kuma change notifications on my iPhone. I love ntfy so much I donate to it.

  For my VPSs, this is probably not enough, so I am considering the more complicated solutions (I’ve started wanting to know things like an influx of fali2ban bans etc.)

• ⁨Comment⁩ on ⁨Kavita runners⁩ ⁨⁨8⁩ ⁨months⁩ ago⁩:

  - fiction
      - Abbott, Edwin A_
          - Flatland
              - Flatland - Edwin A. Abbott.epub
              - Flatland - Edwin A. Abbott.jpg
              - Flatland - Edwin A. Abbott.opf
      - Achebe, Chinua
          - Things Fall Apart
              - Things Fall Apart - Chinua Achebe.epub
              - Things Fall Apart - Chinua Achebe.jpg
              - Things Fall Apart - Chinua Achebe.opf
  

  So in each directory that I use to delineate a library, I have a subdirectory for each author (in sort order form). Within each author subdirectory is a subdirectory for each book, with just the title, then the book with " - ."

  I didn’t invent this, it’s just what Calibre spits out. When I buy a new book, I ingest it into Calibre, fix any metadata and export it to the NAS. Then I delete the Calibre library - I’m just using it to do the neatening up work.

• ⁨Comment⁩ on ⁨Help and questions on my current setup⁩ ⁨⁨9⁩ ⁨months⁩ ago⁩:

  If this is a question about how to access your server at home from devices anywhere, securely, with a simple setup, then the answer is turn off all that port forwarding, and use Tailscale.