anamethatisnt

Gemma 4 12b unified as a q6 gguf fits with about 24k context inside your vram. koboldcpp+sillytavern works well on the software side.

Congrats! Then you have a guide for an easy reverse proxy right inside your router. :)
Try it out and see if that doesn’t fit you better than the nginx proxy manager.

The main point was that if your mini-pc running the proxy is also behind a windows docker desktop install it too will have incoming connections appear as 192.168.65.1.

A solution then is to switch to a linux docker host where you can get rid of that hidden NAT. There are many webuis for docker such as dockge and portainer on linux without having to use the terminal.

My preffered solution would be to switch to a router/firewall with reverse proxy support such as opnsense with haproxy and skip the nginx proxy manager completely.
Having the proxy configured in the same UI as vlan, port forwarding, nat rules and so on is nice. opnsenselab.com/…/opnsense-haproxy-reverse-proxy/

Long shot but you might’ve solved the nginx x-forwarded header multiple times without seeing it if the nginx proxy is behind the same bridged docker desktop system setup on your minipc then the visitors IP will show as 192.168.65.1 to the nginx proxy too so you forward that same ip to jellyfin even when it works.
An easy check would be to spin up the nginx proxy manager as a vm instead of a docker image and see if it works.

No real solution, but a lot of chatter regarding that:
github.com/NginxProxyManager/…/674

You can always contact techaro.lol and ask if they’re willing to setup a secondary domain for you.

Or you can use others endorsements of the product to give it weight.
"The Linux Foundation uses Anubis to protect git.kernel.org and lore.kernel.org and seem very satisfied with the result.
For the low cost of 50USD/Month we get a custom branded version of it.
Image

• …kernel.org/…/1bb84190-f207-4adc-ac0e-8eb87a8a60f…"

I imagine Anubis looking like that is because professional settings really should sponsor when using open source.
anubis.techaro.lol/docs/admin/botstopper/
github.com/sponsors/Xe
Image

docs.docker.com/desktop/features/networking/#how-…
I think your discord friends are right.

Outbound traffic from the container is sent through Network Address Translation (NAT) using a virtual adapter (typically with an internal IP such as 192.168.65.3). You can view or change this with the Docker Desktop settings.

Traefik merge code written by AI, f.e. github.com/traefik/traefik/pull/13397
As do Caddy, such as github.com/caddyserver/caddy/pull/7492 and github.com/caddyserver/caddy/pull/7666

They seem to merge AI code too, from OPs codeberg link: github.com/nginx/nginx/pull/1451

I think pivoting to BSD is the easiest way to find solutions that aren’t tainted by AI.
www.openbsdhandbook.com/relayd/

An example of OpenBSD denying AI code contributions:
marc.info/?l=openbsd-tech&m=177411620801633&w=2

Completely depends on where you are too, my NAS uses ~30W, which means ~22kWh in 30 days, which translated into local electricity costs are 53SEK or $5.39.
It has enough CPU (Intel Celeron J4125) to run my production loads, RAID1 16TB drives and 18GB RAM so it successfully hosts DNS, DHCP, Jellyfin, Vikunja and network shares. And I get the knowledge that it is all local and under my control.

I haven’t done it myself but Eufy cameras seem to be among the easier ones to flash. :)
github.com/…/Camera:-Eufy-E220-‐-Ingenic-usb-firm…

www.youtube.com/shorts/sRiBUtaGxl4

Thingino makes sure your cameras are yours and no one elses, they have a list of cameras that work with it:
thingino.com

I recommend that you look into nagios and zabbix before you get started. Both have free selfhosted open source solutions. And both are used professionally on the enterprise level so you even gain a skillset that can earn you money!

www.zabbix.com/download?zabbix=7.0
www.nagios.org/downloads/nagios-core/thanks/

(do we still call it that?)

Primary and secondary is what it is usually called today. I know both Microsoft and Cloudflare does at least.
www.cloudflare.com/…/primary-secondary-dns/

Check if you need a flag when starting it to bind 0.0.0.0 instead of 127.0.0.1

Depending on the use and the size of your graphics card you might be better of trying Gemma 4 12B too.
On my Nvidia 5060 Ti 16GB I can use either Gemma 4 A4B IQ3_M (larger model but highly compressed) or Gemma 4 12B Q8_0 (smaller model but much less compression) and after a night of testing with the Gemma 4 12B Q8_0 I’d say it’s a better helper when it comes to coding but a worse gm for my dnd inspired fantasy world roleplaying adventure.

I imagine your “setup a selfhosted environment” is closer to the first.

Easy setup would be to use koboldcpp + SillyTavern + Gemma 4 26B A4B GGUF of the largest quant your graphics card can fit together with your context.
Remember to setup SillyTavern to allow network connections and create a user and password, default installation is localhost only.
Set the temperature to 0.2 and make sure all the formatting templates inside Advanced Formatting are set to Gemma 4.

Then use either Gemma 4 itself or the free google.com AI to create some “W++ Denze with Horizontal Lines summaries for Gemma 4” of the relevant documentation of the latest version of the home server apps your friends are gonna install.
You should ensure the resulting lorebook entries are no more than 1k tokens each to leave some context for your friends chats, add it to a character card in SillyTavern and set some keywords to allow them to load dynamically and not stay in context memory all the time.

Regarding the character card you can ask Gemma 4 to write that for you too, I find “Write a character card in W++ Denze with Horizontal Lines style for Gemma 4 with this name, personality, attitude and skillset” works well for that.
Then ask it to write a “First message prompt that starts with X, continues with Y and ends with Z for that character card” and you get a first draft to rewrite and paste into the “First Message” of the character card. The first message works as a template that Gemma 4 will imitate when you chat with it. Then simply try the chatbot out before letting others use it.

I find my own Gemma 4 26B A4B IQ3_M works well for practicing hiragana and katakana, discussing programming or troubleshoot existing code or writing a small function but it can’t be expected to write a correct DatabaseService.cs from scratch and stuff like that.

Oh and forget about finding good cards and lorebooks for SillyTavern use online, most users use it for NSFW Roleplaying chats. It is a very easy UI to use to create harnesses for your local LLM though.

I find setting up an openvpn server with self-signed certificates + username and password login works well. You can even run it on tcp/443 instead of tcp/1194 if you want to make it less likely to be blocked.

Unless you wanna expose services to others my recommendation is always to hide your services behind a vpn connection.

I prefer running true vms too, but it is resource intensive.
Playing with lxcs and docker could allow one to run more services on a little beelink.

A VM is properly isolated and has it’s own OS and kernel. This improves security at the cost of overhead.
If you are starved for hardware resources then running lxcs instead of vms could give you more bang for the buck.

I remember trying both back when my server was new but missing something in dockge, can’t remember what right now.

I wouldn’t use RAID on USB.
If you only got 2x m.2 slots then I would probably prioritize disk space over RAID1 and ensure you got a backup up and running. There are m.2 to sata adapters but your Bee-link doesn’t have a suitable psu for that.

I would start with one VM running portainer and once that is up and running I would recommend learning how to backup and restore the VM. If you have enough disks I would look into ZFS RAID 1 for redundancy.
pve.proxmox.com/wiki/ZFS_on_Linux
Learning the redundancy and backup systems before having too many services active allows you to screw up and redo.