liliumstar

@liliumstar@lemmy.dbzer0.com

• ⁨Comment⁩ on ⁨Help with domain⁩ ⁨⁨1⁩ ⁨week⁩ ago⁩:

  Have you been wronged by njalla?

  I think having an external owner is preferable.

• ⁨Comment⁩ on ⁨Consumer GPUs to run LLMs⁩ ⁨⁨1⁩ ⁨week⁩ ago⁩:

  I know you said consumer GPU, but I run a used Tesla P40. It has 24 GB of vram. The price has gone up since I got it a couple years ago, there might be better options in the same price category. Still, it’s going to be cheaper than a modern full fat consumer gpu, with a reasonable performance hit.

  My use case is text generation, chat kind of things. In most cases, the inference is more than fast enough, but it can get slow when swapping out large context lengths.

  Mostly I run quantized 8-20B models with the sweet spot being around 12. For specialized use cases outside of general language, you can run more compact models. The general output is quite good, and I would have never had thought it was possible 10 years ago.

• ⁨Comment⁩ on ⁨Encrypting data on local servers?⁩ ⁨⁨1⁩ ⁨week⁩ ago⁩:

  I would do FDE yeah. My current laptop setup is with systemd-boot and a special initramfs that allows me to unlock it with a yubikey, with fallback to password. Fair warning, this exact configuration is not particularly easy to setup.

  There are also modules which enable early network connectivity along with a SSH server, meaning you login and unlock it remotely. I have not tried this.

  Debian does not frequently require rebooting under normal circumstances. Kernel updates are not that frequent, and you can usually put it off for a bit if you don’t want to deal with it.

• ⁨Comment⁩ on ⁨I finally got TruNas running an LLM on my AMD GPU!!!⁩ ⁨⁨1⁩ ⁨week⁩ ago⁩:

  Congrats! I just got a similar running on Arch with a 5700 XT. When I looked at it a couple years ago, it wasn’t really possible. Now, smooth sailing.

• ⁨Comment⁩ on ⁨Appropriate settings for a private matrix server⁩ ⁨⁨2⁩ ⁨weeks⁩ ago⁩:

  Yeah, you can turn off registration without a token. Then, if you want someone to register you can issue them a registration token, or manually create their account.

  Federation can be turned on, on a case by case basis.

  You can set rooms to invite only and not discoverable. Alternately, you can use an invite-only space that allows users to join rooms from there.

  The first two parts are done in the server config, see the synapse docs. The last is done once the server is setup and running as an admin.

• ⁨Comment⁩ on ⁨Starting to self host⁩ ⁨⁨4⁩ ⁨weeks⁩ ago⁩:

  To start small setup a static website behind nginx. This requires you to create a basic website or copy a template, it goes somewhere in your filesystem, in linux /var/www is common. Once you have that, setup the nginx service and point it to that location. You can do this locally then expose it to the net or put on a VPS. Here is a dead simple guide presuming you have a remote server: dev.to/…/how-to-deploy-a-simple-website-with-ngin…

  Once you have that covered, ensure you know how to setup ssh keys and such, then install, configure, and run services. From there, most things are easy outside of overly complicated configurations.

• ⁨Comment⁩ on ⁨Any nice playbook or tutorial to host a static website from home?⁩ ⁨⁨5⁩ ⁨weeks⁩ ago⁩:

  I happened across this tool to help you create configs, it looks pretty good, easier than piecing together all the parameters separately: www.digitalocean.com/community/tools/nginx Seems like it has directions for certbot and generating dhparams, etc. as well.

• ⁨Comment⁩ on ⁨Anyone run a matrix server in the cloud? How much does it cost you?⁩ ⁨⁨1⁩ ⁨month⁩ ago⁩:

  For something like that, you’d want a VPS with 2-4 cores, 4 GB RAM, 80 GB SSD. Any less and you’ll start to run into problems when adding bridges and stuff.

  So, it’s really a matter of what deals you can find in that bracket, and if you care about the geographical region it’s hosted in. Usually lowendtalk.com is a good place to start looking at options.

• ⁨Comment⁩ on ⁨Pi-Hole question regarding unbound and cloudflared⁩ ⁨⁨1⁩ ⁨month⁩ ago⁩:

  I think what you have is fine, and wouldn’t worry about it too much.

  That said, I run unbound with pi-hole, directing the dns queries through a wireguard tunnel. It’s a bit slower, but I do like having my own recursive DNS, especially with news that more and more services are implementing DNS level blocking.

• ⁨Comment⁩ on ⁨Uses for a SBC (When You Already Have an x86 Mini-PC?)⁩ ⁨⁨4⁩ ⁨months⁩ ago⁩:

  Media server client, pihole, emulation, programming or home automation project. You could even prop it up as a standalone web server and make some kinda creative thing.

• ⁨Comment⁩ on ⁨Authentication for external sevices⁩ ⁨⁨5⁩ ⁨months⁩ ago⁩:

  It’s feasible as long as all the stuff you want to auth supports oauth, oidc, or saml. It might be a bit overkill for your use case, unless you have a bunch of services you didn’t mention. Keycloak has a bit of a learning curve, but works great once you get past that.