starshipwinepineapple

@starshipwinepineapple@programming.dev

• ⁨Comment⁩ on ⁨Very large amounts of gaming gpus vs AI gpus⁩ ⁨⁨2⁩ ⁨weeks⁩ ago⁩:

  Tflops is a generic measurement, not actual utilization, and not specific to a given type of workload. Not all workloads saturate gpu utilization equally and ai models will depend on cuda/tensor. the gen/count of your cores will be better optimized for AI workloads and better able to utilize those tflops for your task. and yes, amd uses rocm which i didn’t feel i needed to specify since its a given (and years behind cuda capabilities). The point is that these things are not equal and there are major differences here alone.

  I mentioned memory type since the cards you listed use different versions ( hbm vs gddr) so you can’t just compare the capacity alone and expect equal performance.

  And again for your specific use case of this large MoE model you’d need to solve the gpu-to-gpu communication issue (ensuring both connections + sufficient speed without getting bottlenecked)

  I think you’re going to need to do actual analysis of the specific set up youre proposing. Good luck

• ⁨Comment⁩ on ⁨Very large amounts of gaming gpus vs AI gpus⁩ ⁨⁨2⁩ ⁨weeks⁩ ago⁩:

  The table you’re referencing leaves out CUDA/ tensor cores (count+gen) which is a big part of the gpus, and also not factoring in type of memory. From the comments it looks like you want to use a large MoE model. You aren’t going to be able to just stack raw power and expect to be able to run this without major deterioration of performance if it runs at all.

  Don’t forget your MoE model needs all-to-all communication for expert routing

• ⁨Comment⁩ on ⁨Pi-hole client filtering without DHCP?⁩ ⁨⁨3⁩ ⁨weeks⁩ ago⁩:
  • Custom DNS servers specified on the device to circumvent the pihole
  • dns over https or tls
  • hotspot from approved device
  • alternative YouTube front ends

  These are just off the top of my head. Best case scenario the blocking does work and the teen never tries to bypass it. They’ll still just move onto “wasting” time on something else. This is treating the symptom and not the root cause.

• ⁨Comment⁩ on ⁨Pi-hole client filtering without DHCP?⁩ ⁨⁨3⁩ ⁨weeks⁩ ago⁩:

  Pihole can set up “groups” for different blocklists. You specify client by IP or MAC address so it doesnt matter what the dhcp server is, so long as there’s a static IP or static MAC address. My pihole server doesn’t have dhcp set up and I’m able to do this fine

  Though from personal experience this just becomes a game of cat and mouse, and if you have a motivated teenager then they will find a way to circumvent this. For example android can rotate MAC addresses, and IP addresses are trivial to spoof as well.

• ⁨Comment⁩ on ⁨What are the advantages/disadvantages of the different backup solutions?⁩ ⁨⁨3⁩ ⁨weeks⁩ ago⁩:

  Haven’t used all of those but my recommendation would be to just start trying them. Start small, get a feel for it and expand usage or try a different backup solution. You should be able to do automatic backups for any of them either directly or setting up your own timer/cron jobs (which is how i do it with rsync).

• ⁨Comment⁩ on ⁨Your help needed: PhD research on why people choose to self-host⁩ ⁨⁨2⁩ ⁨months⁩ ago⁩:

  I submitted a response but if i may give some feedback, the second portion brings up:

  I am willing to pay a substantial amount for hardware required for self-hosting.

  This seemed out of place because there were no other value related questions. Such as:

  • I believe self hosting saves me money in the short term
  • i believe self hosting saves me money in the long run

  I’m sure you could also think of more. But i think it’s pretty important because between cloud service providers and any non-free apps you want to use, it can be quite costly compared to the cost of some hardware and time it takes to set things up.

  The rest of my responses don’t change but if you’re wanting to understand the impact of money in all of this i think some more questions are needed

  Best of luck!

• ⁨Comment⁩ on ⁨Jellyfin troubles - phone cannot reach⁩ ⁨⁨2⁩ ⁨months⁩ ago⁩:

  You’re not connected to wifi or vpn from the looks of it. jellyfin is hosted on your local network. You need to be connected to that network for any device you want to access it. The most direct way is to connect via wifi. If you want access from outside your house you’ll need to look into opening a remote connection via something like cloudflare tunnel

• ⁨Comment⁩ on ⁨Self Hosted OpenSource Projectmanagement Tool⁩ ⁨⁨2⁩ ⁨months⁩ ago⁩:

  Logseq to some extent, but it’s set up to be a journal/ meeting notes where you tag pages, add documents, etc it world be up to how you’ve tagged things. Does have a graph view of you pages and whiteboard feature.

  Personally it wasn’t exactly what i wanted out of a PKM but it is really powerful and intended to handle taking notes efficiently from meetings and then somewhat self organizing the notes as long as you tag stuff.

• ⁨Comment⁩ on ⁨What webapps do you selfhost that aren't media/game servers?⁩ ⁨⁨2⁩ ⁨months⁩ ago⁩:

  Foundry was the 2nd thing i started self hosting (the first being pihole). Have had it running for 5 years now.

  Other than that i only recently started expanding my self hosting:

  • tandoor recipes
  • navidrome (for music, mentioning it since it isn’t the typical media server recommendation)
  • personal knowledge management (pkm) static website that i build with hugo
  • umami analytics
  • Remark42 for comment system on one of my internal static websites
  • a few smaller things that i built. One is a discord bot from before i started hating discord, and then a few web apps that i haven’t open sourced yet
• ⁨Comment⁩ on ⁨Reddit infiltrators, need a shortened Lemmy link to evade Reddit filtering? DM me⁩ ⁨⁨2⁩ ⁨months⁩ ago⁩:

  Without knowing what reddit is doing, I’m not sure. A JS redirect could be detected, but if OPs paid shortener service is working then reddit is probably working off a simple domain block list. In that case you could use throw away domains.

  But JS redirect, proxy response, etc all could just become a game of cat and mouse. Just depends how motivated either side is. But given how big reddit is, i think you’d have the advantage. Just gets expensive since each time your domain gets blocked you’ll be paying to register a new one.

• ⁨Comment⁩ on ⁨Reddit infiltrators, need a shortened Lemmy link to evade Reddit filtering? DM me⁩ ⁨⁨2⁩ ⁨months⁩ ago⁩:

  I’m not familiar with the reddit filtering but have you tried using cloudflare page rules? You can try capturing everything after the .tld and then forward it to a lemmy server. So for instance somedomain.tld/12345 could forward to lemmy.world/post/12345. If reddit is checking links for 301 redirects to lemmy though then that wouldn’t work though.

  A more advanced approach would be to use a cloudflare worker to do a proxy response so the status code is returned as 200 OK instead of 301 redirect. I haven’t tried that but i think that would be much harder for them to block and you could always make more elaborate urls to make it harder to find obvious lemmy-like structure

• ⁨Comment⁩ on ⁨Selfhosting static site behind two routers?⁩ ⁨⁨3⁩ ⁨months⁩ ago⁩:

  I would use cloudflare pages (or any forge ‘pages’ feature) before using tunnels for a static website

• ⁨Comment⁩ on ⁨Definitely didn't waste half an hour making this⁩ ⁨⁨4⁩ ⁨months⁩ ago⁩:
  0. Pen or bust
• ⁨Comment⁩ on ⁨Any nice playbook or tutorial to host a static website from home?⁩ ⁨⁨5⁩ ⁨months⁩ ago⁩:

  This is something that doesn’t really need to be self hosted unless you’re wanting the experience. You just need:

  1. Static website builder. I use hugo but there’s a few others like jekyll, astro
  2. Use a git forge (github, gitlab, codeberg).
  3. Use your forges Pages feature, there’s also cloudflare pages. Stay away from netlify imo. Each of these you can set up to use your own domain

  So for my website i just write new content, push to my forge, and then a pipeline builds and releases the update on my website.

  Where self hosting comes into play is that it could make some things with static websites easier, like some comment systems, contact forms, etc. But you can still do all of this without self hosting. Comments can be handled through git issues (utteranc.es) and for a contact form i use ‘hero tofu’ free tier. In the end i don’t have to worry about opening access to my ports and can still have a static website with a contact form.

• ⁨Comment⁩ on ⁨Immich: opinion revised⁩ ⁨⁨5⁩ ⁨months⁩ ago⁩:

  Im not familiar with doku wiki but here’s a few thoughts

  • privacy policy is good to have regardless of what you do with rest of my comments
  • your site is creating a cookie “dokuwiki” for user tracking.
  • cookie is created regardless of user agreement, rather than waiting for acceptance (implied or explicit agreement). As in i visit the page, i click nothing and i already have the dokuwiki cookie.
  • i like umami analytics for a cookieless google analytics alternative. They have a generous free cloud option for hobby users and umami is also self hostable. Then you can get rid of any banner.
• ⁨Comment⁩ on ⁨What does the 3-2-1 rule look like for you?⁩ ⁨⁨5⁩ ⁨months⁩ ago⁩:
  1. Main workstation
  2. Local NAS (sync w/ #1, backup to #3)
  3. Cloud backup w/ commercial provider
• ⁨Comment⁩ on ⁨Which reverse proxy do you use/recommend?⁩ ⁨⁨5⁩ ⁨months⁩ ago⁩:

  I have had the same experience. Have used all three at some point but mostly use nginx for new servers