Might it also be possible/feasible to send an “email blast” to everyone with a slrpnk.net account? It would probably be quite complicated to send that many emails at once without getting blocked by the major email providers, but hypothetically we’ve all registered with emails…
Comment on Slrpnk.net outage
Kris@feddit.org 3 weeks agoWell, on the plus side lots of lessons learned and I think I might move at least the xmpp server to an external vps to have a backup communication channel.
mad_lentil@lemmy.ca 3 weeks ago
Kris@feddit.org 3 weeks ago
As email in profile is an optional feature on our instance about 50% of the userbase opted to not share one so we would only reach some people. But yes, getting spam filtered woukd be another problem of mass-mailing.
But I found a way to put up a simple html error page and will add this later to inform our members and link to this thread.
tenchiken@lemmy.dbzer0.com 3 weeks ago
Not sure about your area, but a wireguard accessible OOB connection is a great piece of kit to keep handy. I use a cheap 768kbps SIM in an Ethernet connected switch into my personal systems. It’s saved my skin numerous times.
I’m sure this is obvious, especially in hindsight, but just mentioning because the existence of IoT LTE data plans for a minimal fee ( $100/year for me in Midwest US) was NOT obvious to me until 2 years ago.
Kris@feddit.org 3 weeks ago
Yeah I had plans to set up something like that, but always other priorities and in this specific case I could maybe access other internal servers but i would need KVM access to reboot the firewall or some other way to cut physical power. And exfiltrating hundreds of gbs of lemmy database wouldn’t work over such a small pipe either.
MelodiousFunk@startrek.website 3 weeks ago
This is something that even larger corps struggle with. My old company would buy some other company, lay off a bunch of people, others would quit, and then it was shocked Pikachu faces all around when That One Thing stopped working in an office they turned into a ghost town and, well, no, nobody was going to be there until Monday morning to power cycle etc. True lights out/OOB reachability is WORK. And there’s always going to be a SPOF somewhere that requires hands on-site.
Do what you can, when you can. And thank you for all that y’all have done so far.
curbstickle@lemmy.dbzer0.com 3 weeks ago
For that, I’d highly recommend a power conditioner with outlet controls (and preferably sequencing).
Most are pretty expensive, but you can get something like a surgex squid or a gude expert power control for a few hundred here and there, which will give you great data on power usage as well. You can also grab an older model with serial and/or relay controls, and use a pi or whatever is handy to trigger it. Actually have a setup like that in a few racks for clients (mostly orange pis and a couple of Asus tinker boards).
Hope your trip goes well!