Canopyflyer
@Canopyflyer@lemmy.world
- Comment on Well, shit. 3 weeks ago:
Reminds me of a major incident I got involved in. I was the Problem Manager and not MIM (Major Incident Management), but I’ve had years of MIM experience so was asked to help out on this one. The customer manufactured blood plasma and each of the lots on the production floor was worth a cool $1 million. The application that was down and had brought production down was not the app that actually handled production, but an application (service) that supplied data to it.
Of course the customer thought that app was not Mission Critical so it didn’t have redundancy. I joined the call and first thing I asked was when did the last change go through on this app… Spoiler: I had the change in front of me and it went in the previous night. The admin of the app speaks up that he did a change the previous night… And NO the MIM team had NOT looked at that change yet… Did I mention this was FOUR FUCKING HOURS into the outage? That is MIM 101. Something goes down, look to see who last fucked with it.
This is why you need experienced MIM people in enterprise environments.
So I took control of the MIM, instructed the App Admin to share his screen and walk us through the change he did the previous night… Two screens in and OH… Look at that… There’s a check box that put the app into read only (or something like that, this happened back in 2009 and I don’t remember all the details). I’d never seen the application before in my life, but knew that check box being checked, just based on the verbiage, could not be right… So I asked… The Admin, sounding embarrassed, said yeah he forgot to uncheck that box last night…
Fuck me.
He unchecked the box, bounced the app and what do you know… It started to work.
A single damn check box brought down the production line of a multi-billion dollar company.
My investigation for that Problem was a bit scathing to multiple levels of the customer. If a service supports a Tier 1 production app and that Tier 1 app would stop working if that service goes down… GUESS WHAT! That service is MISSION FUCKING CRITICAL and it should be supported as such. My employer was not on the hook for this one, as both applications involved were customer supported, we just did the MIM support for them.
I would love to say that the above is an uncommon occurrence, but honestly it is the main reason for outages in my experience. Something small and stupid that is easily missed.
- Comment on Would we be able to use the measles virus to reset the immune systems of people with autoimmune disorders like MS or rheumatoid arthritis? 1 month ago:
Because it is a LOT more complicated than that.
Not all rheumatological diseases are due to the immune system’s memory. As a case in point, Ankylosing Spondylitis is theorized as being caused by a mis-folded HLA-B27 protein response. The mis-folded protein response is caused by cellular stress, at least that is the theory. The lead singer of Imagine Dragon Dan Reynolds suffers from this disease. So there are people out there suffering from it, it’s not just some disease out in left field no one has heard of before.
Are there diseases that could be treated by clearing the immune system’s memory? Possibly, but there would also be consequences for that as well. Mainly, because the actual method by which the memory works is not completely understood.
Disclaimer: My wife is a Rheumatologist that does both basic research and clinical work. What I wrote above is based on what I have gleaned from her over the years. Any mistakes or misconceptions are strictly mine. I’m just an old IT guy and have never studied medicine.
- Comment on Gringos out here wilin' 2 months ago:
That photo is from when the gas main blew up right?
I was working at AmFam at the time.
- Comment on Today's Survey. One point for everything that you have NEVER DONE 5 months ago:
Can confirm.
Am old.
Scored a zero.
- Comment on Today's Survey. One point for everything that you have NEVER DONE 5 months ago:
Older Gen X’er here.
This list was basically a Tuesday for me back in the day.
- Comment on You guys have to end it 6 months ago:
As someone that literally spent 25 years driving a manual, including various stints in racing. Manuals have seen their day.
It used to be if you wanted better mileage, you drove a manual. If you wanted to be faster on the track, drive a manual (caveat there is drag racing.)
Today? The computer is just better at controlling a transmission. I drive a Camry Hybrid now and not having shifts is REALLY weird and the drone getting up to highway speeds is annoying, but I do like the 45mpg. Not to mention, when I sat down to learn how the Toyota Hybrid Drive works… It’s a pretty clever system.
There are a lot of times that nostalgia gets the better of me and I wish I had a car with a manual. My oldest is possibly joining a skating team that is a 2 hour drive away. It’s tempting to let him use my car and then buy an older manual for myself as a toy. I’d love to get a hold of another mid-80’s Corolla GT-S. I autocrossed one back in the late 80’s early 90’s. It still remains my favorite car I’ve ever owned.
- Comment on Badgers 11 months ago:
TIL!
I’ve lived in Wisconsin since 2006 and did not know that.
Thank you!
- Comment on Badgers 11 months ago:
Wisconsinite here where the badger is native and the mascot for the University of Wisconsin is the Badger.
This meme is inaccurate.
The American Badger will also remove your kidneys and sell them on the black market as well, to support their meth habit.