Submitted 1 month ago by otter@lemmy.ca to technology@lemmy.world
https://www.digitaltrends.com/computing/internet-outage-live-blog-october-20/
health.aws.amazon.com/health/status
I suspect the big problem is that IAM (AWS authentication system) is affected and it is not decentralized, which is causing other systems worldwide to fail because the internal authentication is broken.
I can’t login to the AWS console to check on my stuff in the European zone, because the login goes through IAM in us-east-1 where all the authentication does.
There is a chrome addon that will “block” anything from AWS with the goal being you get to see how much of the world relies on it.
I’m starting to understand why some companies are starting to exit AWS and back to their own data centers.
That’s the ebb and flow of IT hosting / support.
On prem -> off prem -> on prem -> off prem
Same goes for off shore workers. Back and forth back and forth
Every company I’ve ever worked for has had that flip flop. :/
AWS doesn’t go down that often to impact such decisions I wouldn’t think… I think it’s more likely that these companies calculated that AWS isn’t worth the price for their workloads?
I’ve been at several companies where just a day’s worth of their AWS costs would be able to finance significantly stronger compute/storage, in addition to an administration team for all that. (Of course it’s not that simple, but you get what I mean)
It really highlights just how centralized so much of the internet is on like three companies (Amazon, Microsoft, and Google)
Cloudflare: What am I? Chopped liver?
my jellyfin didn’t go down
Mine did… Although it’s completely unrelated to AWS.
Kodi is pretty reliable…
Using it right meow. Didn’t even know this was happening till I saw this post.
Neither did mine :)
Oh no, anyways
opens VLC to watch stuff I already downloaded a few days ago
Funny. My Jellyfin instance is working fine. 😏
Sorry I missed this. I was too busy enjoying my library of media locally over Jellyfin.
its us-east-1 as usual, I guess its that time of the year. and the companies haven’t changed either… so, basically the IT guys told the budget approvers we need more money they calculated it and said, no. see you next year for another one.
Or aws still haven’t fixed their own dependantcies on that region
*won’t fix
Looks like it was an Amazon AWS outage. Just geos to how how vulnerable the Internet is as it becomes ever more concentrated into the hands of the tech giants.
As someone who works in tech I occasionally point out to people that if Jeff Bezos decided to go full supervillain he could hold the internet hostage. If you disabled AWS, Azure, or Google Cloud individually the cascading failures on the various systems would take weeks to fix, which we might not have with a supply chain collapse. Genuinely, I think there’s a real chance it could trigger the collapse of human civilization
The mindblowing part of it for me is that a company the size of Disney don’t seem to have the appetite to own and run their own servers.
These are the same people that managed to get two counties redistricted so that they could own their own city, and to this day literally buy the entire electorate by giving housing only to people who vote the way they’re told to.
They’re being run by accountants, and one thing accountants hate is paying people to do a job, its always “far easier” just to pay a company for that.
And criminals.
That’s what they said.
Hehe. Imagine managing your house in the cloud, and suddenly there is no heating, no light, all the “smart” appliances don’t work anymore, and the shower only produces cold water, because the shower thermostat got a “0” as return value when asking for the preferred temperature…
There’s a good reason why I refuse to use cloud connected or Internet required “smart” devices.
It’s essentially an excuse for shitty engineering.
If you really need a device to be cloud connected then it can also maintain mobile data when the remote server is down. Even better, it uses an open spec and you can standup your own server.
Dream on, meanwhile the world will be buying $8 cloud connected “smart switches” because they’re the cheapest, easiest to install things out there and even grandma is able to say “hey Alexa, turn on the coffee maker” and make it work.
This is why Home Assistant exists.
Of course. But 99% of the population is either too lazy or to dumb for that, or such problems would not exist.
It’s not that far off. I woke up to an Internet outage and none of my home lighting routines fired off and I couldn’t control my lights via wifi. I got it under control shifting to Bluetooth but for a second it was infuriating.
the fact that your home network setup for this relies on an internet connection is baffling
Was getting up and turning on the light switch not an option?
Sounds like someone needs HomeAssistant…
I had about a dozen WeMo devices controlling various stuff around the house, they just accumulated over the years. About a year ago, I “got serious” and ripped out all the cloud connected stuff and setup a Zigbee based Home Assistant system. It’s about 5x more capable than the old hodge podge of cloud devices, much lower lag, much better management capabilities, and when the internet connection goes down, it still works. The cloud devices would take long coffee breaks about twice a year.
God, so many things gone wrong there. At least they could use “30” as the default value, right???
at least its not -254
PirateBay reliable as ever…
Thats what happens when a single company controls the flow
Signal seems to be down as well?
Its back up now but that’s because Signal uses AWS.
I like signal and use it daily, but it is very strange that an app built for privacy and security doesn’t let you self host. I wonder about the reasoning behind that sometimes.
I think it’s more questionable that it uses AWS
It appears to be resolved now? I’m able to message people.
It’s working on my end as well!
Oh I didn’t notice 🏴☠️
LoL, same. I didn’t even know a problem existed til I opened up Lemmy this morning. 😂
Same.
It’s perfecto
I sure do love working at an MSP during times like this. Today fuckin sucked. Clients called in non-stop about things being broke AND our ticketing and remote support software was up and down all day
Managed Service Provider, for those curious.
People are too uneducated to just see what works and what doesn’t and add 1 and 1 together. If Google or WhatsApp work and Amazon doesn’t then it‘s definitely an Amazon problem.
Basket, dropped Eggs, broken
but how? isn’t all that stuff all up in the cloud? The cloud is great, right?
AWS outage. Basically Bezos went down on all his customers.
cloud’s gone
Why do these companies still sign with AWS? Didn’t they learn from the last two major outages in us-east? To say nothing of the deceptive business practices to obfuscate service utilization to overcharge businesses?
My guess, the CFO showed that using AWS saves the company a few cents to a fraction of a cent per what ever unit they measure by. Those few cents to a fraction of a cent add up when multiplied by the millions or hundreds of millions of units and that savings makes the CEO look like they are more profitable and can give shareholders more profit.
When everything is about the quarterly results and the need to always show growth so the board and shareholders don’t fire you, you’ll cut corners and take the risk, as long as it has the potential to make you look good.
Can you name a more reliable alternative? With citations?
Because every major cloud provider has outages. On prem clouds also have outages. Everyone does.
AWS has outages. So the answer to your question is obvious, AWS is not an advantage over any other solution.
No system is perfect.
For these large businesses, I imagine they get favorable deals, and all the executives probably know each other and scratch each-other’s backs. For smaller businesses, AWS can decrease time-to-market, it’s easy to find people who are already familiar with it, and is seen as less risky than going with some smaller provider. Though, I hate the “cloud” with a passion, and whenever I’m given the choice, I avoid it. It’s quite a bit cheaper in the long run to avoid cloud providers too. On one long project I worked on, we hadn’t had downtime on any of our VPSs longer than a couple minutes over the course of 8 years.
Good.
Trying to log into AWS this morning for work, and while I’m waiting for the errors to clear out I stumbled upon this article. Thanks for posting!
Meanwhile, my piracy stream app with all those combined together is working fine…
Oh no!
anyway
Can’t even launch docker containers because auth.docker.io is down too.
Postman is also down for me. Can’t sign in, or view workspaces locally.
I think it’s just called BO Max these days
Arrr no!
Anyway…
If this was the work of a hacker then I never want to know their name.
Cloud confections dazzle the eye, but sugar highs eventually die.
Measure, simplify, shred the bloat; the sweetest stack is one you wrote.
(This sugar bill will sink the boat.)
Oompa Loompa doopity doo, I’ve got another problem for you…
aeronmelon@lemmy.world 1 month ago
Funny, my digitized collection movies and TV shows seems to be working just fine. :3
dukemirage@lemmy.world 1 month ago
BananaTrifleViolin@lemmy.world 1 month ago
I think they were just pointing out that this is the problem with subscription services. You own nothing and you’re screwed when the service goes down.
It really doesn’t take “ludicrous amounts of time and money” to build a private library. It’s interesting how the subscription giants have managed to change people’s perceptions - when you buy content to keep, you keep some of the value, but when you subscribe you’re just getting a time pass to use someone else’s library and won’t see that money again.
They sold the proposition on convenience when everything was in one place, but not it’s all fragmented it’s a waste of money.
And of course plenty of people are building media libraries for free by sailing the seas.
foster@lemmy.hangdaan.com 1 month ago
What’s even funnier are the people who spend lots of money on subscription services to own nothing. This outage just demonstrates who really owns their purchases.
SunSunFuego@lemmy.ml 1 month ago
streaming service: 15-20€ per month per service me: vpn 5€ and a cheap hard drive
i’d be poorer with subscribing
teft@piefed.social 1 month ago
Ludicrous amounts of time and money? What do you think is involved with media piracy? lol
thedirtyknapkin@lemmy.world 1 month ago
lmao, buddy you can get a 10tb hard drive for like $200 and fit all the pirated media you want on it. that’s less money than two mainline subscriptions for a year.
SidewaysHighways@lemmy.world 1 month ago
yep!
Dreaming_Novaling@lemmy.zip 1 month ago
So, in the US, a standalone, bare-minimum with ads included Disney+ subscription costs $9.99. Oops, actually we’re raising it to $11.99 TOMORROW! So after a paying for a year of Dinsey’s cheapest plan, you’d have paid $144.
But maybe Disney isn’t your thing? Well. Netflix costs $7.99 for the ad plan, and $17.99 for the no ads plan. But do note, even on the ad supported plan, you STILL can’t watch everything.
Ranges $96-216 per year for ads or no ads.
Like anime? Crunchyroll offers a $7.99 plan, but it might not have all the content, so then there’s the $11.99 plan. So $96-144 per year. But their catalog doesn’t even have every fucking anime, and they’ve let dubbing go to the wayside after buying out their main competitor, Funimation (in which we lost several anime due to licensing).
Listen to music on top of that? Spotify for non-students ($5.99) costs $11.99, so $144 in a year. YT music is $10.99 for non-students, so $132
So say you listen to Spotify, like anime, and watch Netflix, you’re paying at minimum $336 per year, on the cheapest plans available, which usually have ads or missing features.
I’ve been looking at Optiplex and Lenovo ThinkCentres on ebay recently, and for my bare minimum standards of 1. Can support virtualization, 2. Can do Intel quick sync video and encode HEVC 10-bit (So about 10 year old devices) the prices range around $90-$150. Some 2TB HDDs would be about $100. You’d probably be pirating since most of the new shows on streaming services have no physical media to buy/no way of just owning a movie or TV box set. Even then, outright buying music and movies is cheaper in the long run. Anything you already own can be added to your library. You’ll never be told that “oops we didn’t pay to re-up our access to that movie, so it’s gone!” You’ll never have new ads, paywalled features, limited devices, or other bullshit. The server is up whenever you want it to be, provided you can handle being tech support.
So in the end, a home server + drives costs less than paying for several services where you own shit, and they can cut features or raise the price any day. But yes, we’re just being conceited assholes.
panda_abyss@lemmy.ca 1 month ago
Just let us be excited
This is our version when there’s a big storm and your neighbourhood dads start going around with chainsaws offering to cut up downed trees.
balance8873@lemmy.myserv.one 1 month ago
It’s ok to be jealous, it’s a normal emotion.
HertzDentalBar@lemmy.blahaj.zone 1 month ago
You know you can setup a stack for piracy in less than 10min on a $40 microcomputer or even on an old android phone. And with the right setup you can automate the downloads meaning you just search for stuff and it downloads it without effort.
Time and money, not so much.
Checkout YAMS
yams.media
SaveTheTuaHawk@lemmy.ca 1 month ago
1981 wants it’s term back.
Scavenger8294@feddit.org 1 month ago
old server + 12 tb block acc. Costs like 15 cans of coke
remon@ani.social 1 month ago
I don’t wanna say I told you so, but …
mlg@lemmy.world 1 month ago
Dawg even pirate stream sites don’t host on AWS and GCP, you can still watch your content for free online without worrying about a cloud outage because pirate sites actually distribute their files on several cloud platforms since they’re technically always at risk of DMCA lol.
Damage@feddit.it 1 month ago
Yeah I mean, give us this one satisfaction!
ArmchairAce1944@discuss.online 1 month ago
I need to download more shit!
AtariDump@lemmy.world 1 month ago
Yarrrr
FalseTautology@lemmy.zip 1 month ago
How strange my pirate streaming site seems to be fine also