Mailing List Archive

8:22 AM PST We are investigating increased error rates for the AWS Management Console.
8:26 AM PST We are experiencing API and console issues in the US-EAST-1 Region. We have identified root cause and we are actively working towards recovery. This issue is affecting the global console landing page, which is also hosted in US-EAST-1. Customers may be able to access region-specific consoles going to https://console.aws.amazon.com/. So, to access the US-WEST-2 console, try https://us-west-2.console.aws.amazon.com/


________________________________
From: Outages <outages-bounces@outages.org> on behalf of Steve Rieger via Outages <outages@outages.org>
Sent: Tuesday, December 7, 2021 10:23 AM
To: outages@outages.org <outages@outages.org>
Subject: [outages] AWS east is reporting an outage, seems to be affecting IAM globally


EOM

________________________________
------------------------------------------------------------
-SECURITY/CONFIDENTIALITY WARNING-

This message and any attachments are intended solely for the individual or entity to which they are addressed. This communication may contain information that is privileged, confidential, or exempt from disclosure under applicable law (e.g., personal health information, research data, financial information). Because this e-mail has been sent without encryption, individuals other than the intended recipient may be able to view the information, forward it to others or tamper with the information without the knowledge or consent of the sender. If you are not the intended recipient, or the employee or person responsible for delivering the message to the intended recipient, any dissemination, distribution or copying of the communication is strictly prohibited. If you received the communication in error, please notify the sender immediately by replying to this message and deleting the message and any accompanying files from your system. If, due to the security risks, you do not wish to receive further communications via e-mail, please reply to this message and inform the sender that you do not wish to receive further e-mail from the sender. (LCP301)
------------------------------------------------------------

It impacts console access to global services (IAM, Route 53) but services on other regions seem to work correctly.

I'm seeing errors on S3 buckets on us-east-1 as well. Errors started to appear at around 15:30 UTC.

On Tue, Dec 7, 2021, at 17:23, Steve Rieger via Outages wrote:
> EOM
>
Kevin Decherf - @Kdecherf
GPG 0x108ABD75A81E6E2F
https://kdecherf.com

This outage is having a big impact on other Amazon.com services in the Denver area. While I can access saved Amazon shopping lists, I can't search for products. I also can't stream Prime video. Friends in the area are reporting the same to me.

Lurker here. Many apps are not functional right now. InstaCart is
completely down. Shipt is completely down. A friend just posted that all of
Targets internal systems are down (store pickup, order picking, drive-up).

On Tue, Dec 7, 2021, 8:56 AM Kevin Decherf via Outages <outages@outages.org>
wrote:

> It impacts console access to global services (IAM, Route 53) but services
> on other regions seem to work correctly.
>
> I'm seeing errors on S3 buckets on us-east-1 as well. Errors started to
> appear at around 15:30 UTC.
>
> On Tue, Dec 7, 2021, at 17:23, Steve Rieger via Outages wrote:
>
> EOM
>
> Kevin Decherf - @Kdecherf
> GPG 0x108ABD75A81E6E2F
> https://kdecherf.com
>
> _______________________________________________
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>

Amazon Cust Serv is also down, all functions are offline...
JeffP

jeffp@jeffp.us



*Please consider the environment before printing this e-mail.*

NOTICE:
This email and any files transmitted with it are confidential and intended
solely for the use of the individual or entity to whom they are addressed.
Use or dissemination by persons other than the intended recipient(s) is
strictly prohibited. If you have received this message in error, please
notify the sender immediately by reply e-mail to correct our records.
Please then delete the original message (including any attachments) in its
entirety, including any backup processes that your system may perform.
Please note that any views or opinions presented in this email are solely
those of the author. Email transmission cannot be guaranteed to be secure
or error-free as information could be intercepted, corrupted, lost,
destroyed, arrive late or incomplete, or contain viruses. The sender,
therefore, does not accept liability for any errors or omissions in the
contents of this message, which arise as a result of e-mail transmission.




On Tue, Dec 7, 2021 at 8:59 AM Keith Stokes via Outages <outages@outages.org>
wrote:

> 8:22 AM PST We are investigating increased error rates for the AWS
> Management Console.
> 8:26 AM PST We are experiencing API and console issues in the US-EAST-1
> Region. We have identified root cause and we are actively working towards
> recovery. This issue is affecting the global console landing page, which is
> also hosted in US-EAST-1. Customers may be able to access region-specific
> consoles going to https://console.aws.amazon.com/. So, to access the
> US-WEST-2 console, try https://us-west-2.console.aws.amazon.com/
>
>
> ------------------------------
> *From:* Outages <outages-bounces@outages.org> on behalf of Steve Rieger
> via Outages <outages@outages.org>
> *Sent:* Tuesday, December 7, 2021 10:23 AM
> *To:* outages@outages.org <outages@outages.org>
> *Subject:* [outages] AWS east is reporting an outage, seems to be
> affecting IAM globally
>
>
> EOM
> ------------------------------
> ------------------------------------------------------------
> -SECURITY/CONFIDENTIALITY WARNING-
>
> This message and any attachments are intended solely for the individual or
> entity to which they are addressed. This communication may contain
> information that is privileged, confidential, or exempt from disclosure
> under applicable law (e.g., personal health information, research data,
> financial information). Because this e-mail has been sent without
> encryption, individuals other than the intended recipient may be able to
> view the information, forward it to others or tamper with the information
> without the knowledge or consent of the sender. If you are not the intended
> recipient, or the employee or person responsible for delivering the message
> to the intended recipient, any dissemination, distribution or copying of
> the communication is strictly prohibited. If you received the communication
> in error, please notify the sender immediately by replying to this message
> and deleting the message and any accompanying files from your system. If,
> due to the security risks, you do not wish to receive further
> communications via e-mail, please reply to this message and inform the
> sender that you do not wish to receive further e-mail from the sender.
> (LCP301)
> ------------------------------------------------------------
> _______________________________________________
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>

We started seeing HTTP 429 throttling errors from the Quicksight APIs around the time this started, guessing due to the IAM dependency despite making calls to/from a different region.
_______________________________________________
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

I'm running into issues controlling devices via Alexa now. Unable to
manipulate some smart home devices (Amazon smart plugs, TP-Link smart
plugs, Philips Hue lighting, etc.) The TP-Link plugs and Hue lights can
still be manipulated via their own apps, just not Alexa or the Alexa app.

I'm sure it's probably related.

--
Jeremy Gault, KD4NED
"It's better to give than to receive. Especially advice." - Mark Twain

--- Original message ---
From: Ben Burwell via Outages outages@outages.org
Sent: December 7, 2021 12:36:47
To: outages@outages.org
Subject: Re: [outages] AWS east is reporting an outage, seems to be
affecting IAM globally

> We started seeing HTTP 429 throttling errors from the Quicksight APIs
> around the time this started, guessing due to the IAM dependency despite
> making calls to/from a different region.
> _______________________________________________
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages



_______________________________________________
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Oh, what a coincidence! Earlier I tried asking Alexa to manipulate several
smart home devices and she mismatched the devices completely. My voice was
clear and uninterrupted. I thought maybe my speaker was the issue and moved
on with my day -- as noted by Ben, I could manipulate the devices by app no
problem. After hearing this, it seems something odd may be awry.

--Chris

-----Original Message-----
From: Outages <outages-bounces@outages.org> On Behalf Of Jeremy Gault
(KD4NED) via Outages
Sent: Tuesday, December 7, 2021 2:45 PM
To: Ben Burwell via Outages <outages@outages.org>
Subject: Re: [outages] AWS east is reporting an outage, seems to be
affecting IAM globally

I'm running into issues controlling devices via Alexa now. Unable to
manipulate some smart home devices (Amazon smart plugs, TP-Link smart plugs,
Philips Hue lighting, etc.) The TP-Link plugs and Hue lights can still be
manipulated via their own apps, just not Alexa or the Alexa app.

I'm sure it's probably related.

--
Jeremy Gault, KD4NED
"It's better to give than to receive. Especially advice." - Mark Twain

--- Original message ---
From: Ben Burwell via Outages outages@outages.org
Sent: December 7, 2021 12:36:47
To: outages@outages.org
Subject: Re: [outages] AWS east is reporting an outage, seems to be
affecting IAM globally

> We started seeing HTTP 429 throttling errors from the Quicksight APIs
> around the time this started, guessing due to the IAM dependency
> despite making calls to/from a different region.
> _______________________________________________
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages



_______________________________________________
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages


_______________________________________________
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Oh, what a coincidence! Earlier I tried asking Alexa to manipulate several
smart home devices and she mismatched the devices completely. My voice was
clear and uninterrupted. I thought maybe my speaker was the issue and moved
on with my day -- as noted by Ben, I could manipulate the devices by app no
problem. After hearing this, it seems something odd may be awry.

--Chris

-----Original Message-----
From: Outages <outages-bounces@outages.org> On Behalf Of Jeremy Gault
(KD4NED) via Outages
Sent: Tuesday, December 7, 2021 2:45 PM
To: Ben Burwell via Outages <outages@outages.org>
Subject: Re: [outages] AWS east is reporting an outage, seems to be
affecting IAM globally

I'm running into issues controlling devices via Alexa now. Unable to
manipulate some smart home devices (Amazon smart plugs, TP-Link smart plugs,
Philips Hue lighting, etc.) The TP-Link plugs and Hue lights can still be
manipulated via their own apps, just not Alexa or the Alexa app.

I'm sure it's probably related.

--
Jeremy Gault, KD4NED
"It's better to give than to receive. Especially advice." - Mark Twain

--- Original message ---
From: Ben Burwell via Outages outages@outages.org
Sent: December 7, 2021 12:36:47
To: outages@outages.org
Subject: Re: [outages] AWS east is reporting an outage, seems to be
affecting IAM globally

> We started seeing HTTP 429 throttling errors from the Quicksight APIs
> around the time this started, guessing due to the IAM dependency
> despite making calls to/from a different region.
> _______________________________________________
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages



_______________________________________________
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages


_______________________________________________
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

1) I'm seeing my orders from Amazon.com being delayed 24 hours (just
received an email saying shipping is delayed)

2) McDonald's APP is down (iOS and Android) for several hours. Hosted at
AWS or just a coincidence?