I can only imagine the series of failures that led to that outcome. That’s wild. Resume Generating Event for someone I’d assume.
--
Christopher Conley
Systems Administrator | Fors Marsh
4250 N Fairfax Dr, Suite 520
Arlington, VA 22203
From: Outages <outages-bounces@outages.org> On Behalf Of Matt Morgensen via Outages
Sent: Thursday, November 2, 2023 9:09 AM
To: Outages <outages@outages.org>
Subject: [EXTERNAL] Re: [outages] Dreamhost MySQL outage?
We're in Flexential PDX02, I have guys on-site now.
Looks like they lost utility, switched to generator, and then generator failed (not clear on scope of Gen failure yet). Some utility power is back, so recovery is in progress for some portion of the site. I still have ~70 racks without power....but things are coming back to life slowly.
On Thu, Nov 2, 2023 at 6:01?AM Tom Strickx via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
Flexential PDX02 is entirely down right now. Full power outage.
--
Tom Strickx
Principal Network Engineer
AS13335 - Cloudflare
On Thu, Nov 2, 2023 at 12:31?PM Bob Colon via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
All my sites, hosted on one of their VPSes is down hard. I can't SSH in, and it's not responding to pings. According to their status page, their data center on Portland is down hard:
https://www.dreamhoststatus.com/
On Thu, Nov 2, 2023 at 7:27?AM Max Leonard via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
cloudflare is having issues again (https://www.cloudflarestatus.com/) -- probably unrelated but ::shrug::
On Thu, Nov 2, 2023 at 7:16?AM James Lawrie via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
It could be something else, but one of our sites is down because MySQL endpoint is unresponsive, and attempting to login to contact them panel.dreamhost.com<http://panel.dreamhost.com> has the same problem (gives either 503 or times out).
_______________________________________________
Outages mailing list
Outages@outages.org<mailto:Outages@outages.org>
https://puck.nether.net/mailman/listinfo/outages
_______________________________________________
Outages mailing list
Outages@outages.org<mailto:Outages@outages.org>
https://puck.nether.net/mailman/listinfo/outages
_______________________________________________
Outages mailing list
Outages@outages.org<mailto:Outages@outages.org>
https://puck.nether.net/mailman/listinfo/outages
_______________________________________________
Outages mailing list
Outages@outages.org<mailto:Outages@outages.org>
https://puck.nether.net/mailman/listinfo/outages
The content of this email is confidential and intended for the recipient specified in message only. It is strictly forbidden to share any part of this message with any third party, without a written consent of the sender. If you received this message by mistake, please reply to this message and follow with its deletion, so that we can ensure such a mistake does not occur in the future.
--
Christopher Conley
Systems Administrator | Fors Marsh
4250 N Fairfax Dr, Suite 520
Arlington, VA 22203
From: Outages <outages-bounces@outages.org> On Behalf Of Matt Morgensen via Outages
Sent: Thursday, November 2, 2023 9:09 AM
To: Outages <outages@outages.org>
Subject: [EXTERNAL] Re: [outages] Dreamhost MySQL outage?
We're in Flexential PDX02, I have guys on-site now.
Looks like they lost utility, switched to generator, and then generator failed (not clear on scope of Gen failure yet). Some utility power is back, so recovery is in progress for some portion of the site. I still have ~70 racks without power....but things are coming back to life slowly.
On Thu, Nov 2, 2023 at 6:01?AM Tom Strickx via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
Flexential PDX02 is entirely down right now. Full power outage.
--
Tom Strickx
Principal Network Engineer
AS13335 - Cloudflare
On Thu, Nov 2, 2023 at 12:31?PM Bob Colon via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
All my sites, hosted on one of their VPSes is down hard. I can't SSH in, and it's not responding to pings. According to their status page, their data center on Portland is down hard:
https://www.dreamhoststatus.com/
On Thu, Nov 2, 2023 at 7:27?AM Max Leonard via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
cloudflare is having issues again (https://www.cloudflarestatus.com/) -- probably unrelated but ::shrug::
On Thu, Nov 2, 2023 at 7:16?AM James Lawrie via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
It could be something else, but one of our sites is down because MySQL endpoint is unresponsive, and attempting to login to contact them panel.dreamhost.com<http://panel.dreamhost.com> has the same problem (gives either 503 or times out).
_______________________________________________
Outages mailing list
Outages@outages.org<mailto:Outages@outages.org>
https://puck.nether.net/mailman/listinfo/outages
_______________________________________________
Outages mailing list
Outages@outages.org<mailto:Outages@outages.org>
https://puck.nether.net/mailman/listinfo/outages
_______________________________________________
Outages mailing list
Outages@outages.org<mailto:Outages@outages.org>
https://puck.nether.net/mailman/listinfo/outages
_______________________________________________
Outages mailing list
Outages@outages.org<mailto:Outages@outages.org>
https://puck.nether.net/mailman/listinfo/outages
The content of this email is confidential and intended for the recipient specified in message only. It is strictly forbidden to share any part of this message with any third party, without a written consent of the sender. If you received this message by mistake, please reply to this message and follow with its deletion, so that we can ensure such a mistake does not occur in the future.