Mailing List Archive

DE-CIX - Wednesday 11:00am - 1:30pm Eastern
Does anyone here know any more about what crashed in the DE-CIX NYC
exchange yesterday between approximately 11am and 1:30pm?

Between those times I'm told the Nokia switching fabric locked up and
ultimately rebooted.
Re: DE-CIX - Wednesday 11:00am - 1:30pm Eastern [ In reply to ]
All,


For clarification, DE-CIX New York operates over a dozen switches as part of our local switch fabric. ONE of our switches malfunctioned for about a two hour period prior to rebooting and that caused problems for customer networks connected to that switch during that period. All other switches were not impacted and the DE-CIX New York exchange did not go down.


Ed d'Agostino

________________________________
From: NANOG <nanog-bounces+ed.dagostino=de-cix.net@nanog.org> on behalf of Matt Hoppes <mattlists@rivervalleyinternet.net>
Sent: Thursday, October 29, 2020 11:29:03 AM
To: North American Network Operators' Group; outages-discussion@outages.org
Subject: DE-CIX - Wednesday 11:00am - 1:30pm Eastern

Does anyone here know any more about what crashed in the DE-CIX NYC
exchange yesterday between approximately 11am and 1:30pm?

Between those times I'm told the Nokia switching fabric locked up and
ultimately rebooted.
Re: DE-CIX - Wednesday 11:00am - 1:30pm Eastern [ In reply to ]
Hi Ed,
Thank you for that clarification.

On 10/29/20 12:05 PM, Ed dAgostino wrote:
> All,
>
>
> For clarification, DE-CIX New York operates over a dozen switches as
> part of our local?switch fabric.? ?ONE of our switches malfunctioned for
> about a two hour period? prior?to rebooting and that caused problems for
> customer networks connected to that switch during that period.? ?All
> other switches were not impacted and the DE-CIX New York exchange did
> not go down.
>
>
> Ed d'Agostino
>
> ------------------------------------------------------------------------
> *From:* NANOG <nanog-bounces+ed.dagostino=de-cix.net@nanog.org> on
> behalf of Matt Hoppes <mattlists@rivervalleyinternet.net>
> *Sent:* Thursday, October 29, 2020 11:29:03 AM
> *To:* North American Network Operators' Group;
> outages-discussion@outages.org
> *Subject:* DE-CIX - Wednesday 11:00am - 1:30pm Eastern
> Does anyone here know any more about what crashed in the DE-CIX NYC
> exchange yesterday between approximately 11am and 1:30pm?
>
> Between those times I'm told the Nokia switching fabric locked up and
> ultimately rebooted.
Re: DE-CIX - Wednesday 11:00am - 1:30pm Eastern [ In reply to ]
On Thu, Oct 29, 2020 at 11:10 AM Matt Hoppes <
mattlists@rivervalleyinternet.net> wrote:

> Hi Ed,
> Thank you for that clarification.
>
> On 10/29/20 12:05 PM, Ed dAgostino wrote:
> > All,
> >
> >
> > For clarification, DE-CIX New York operates over a dozen switches as
> > part of our local switch fabric. ONE of our switches malfunctioned for
> > about a two hour period prior to rebooting and that caused problems for
> > customer networks connected to that switch during that period. All
> > other switches were not impacted and the DE-CIX New York exchange did
> > not go down.
> >
> >
> > Ed d'Agostino


It looks as though something's going on again right now. I just lost
sessions to one of the two route servers, and some but not all of my other
peers on DE-CIX NY.

Matt Harris|Infrastructure Lead Engineer
816-256-5446|Direct
Looking for something?
Helpdesk Portal|Email Support|Billing Portal
We build and deliver end-to-end IT solutions.
Re: DE-CIX - Wednesday 11:00am - 1:30pm Eastern [ In reply to ]
Hi Matt,



please open a ticket with support@de-cix.net and/or call +1-212-796-6914 so that we can have a direct communication with you. We will work with you on resolving the issue right away.



Best regards,

Thomas


--

Dr. Thomas King

Chief Technology Officer (CTO)



DE-CIX Management GmbH | Lindleystraße 12 | 60314 Frankfurt am Main | Germany | www.de-cix.net |

Phone +49 69 1730902 87 | Mobile +49 175 1161428 | Fax +49 69 4056 2716 | thomas.king@de-cix.net |

Geschaeftsfuehrer Harald A. Summa and Sebastian Seifert | Registergericht AG Koeln HRB 51135



DE-CIX 25th anniversary: Without you the Internet would not be the same!

Join us on the journey at https://withoutyou.de-cix.net





From: NANOG <nanog-bounces+thomas.king=de-cix.net@nanog.org> on behalf of Matt Harris <matt@netfire.net>
Date: Thursday, 29. October 2020 at 23:19
To: Matt Hoppes <mattlists@rivervalleyinternet.net>
Cc: North American Network Operators' Group <nanog@nanog.org>
Subject: Re: DE-CIX - Wednesday 11:00am - 1:30pm Eastern



Matt Harris?
|

Infrastructure Lead Engineer

816?256?5446
|

Direct

Looking for something?
Helpdesk Portal
|

Email Support

|

Billing Portal

We build and deliver end?to?end IT solutions.
On Thu, Oct 29, 2020 at 11:10 AM Matt Hoppes <mattlists@rivervalleyinternet.net> wrote:

Hi Ed,
Thank you for that clarification.

On 10/29/20 12:05 PM, Ed dAgostino wrote:
> All,
>
>
> For clarification, DE-CIX New York operates over a dozen switches as
> part of our local switch fabric. ONE of our switches malfunctioned for
> about a two hour period prior to rebooting and that caused problems for
> customer networks connected to that switch during that period. All
> other switches were not impacted and the DE-CIX New York exchange did
> not go down.
>
>
> Ed d'Agostino



It looks as though something's going on again right now. I just lost sessions to one of the two route servers, and some but not all of my other peers on DE-CIX NY.