Mailing List Archive: Re: [EXTERNAL] Outage in He / Zayo in Dallas area

Re: [EXTERNAL] Outage in He / Zayo in Dallas area

Aug 27, 2021, 12:32 PM

Post #1 of 4 (376 views)

Something went on with HE in STL/KC also, I saw a few hits/drops between around 1:05 and 1:20pm central or so. BGP timers show tons of routes with reset counters for an HE site in STL. ISP we have at sites in Dallas and KC also took a hit, and HE is one of their main transit providers. Only common variable I could spot so far was HE.

From: Outages <outages-bounces@outages.org> On Behalf Of Yafim Kazak via Outages
Sent: Friday, August 27, 2021 2:19 PM
To: outages@outages.org
Subject: [EXTERNAL] [outages] Outage in He / Zayo in Dallas area

Has anyone else noticed outage in HE / Zayo in Dallas area? -- Yafim. ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?

Has anyone else noticed outage in HE / Zayo in Dallas area?
--
Yafim.

Re: [EXTERNAL] Outage in He / Zayo in Dallas area [ In reply to ]

outages at outages

Aug 27, 2021, 12:46 PM

Post #2 of 4 (376 views)

Permalink

Yes, HE in Dallas and Phoenix are both having some packet loss. We had BGP resets by HE at 13:05 in Dallas for both our IPv4 and IPv6 peers. The session came back a few minutes later, but after 23 minutes we'd only learned 336k IPv4 routes which is well short of what we expect (currently at 862k IPv4 routes from HE in Denver which appears stable). We made a decision to drop HE in Dallas and Phoenix until they sort it out.
_______________________________________________
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Re: [EXTERNAL] Outage in He / Zayo in Dallas area [ In reply to ]

outages at outages

Aug 27, 2021, 12:47 PM

Post #3 of 4 (376 views)

Permalink

Yeah, we too saw our Dallas sessions drop with HE (both peering and
transit.)

Sessions dropped at 1:05p CDT and all came back at 1:16p.

We take transit from them elsewhere too, but I only saw Dallas drop.

On 8/27/21 9:32 PM, Neader, Brent via Outages wrote:
> Something went on with HE in STL/KC also, I saw a few hits/drops between
> around 1:05 and 1:20pm central or so. BGP timers show tons of routes
> with reset counters for an HE site in STL. ISP we have at sites in
> Dallas and KC also took a hit, and HE is one of their main transit
> providers. Only common variable I could spot so far was HE.
>
> *From:*Outages <outages-bounces@outages.org> *On Behalf Of *Yafim Kazak
> via Outages
> *Sent:* Friday, August 27, 2021 2:19 PM
> *To:* outages@outages.org
> *Subject:* [EXTERNAL] [outages] Outage in He / Zayo in Dallas area
>
> Has anyone else noticed outage in HE / Zayo in Dallas area? -- Yafim. ?
> ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?
> ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?
> ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?
> ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?
> ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?
>
> Has anyone else noticed outage in HE / Zayo in Dallas area?
>
> --
>
> Yafim.
>
>
> _______________________________________________
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
_______________________________________________
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Re: [EXTERNAL] Outage in He / Zayo in Dallas area [ In reply to ]

outages at outages

Aug 27, 2021, 12:55 PM

Post #4 of 4 (376 views)

Permalink

Finally, we have received confirmation from HE on the outage without
details. still waiting for zayo.

On Fri, Aug 27, 2021 at 10:33 PM Neader, Brent <Brent.Neader@druryhotels.com>
wrote:

> Something went on with HE in STL/KC also, I saw a few hits/drops between
> around 1:05 and 1:20pm central or so. BGP timers show tons of routes with
> reset counters for an HE site in STL. ISP we have at sites in Dallas and
> KC also took a hit, and HE is one of their main transit providers. Only
> common variable I could spot so far was HE.
>
>
>
> *From:* Outages <outages-bounces@outages.org> *On Behalf Of *Yafim Kazak
> via Outages
> *Sent:* Friday, August 27, 2021 2:19 PM
> *To:* outages@outages.org
> *Subject:* [EXTERNAL] [outages] Outage in He / Zayo in Dallas area
>
>
>
> Has anyone else noticed outage in HE / Zayo in Dallas area? -- Yafim. ? ?
> ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?
> ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?
> ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?
> ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?
> ? ? ? ? ? ? ? ? ? ? ? ? ? ?
>
> Has anyone else noticed outage in HE / Zayo in Dallas area?
>
> --
>
> Yafim.
>
>
>

--
Yafim (Fima) Kazak
Software engineer, Core team