Mailing List Archive

Yes, we've had a few T1s down all weekend. They are MCI/MFS local loops in
Manhattan, riding an AT&T DS3 up to Connecticut. I know that the issue has
been escalated within Verizon, but I haven't heard an ETR.

For what it's worth, we do also have circuits between MCI/MFS in New York
city and AT&T in Connecticut which appear to be unaffected.






On Jul 26, 2010 9:08am, virendra rode <virendra.rode at outages.org> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----

> Hash: SHA1



> - -------- Original Message --------

> Subject: [Outages-discussion] NYC T1's

> Date: Mon, 26 Jul 2010 12:03:05 -0400

> From: Jason Berenson jason at pins.net>

> To: outages-discussion at outages.org



> Greetings,



> Has anyone noticed any issues with VZ/VZB and ATT in the NYC area? I've

> got a bunch of DS1's that are down, and a few customers with DS3's that

> are out as well.



> - -Jason

> _______________________________________________

> Outages-discussion mailing list

> Outages-discussion at outages.org

> https://puck.nether.net/mailman/listinfo/outages-discussion

> -----BEGIN PGP SIGNATURE-----

> Version: GnuPG v1.4.6 (GNU/Linux)

> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org



> iD8DBQFMTbL+pbZvCIJx1bcRAlHGAKCM1cWhKLogL2AfyCQRyX538uovYgCfRTuv

> U5ZsRnUW463MyA/4Y1TUkk4=

> =VV/L

> -----END PGP SIGNATURE-----

> _______________________________________________

> Outages mailing list

> Outages at outages.org

> https://puck.nether.net/mailman/listinfo/outages

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://puck.nether.net/pipermail/outages/attachments/20100726/6bd07793/attachment.html>

Same here. I just got word that ATT reported a Level 5 outage, but no
more details then that.

-Jason

On 7/26/2010 12:52 PM, amelton at gmail.com wrote:
> Yes, we've had a few T1s down all weekend. They are MCI/MFS local
> loops in Manhattan, riding an AT&T DS3 up to Connecticut. I know that
> the issue has been escalated within Verizon, but I haven't heard an ETR.
>
> For what it's worth, we do also have circuits between MCI/MFS in New
> York city and AT&T in Connecticut which appear to be unaffected.
>
>
>
>
>
>
> On Jul 26, 2010 9:08am, virendra rode <virendra.rode at outages.org> wrote:
> > -----BEGIN PGP SIGNED MESSAGE-----
> >
> > Hash: SHA1
> >
> >
> >
> > - -------- Original Message --------
> >
> > Subject: [Outages-discussion] NYC T1's
> >
> > Date: Mon, 26 Jul 2010 12:03:05 -0400
> >
> > From: Jason Berenson jason at pins.net>
> >
> > To: outages-discussion at outages.org
> >
> >
> >
> > Greetings,
> >
> >
> >
> > Has anyone noticed any issues with VZ/VZB and ATT in the NYC area? I've
> >
> > got a bunch of DS1's that are down, and a few customers with DS3's that
> >
> > are out as well.
> >
> >
> >
> > - -Jason
> >
> > _______________________________________________
> >
> > Outages-discussion mailing list
> >
> > Outages-discussion at outages.org
> >
> > https://puck.nether.net/mailman/listinfo/outages-discussion
> >
> > -----BEGIN PGP SIGNATURE-----
> >
> > Version: GnuPG v1.4.6 (GNU/Linux)
> >
> > Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
> >
> >
> >
> > iD8DBQFMTbL+pbZvCIJx1bcRAlHGAKCM1cWhKLogL2AfyCQRyX538uovYgCfRTuv
> >
> > U5ZsRnUW463MyA/4Y1TUkk4=
> >
> > =VV/L
> >
> > -----END PGP SIGNATURE-----
> >
> > _______________________________________________
> >
> > Outages mailing list
> >
> > Outages at outages.org
> >
> > https://puck.nether.net/mailman/listinfo/outages
> >
>
>
> _______________________________________________
> Outages mailing list
> Outages at outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://puck.nether.net/pipermail/outages/attachments/20100726/24558a44/attachment.html>

I'm guessing that this DACS outage is the root of the problem:

http://online.wsj.com/article/SB10001424052748703700904575391260257717920.html

-J

On Mon, Jul 26, 2010 at 1:06 PM, Jason Berenson <jason at pins.net> wrote:
> Same here.? I just got word that ATT reported a Level 5 outage, but no more
> details then that.
>
> -Jason
>
> On 7/26/2010 12:52 PM, amelton at gmail.com wrote:
>
> Yes, we've had a few T1s down all weekend. They are MCI/MFS local loops in
> Manhattan, riding an AT&T DS3 up to Connecticut. I know that the issue has
> been escalated within Verizon, but I haven't heard an ETR.
>
> For what it's worth, we do also have circuits between MCI/MFS in New York
> city and AT&T in Connecticut which appear to be unaffected.
>
>
>
>
>
>
> On Jul 26, 2010 9:08am, virendra rode <virendra.rode at outages.org> wrote:
>> -----BEGIN PGP SIGNED MESSAGE-----
>>
>> Hash: SHA1
>>
>>
>>
>> - -------- Original Message --------
>>
>> Subject: [Outages-discussion] NYC T1's
>>
>> Date: Mon, 26 Jul 2010 12:03:05 -0400
>>
>> From: Jason Berenson jason at pins.net>
>>
>> To: outages-discussion at outages.org
>>
>>
>>
>> Greetings,
>>
>>
>>
>> Has anyone noticed any issues with VZ/VZB and ATT in the NYC area? ?I've
>>
>> got a bunch of DS1's that are down, and a few customers with DS3's that
>>
>> are out as well.
>>
>>
>>
>> - -Jason
>>
>> _______________________________________________
>>
>> Outages-discussion mailing list
>>
>> Outages-discussion at outages.org
>>
>> https://puck.nether.net/mailman/listinfo/outages-discussion
>>
>> -----BEGIN PGP SIGNATURE-----
>>
>> Version: GnuPG v1.4.6 (GNU/Linux)
>>
>> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
>>
>>
>>
>> iD8DBQFMTbL+pbZvCIJx1bcRAlHGAKCM1cWhKLogL2AfyCQRyX538uovYgCfRTuv
>>
>> U5ZsRnUW463MyA/4Y1TUkk4=
>>
>> =VV/L
>>
>> -----END PGP SIGNATURE-----
>>
>> _______________________________________________
>>
>> Outages mailing list
>>
>> Outages at outages.org
>>
>> https://puck.nether.net/mailman/listinfo/outages
>>
>
> _______________________________________________
> Outages mailing list
> Outages at outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
>
> _______________________________________________
> Outages mailing list
> Outages at outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
>

Now I really want to know - a DACS shouldn't have anything that directly leaves the office (DS1s go through HDSL smartjacks, DS3s leave the building on fiber, and obviously anything fiber fed leaves the office on fiber.

The battery plant is filtered, and there's nothing crazier than telco grounding.

If it was a water leak, they wouldn't be working with the vendor to fix it, and they'd own up to that.

I'd be willing to bet this is like the rest of their ILEC network, wherein redundancy seems to just mean 'we don't have to address failures because there's a backup system'.

(I think it's pretty interesting that VZW knew better than to use VZ ILEC's network)

> -----Original Message-----
> From: outages-bounces at outages.org [mailto:outages-bounces at outages.org]
> On Behalf Of Jayson Navitsky
> Sent: Monday, July 26, 2010 2:01 PM
> To: outages at outages.org
> Subject: Re: [outages] [Fwd: [Outages-discussion] NYC T1's]
>
> I'm guessing that this DACS outage is the root of the problem:
>
> http://online.wsj.com/article/SB100014240527487037009045753912602577179
> 20.html
>
> -J
>
> On Mon, Jul 26, 2010 at 1:06 PM, Jason Berenson <jason at pins.net> wrote:
> > Same here.? I just got word that ATT reported a Level 5 outage, but
> no more
> > details then that.
> >
> > -Jason
> >
> > On 7/26/2010 12:52 PM, amelton at gmail.com wrote:
> >
> > Yes, we've had a few T1s down all weekend. They are MCI/MFS local
> loops in
> > Manhattan, riding an AT&T DS3 up to Connecticut. I know that the
> issue has
> > been escalated within Verizon, but I haven't heard an ETR.
> >
> > For what it's worth, we do also have circuits between MCI/MFS in New
> York
> > city and AT&T in Connecticut which appear to be unaffected.
> >
> >
> >
> >
> >
> >
> > On Jul 26, 2010 9:08am, virendra rode <virendra.rode at outages.org>
> wrote:
> >> -----BEGIN PGP SIGNED MESSAGE-----
> >>
> >> Hash: SHA1
> >>
> >>
> >>
> >> - -------- Original Message --------
> >>
> >> Subject: [Outages-discussion] NYC T1's
> >>
> >> Date: Mon, 26 Jul 2010 12:03:05 -0400
> >>
> >> From: Jason Berenson jason at pins.net>
> >>
> >> To: outages-discussion at outages.org
> >>
> >>
> >>
> >> Greetings,
> >>
> >>
> >>
> >> Has anyone noticed any issues with VZ/VZB and ATT in the NYC area?
> ?I've
> >>
> >> got a bunch of DS1's that are down, and a few customers with DS3's
> that
> >>
> >> are out as well.
> >>
> >>
> >>
> >> - -Jason
> >>
> >> _______________________________________________
> >>
> >> Outages-discussion mailing list
> >>
> >> Outages-discussion at outages.org
> >>
> >> https://puck.nether.net/mailman/listinfo/outages-discussion
> >>
> >> -----BEGIN PGP SIGNATURE-----
> >>
> >> Version: GnuPG v1.4.6 (GNU/Linux)
> >>
> >> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
> >>
> >>
> >>
> >> iD8DBQFMTbL+pbZvCIJx1bcRAlHGAKCM1cWhKLogL2AfyCQRyX538uovYgCfRTuv
> >>
> >> U5ZsRnUW463MyA/4Y1TUkk4=
> >>
> >> =VV/L
> >>
> >> -----END PGP SIGNATURE-----
> >>
> >> _______________________________________________
> >>
> >> Outages mailing list
> >>
> >> Outages at outages.org
> >>
> >> https://puck.nether.net/mailman/listinfo/outages
> >>
> >
> > _______________________________________________
> > Outages mailing list
> > Outages at outages.org
> > https://puck.nether.net/mailman/listinfo/outages
> >
> >
> > _______________________________________________
> > Outages mailing list
> > Outages at outages.org
> > https://puck.nether.net/mailman/listinfo/outages
> >
> >
>
> _______________________________________________
> Outages mailing list
> Outages at outages.org
> https://puck.nether.net/mailman/listinfo/outages

More here:
http://www.totaltele.com/view.aspx?C=0&ID=457349
http://www.fiercetelecom.com/story/thunderstorms-cause-domino-outage-verizon
-t-mobility-manhattan/2010-07-26?utm_medium=nl&utm_source=internal

Frank

-----Original Message-----
From: outages-bounces@outages.org [mailto:outages-bounces@outages.org] On
Behalf Of Jayson Navitsky
Sent: Monday, July 26, 2010 1:01 PM
To: outages at outages.org
Subject: Re: [outages] [Fwd: [Outages-discussion] NYC T1's]

I'm guessing that this DACS outage is the root of the problem:

http://online.wsj.com/article/SB10001424052748703700904575391260257717920.ht
ml

-J

On Mon, Jul 26, 2010 at 1:06 PM, Jason Berenson <jason at pins.net> wrote:
> Same here.? I just got word that ATT reported a Level 5 outage, but no
more
> details then that.
>
> -Jason
>
> On 7/26/2010 12:52 PM, amelton at gmail.com wrote:
>
> Yes, we've had a few T1s down all weekend. They are MCI/MFS local loops in
> Manhattan, riding an AT&T DS3 up to Connecticut. I know that the issue has
> been escalated within Verizon, but I haven't heard an ETR.
>
> For what it's worth, we do also have circuits between MCI/MFS in New York
> city and AT&T in Connecticut which appear to be unaffected.
>
>
>
>
>
>
> On Jul 26, 2010 9:08am, virendra rode <virendra.rode at outages.org> wrote:
>> -----BEGIN PGP SIGNED MESSAGE-----
>>
>> Hash: SHA1
>>
>>
>>
>> - -------- Original Message --------
>>
>> Subject: [Outages-discussion] NYC T1's
>>
>> Date: Mon, 26 Jul 2010 12:03:05 -0400
>>
>> From: Jason Berenson jason at pins.net>
>>
>> To: outages-discussion at outages.org
>>
>>
>>
>> Greetings,
>>
>>
>>
>> Has anyone noticed any issues with VZ/VZB and ATT in the NYC area? ?I've
>>
>> got a bunch of DS1's that are down, and a few customers with DS3's that
>>
>> are out as well.
>>
>>
>>
>> - -Jason
>>
>> _______________________________________________
>>
>> Outages-discussion mailing list
>>
>> Outages-discussion at outages.org
>>
>> https://puck.nether.net/mailman/listinfo/outages-discussion
>>
>> -----BEGIN PGP SIGNATURE-----
>>
>> Version: GnuPG v1.4.6 (GNU/Linux)
>>
>> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
>>
>>
>>
>> iD8DBQFMTbL+pbZvCIJx1bcRAlHGAKCM1cWhKLogL2AfyCQRyX538uovYgCfRTuv
>>
>> U5ZsRnUW463MyA/4Y1TUkk4=
>>
>> =VV/L
>>
>> -----END PGP SIGNATURE-----
>>
>> _______________________________________________
>>
>> Outages mailing list
>>
>> Outages at outages.org
>>
>> https://puck.nether.net/mailman/listinfo/outages
>>
>
> _______________________________________________
> Outages mailing list
> Outages at outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
>
> _______________________________________________
> Outages mailing list
> Outages at outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
>

_______________________________________________
Outages mailing list
Outages at outages.org
https://puck.nether.net/mailman/listinfo/outages

This DACS outage is going on 5 days now. Verizon seems to have contracted
BP to coordinate the repairs in New York.

On Jul 27, 2010 7:28 AM, "Network Operations" <noc at clearrate.com> wrote:

Now I really want to know - a DACS shouldn't have anything that directly
leaves the office (DS1s go through HDSL smartjacks, DS3s leave the building
on fiber, and obviously anything fiber fed leaves the office on fiber.

The battery plant is filtered, and there's nothing crazier than telco
grounding.

If it was a water leak, they wouldn't be working with the vendor to fix it,
and they'd own up to that.

I'd be willing to bet this is like the rest of their ILEC network, wherein
redundancy seems to just mean 'we don't have to address failures because
there's a backup system'.

(I think it's pretty interesting that VZW knew better than to use VZ ILEC's
network)


> -----Original Message-----
> From: outages-bounces at outages.org [mailto:outages-bounces at outages.or...
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://puck.nether.net/pipermail/outages/attachments/20100727/9c7ab303/attachment.html>