Advanced
Mailing List Archive

Mailing List Archive

  1. Home >
  2. nsp>
  3. foundry
Router Becomes Unresponsive
chris.obrien.1021 at gmail
Mar 10, 2015, 8:30 AM
Post #1 of 6 (2425 views)
Permalink
Hi,

I was looking for some feedback on a strange issue. We are performing a
router upgrade. On the new gear, when certain BGP peers are established,
the router becomes unresponsive via telnet and the network encounters heavy
packet loss/latency. CPU shows idle and the log just shows interfaces
flapping. Serial access is OK. When you turn these BGP peers down, the
issue goes away. When you turn them back up, the issue returns. It is very
reproducible.

Configs are the same.

Here is our current setup--

SL M1: NI-MLX-32_MR Management Module Active (Serial #:, Part #:
35639-300C):
Boot : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:30 labeled as xmprm05300
(517880 bytes) from boot flash
Monitor : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:04:52 labeled as xmb05300
(524496 bytes) from code flash
IronWare : Version 5.3.0aT163 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:27:24 labeled as xmr05300a
(8063716 bytes) from Primary
Board ID : 00 MBRIDGE32 Revision : 35
916 MHz Power PC processor 7447A (version 8003/0101) 166 MHz bus
512 KB Boot Flash (AM29LV040B), 32 MB Code Flash (MT28F128J3)
2048 MB DRAM INSTALLED
2048 MB DRAM ADDRESSABLE

And, we are migrating to--

SL M1: BR-MLX-MR2-X Management Module Active (Serial #: , Part #:
60-1002375-06):
Boot : Version 5.6.0T165 Copyright (c) 1996-2013 Brocade Communications
Systems, Inc.
Compiled on Sep 20 2013 at 16:42:38 labeled as xmprm05600
(516258 bytes) from boot flash
Monitor : Version 5.6.0T165 Copyright (c) 1996-2013 Brocade Communications
Systems, Inc.
Compiled on Sep 20 2013 at 16:41:56 labeled as xmb05600
(534157 bytes) from code flash
IronWare : Version 5.6.0dT163 Copyright (c) 1996-2013 Brocade
Communications Systems, Inc.
Compiled on Jul 24 2014 at 22:51:20 labeled as xmr05600d
(9442445 bytes) from Primary
Board ID : 00 MBRIDGE Revision : 37
1666 MHz Power PC processor 7448 (version 8004/0202) 166 MHz bus
512 KB Boot Flash (MX29LV040C), 128 MB Code Flash (MT28F256J3)
4096 MB DRAM INSTALLED
4096 MB DRAM ADDRESSABLE
Re: Router Becomes Unresponsive [ In reply to ]
tmasuda at vpls
Mar 10, 2015, 1:25 PM
Post #2 of 6 (2412 views)
Permalink
What's the bgp config look like?
Your modules updated properly as well? How about showing us the whole 'show version' with the modules.

----- Original Message -----
From: "Chris O'Brien" <chris.obrien.1021@gmail.com>
To: foundry-nsp@puck.nether.net
Sent: Tuesday, March 10, 2015 8:30:55 AM
Subject: [f-nsp] Router Becomes Unresponsive

Hi,

I was looking for some feedback on a strange issue. We are performing a router upgrade. On the new gear, when certain BGP peers are established, the router becomes unresponsive via telnet and the network encounters heavy packet loss/latency. CPU shows idle and the log just shows interfaces flapping. Serial access is OK. When you turn these BGP peers down, the issue goes away. When you turn them back up, the issue returns. It is very reproducible.

Configs are the same.

Here is our current setup--

SL M1: NI-MLX-32_MR Management Module Active (Serial #:, Part #: 35639-300C):
Boot : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade Communications Systems, Inc.
Compiled on Nov 16 2011 at 10:05:30 labeled as xmprm05300
(517880 bytes) from boot flash
Monitor : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade Communications Systems, Inc.
Compiled on Nov 16 2011 at 10:04:52 labeled as xmb05300
(524496 bytes) from code flash
IronWare : Version 5.3.0aT163 Copyright (c) 1996-2009 Brocade Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:27:24 labeled as xmr05300a
(8063716 bytes) from Primary
Board ID : 00 MBRIDGE32 Revision : 35
916 MHz Power PC processor 7447A (version 8003/0101) 166 MHz bus
512 KB Boot Flash (AM29LV040B), 32 MB Code Flash (MT28F128J3)
2048 MB DRAM INSTALLED
2048 MB DRAM ADDRESSABLE

And, we are migrating to--

SL M1: BR-MLX-MR2-X Management Module Active (Serial #: , Part #: 60-1002375-06):
Boot : Version 5.6.0T165 Copyright (c) 1996-2013 Brocade Communications Systems, Inc.
Compiled on Sep 20 2013 at 16:42:38 labeled as xmprm05600
(516258 bytes) from boot flash
Monitor : Version 5.6.0T165 Copyright (c) 1996-2013 Brocade Communications Systems, Inc.
Compiled on Sep 20 2013 at 16:41:56 labeled as xmb05600
(534157 bytes) from code flash
IronWare : Version 5.6.0dT163 Copyright (c) 1996-2013 Brocade Communications Systems, Inc.
Compiled on Jul 24 2014 at 22:51:20 labeled as xmr05600d
(9442445 bytes) from Primary
Board ID : 00 MBRIDGE Revision : 37
1666 MHz Power PC processor 7448 (version 8004/0202) 166 MHz bus
512 KB Boot Flash (MX29LV040C), 128 MB Code Flash (MT28F256J3)
4096 MB DRAM INSTALLED
4096 MB DRAM ADDRESSABLE


_______________________________________________
foundry-nsp mailing list
foundry-nsp@puck.nether.net
http://puck.nether.net/mailman/listinfo/foundry-nsp
_______________________________________________
foundry-nsp mailing list
foundry-nsp@puck.nether.net
http://puck.nether.net/mailman/listinfo/foundry-nsp
Re: Router Becomes Unresponsive [ In reply to ]
chris.obrien.1021 at gmail
Mar 11, 2015, 12:58 PM
Post #3 of 6 (2411 views)
Permalink
Jake,

Comments inline. Thanks in advance for your help.

"1) When the issue is occurring, what are you seeing in 'show tasks' and
'show cpu lp'?"

CPU was showing 100% idle.

1A) Is the BGP task what is taking up your MP CPU in 'show tasks'?

BGP was not accounting for any CPU.

1B) Is the line card where the provider circuit for which you are turning
up BGP showing high load? In my experience, anywhere about 45 or 50 will
cause issues.

All the line cards were showing low utilization.

2) Do you have enough space in your FIB to account for all of the 'best'
routes that are being installed? I think the MLX has a limit of 512,000 FIB
entries. If you're trying to install more routes then that, perhaps what
you are seeing is the result of the popping out of the old entities -- I've
seen similar performance degradation under this circumstance.

We are essentially upgrading from the MLX32 to the MLXE8 for this reason.
The new router (MLXE8) supports 1M routes. The current router (MLX32)
supports 512K, but we're not encountering this issue.

I should point out that we're using the MLXE8 in a stick configuration. The
Layer 3 config moves over to the MLXE8 and the MLX32 remains online with
Layer 2 config only.


On Tue, Mar 10, 2015 at 12:05 PM, Jake Mertel <jake@nobistech.net> wrote:

> Couple of thoughts off the top of my head:
>
> 1) When the issue is occurring, what are you seeing in 'show tasks' and
> 'show cpu lp'?
> 1A) Is the BGP task what is taking up your MP CPU in 'show tasks'?
> 1B) Is the line card where the provider circuit for which you are turning
> up BGP showing high load? In my experience, anywhere about 45 or 50 will
> cause issues.
>
> 2) Do you have enough space in your FIB to account for all of the 'best'
> routes that are being installed? I think the MLX has a limit of 512,000 FIB
> entries. If you're trying to install more routes then that, perhaps what
> you are seeing is the result of the popping out of the old entities -- I've
> seen similar performance degradation under this circumstance.
>
>
>
>
> --
> Regards,
>
> Jake Mertel
> Nobis Technology Group, LLC
>
>
>
>
> *Web: *http://www.nobistech.net
> *Phone: *1-480-212-1710
> *Mail:* 5350 East High Street, Suite 300, Phoenix, AZ 85054
>
>
>
> On Tue, Mar 10, 2015 at 8:30 AM, Chris O'Brien <
> chris.obrien.1021@gmail.com> wrote:
>
>> Hi,
>>
>> I was looking for some feedback on a strange issue. We are performing a
>> router upgrade. On the new gear, when certain BGP peers are established,
>> the router becomes unresponsive via telnet and the network encounters heavy
>> packet loss/latency. CPU shows idle and the log just shows interfaces
>> flapping. Serial access is OK. When you turn these BGP peers down, the
>> issue goes away. When you turn them back up, the issue returns. It is very
>> reproducible.
>>
>> Configs are the same.
>>
>> Here is our current setup--
>>
>> SL M1: NI-MLX-32_MR Management Module Active (Serial #:, Part #:
>> 35639-300C):
>> Boot : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade
>> Communications Systems, Inc.
>> Compiled on Nov 16 2011 at 10:05:30 labeled as xmprm05300
>> (517880 bytes) from boot flash
>> Monitor : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade
>> Communications Systems, Inc.
>> Compiled on Nov 16 2011 at 10:04:52 labeled as xmb05300
>> (524496 bytes) from code flash
>> IronWare : Version 5.3.0aT163 Copyright (c) 1996-2009 Brocade
>> Communications Systems, Inc.
>> Compiled on Apr 6 2012 at 10:27:24 labeled as xmr05300a
>> (8063716 bytes) from Primary
>> Board ID : 00 MBRIDGE32 Revision : 35
>> 916 MHz Power PC processor 7447A (version 8003/0101) 166 MHz bus
>> 512 KB Boot Flash (AM29LV040B), 32 MB Code Flash (MT28F128J3)
>> 2048 MB DRAM INSTALLED
>> 2048 MB DRAM ADDRESSABLE
>>
>> And, we are migrating to--
>>
>> SL M1: BR-MLX-MR2-X Management Module Active (Serial #: , Part #:
>> 60-1002375-06):
>> Boot : Version 5.6.0T165 Copyright (c) 1996-2013 Brocade
>> Communications Systems, Inc.
>> Compiled on Sep 20 2013 at 16:42:38 labeled as xmprm05600
>> (516258 bytes) from boot flash
>> Monitor : Version 5.6.0T165 Copyright (c) 1996-2013 Brocade
>> Communications Systems, Inc.
>> Compiled on Sep 20 2013 at 16:41:56 labeled as xmb05600
>> (534157 bytes) from code flash
>> IronWare : Version 5.6.0dT163 Copyright (c) 1996-2013 Brocade
>> Communications Systems, Inc.
>> Compiled on Jul 24 2014 at 22:51:20 labeled as xmr05600d
>> (9442445 bytes) from Primary
>> Board ID : 00 MBRIDGE Revision : 37
>> 1666 MHz Power PC processor 7448 (version 8004/0202) 166 MHz bus
>> 512 KB Boot Flash (MX29LV040C), 128 MB Code Flash (MT28F256J3)
>> 4096 MB DRAM INSTALLED
>> 4096 MB DRAM ADDRESSABLE
>>
>>
>> _______________________________________________
>> foundry-nsp mailing list
>> foundry-nsp@puck.nether.net
>> http://puck.nether.net/mailman/listinfo/foundry-nsp
>>
>
>
Re: Router Becomes Unresponsive [ In reply to ]
chris.obrien.1021 at gmail
Mar 11, 2015, 1:06 PM
Post #4 of 6 (2410 views)
Permalink
Hi, Takahiro:

BGP config is pretty straightforward. Here you go--

router bgp
local-as xxxxx
always-compare-med
fast-external-fallover
neighbor xx.xxx.xx.xx remote-as xxx
neighbor xx.xxx.xx.xx soft-reconfiguration inbound

address-family ipv4 unicast
graceful-restart
maximum-paths 8
maximum-paths ibgp 8
maximum-paths ebgp 8
network xxx.xxx.xxx.x/22
network xxx.xxx.xxx.x/21
neighbor xx.xxx.xx.xx prefix-list NETBLOCK out
neighbor xx.xxx.xx.xx route-map in ROUTES-IN
exit-address-family

address-family ipv4 multicast
exit-address-family

address-family ipv6 unicast
exit-address-family

address-family ipv6 multicast
exit-address-family

address-family vpnv4 unicast
exit-address-family

address-family l2vpn vpls
exit-address-family

ip prefix-list NETBLOCK seq 25 permit xxx.xxx.xxx.x/22
ip prefix-list NETBLOCK seq 30 permit xxx.xxx.xxx.x/21

route-map ROUTES-IN permit 1000
set metric 201
set origin igp
set local-preference 100

Here's the full show version on the MLX32 (old gear):

System Mode: MLX
Chassis: NetIron 32-slot (Serial #:, Part #: 35632-100A)
NI-X-32-SF Switch Fabric Module 1 (Serial #:, Part #: 35612-200A)
SBRIDGE Version: 6, CPLD Version: 2
FE 1: Type fe200, Version 2
FE 2: Type fe200, Version 2
FE 3: Type fe200, Version 2
Switch Fabric Module 1 Up Time is 6 days 8 hours 45 minutes 47 seconds
NI-X-32-SF Switch Fabric Module 2 (Serial #:, Part #: 35612-200A)
SBRIDGE Version: 6, CPLD Version: 2
FE 1: Type fe200, Version 2
FE 2: Type fe200, Version 2
FE 3: Type fe200, Version 2
Switch Fabric Module 2 Up Time is 6 days 8 hours 45 minutes 47 seconds
NI-X-32-SF Switch Fabric Module 3 (Serial #:, Part #: 35612-200B)
SBRIDGE Version: 6, CPLD Version: 2
FE 1: Type fe200, Version 2
FE 2: Type fe200, Version 2
FE 3: Type fe200, Version 2
Switch Fabric Module 3 Up Time is 6 days 8 hours 45 minutes 47 seconds
NI-X-32-SF Switch Fabric Module 4 (Serial #:, Part #: 35612-200A)
SBRIDGE Version: 6, CPLD Version: 2
FE 1: Type fe200, Version 2
FE 2: Type fe200, Version 2
FE 3: Type fe200, Version 2
Switch Fabric Module 4 Up Time is 6 days 8 hours 45 minutes 47 seconds
NI-X-32-SF Switch Fabric Module 5 (Serial #:, Part #: 35612-200B)
SBRIDGE Version: 6, CPLD Version: 2
FE 1: Type fe200, Version 2
FE 2: Type fe200, Version 2
FE 3: Type fe200, Version 2
Switch Fabric Module 5 Up Time is 6 days 8 hours 45 minutes 47 seconds
NI-X-32-SF Switch Fabric Module 6 (Serial #:, Part #: 35612-200A)
SBRIDGE Version: 6, CPLD Version: 2
FE 1: Type fe200, Version 2
FE 2: Type fe200, Version 2
FE 3: Type fe200, Version 2
Switch Fabric Module 6 Up Time is 6 days 8 hours 45 minutes 47 seconds
NI-X-32-SF Switch Fabric Module 7 (Serial #:, Part #: 35612-200A)
SBRIDGE Version: 6, CPLD Version: 2
FE 1: Type fe200, Version 2
FE 2: Type fe200, Version 2
FE 3: Type fe200, Version 2
Switch Fabric Module 7 Up Time is 6 days 8 hours 45 minutes 47 seconds
NI-X-32-SF Switch Fabric Module 8 (Serial #:, Part #: 35612-200B)
SBRIDGE Version: 6, CPLD Version: 2
FE 1: Type fe200, Version 2
FE 2: Type fe200, Version 2
FE 3: Type fe200, Version 2
Switch Fabric Module 8 Up Time is 6 days 8 hours 45 minutes 47 seconds
==========================================================================
SL M1: NI-MLX-32_MR Management Module Active (Serial #:, Part #:
35639-300C):
Boot : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:30 labeled as xmprm05300
(517880 bytes) from boot flash
Monitor : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:04:52 labeled as xmb05300
(524496 bytes) from code flash
IronWare : Version 5.3.0aT163 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:27:24 labeled as xmr05300a
(8063716 bytes) from Primary
Board ID : 00 MBRIDGE32 Revision : 35
916 MHz Power PC processor 7447A (version 8003/0101) 166 MHz bus
512 KB Boot Flash (AM29LV040B), 32 MB Code Flash (MT28F128J3)
2048 MB DRAM INSTALLED
2048 MB DRAM ADDRESSABLE
Active Management uptime is 6 days 8 hours 45 minutes 47 seconds
==========================================================================
SL M2: NI-MLX-32_MR Management Module Standby (Serial #:, Part #:
35639-300C):
Boot : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:30 labeled as xmprm05300
(517880 bytes) from boot flash
Monitor : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:04:52 labeled as xmb05300
(524496 bytes) from code flash
IronWare : Version 5.3.0aT163 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:27:24 labeled as xmr05300a
(8063716 bytes) from Primary
Board ID : 00 MBRIDGE32 Revision : 35
916 MHz Power PC processor 7447A (version 8003/0101) 166 MHz bus
512 KB Boot Flash (AM29LV040B), 32 MB Code Flash (MT28F128J3)
2048 MB DRAM INSTALLED
2048 MB DRAM ADDRESSABLE
Standby Management uptime is 6 days 8 hours 43 minutes 48 seconds
==========================================================================
SL 1: NI-MLX-10Gx4 4-port 10GbE Module (Serial #: , Part #: 35600-200A)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 1 uptime is 6 days 8 hours 44 minutes 31 seconds
==========================================================================
SL 2: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-104B)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 2 uptime is 6 days 8 hours 44 minutes 31 seconds
==========================================================================
SL 3: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-202A)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 3 uptime is 2 hours 21 minutes 54 seconds
==========================================================================
SL 4: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-202A)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 4 uptime is 6 days 8 hours 44 minutes 32 seconds
==========================================================================
SL 5: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-202D)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 5 uptime is 6 days 8 hours 44 minutes 32 seconds
==========================================================================
SL 6: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-202C)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 6 uptime is 6 days 8 hours 44 minutes 33 seconds
==========================================================================
SL 7: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-202A)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 7 uptime is 6 days 8 hours 44 minutes 32 seconds
==========================================================================
SL 13: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-200C)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 13 uptime is 6 days 8 hours 44 minutes 33 seconds
==========================================================================
SL 14: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-200C)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 14 uptime is 6 days 8 hours 44 minutes 33 seconds
==========================================================================
SL 15: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-202A)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 15 uptime is 6 days 8 hours 44 minutes 33 seconds
==========================================================================
SL 16: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-202A)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 16 uptime is 6 days 8 hours 44 minutes 33 seconds
==========================================================================
SL 18: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-201B)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 18 uptime is 6 days 8 hours 44 minutes 34 seconds
==========================================================================
SL 20: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-200A)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 20 uptime is 6 days 8 hours 44 minutes 33 seconds
==========================================================================
SL 29: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-202B)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 29 uptime is 6 days 8 hours 44 minutes 34 seconds
==========================================================================
SL 30: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-200C)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 30 uptime is 6 days 8 hours 44 minutes 34 seconds
==========================================================================
SL 31: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-201B)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 31 uptime is 6 days 8 hours 44 minutes 34 seconds
==========================================================================
SL 32: NI-MLX-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35600-202A)
Boot : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:05:54 labeled as xmlprm05300
(509446 bytes) from boot flash
Monitor : Version 5.3.0T175 Copyright (c) 1996-2009 Brocade Communications
Systems, Inc.
Compiled on Nov 16 2011 at 10:06:18 labeled as xmlb05300
(524288 bytes) from code flash
IronWare : Version 5.3.0aT177 Copyright (c) 1996-2009 Brocade
Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:33:32 labeled as xmlp05300a
(6671380 bytes) from Primary
FPGA versions:
Valid PBIF Version = 3.27, Build Time = 10/18/2011 17:38:00

Valid XPP Version = 7.05, Build Time = 12/19/2011 19:21:00

Valid XGMAC Version = 0.15, Build Time = 10/14/2010 16:31:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
512 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
PPCR0: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
PPCR1: 768K entries CAM, 8192K PRAM, 2048K AGE RAM
LP Slot 32 uptime is 6 days 8 hours 44 minutes 35 seconds
==========================================================================
All show version done

Here's the full show version on the MLXE8 (new gear):

System Mode: XMR
Chassis: MLXe 8-slot (Serial #:, Part #: 40-1000362-03)
NI-X-HSF Switch Fabric Module 2 (Serial #:, Part #: 60-1001588-12)
FE 1: Type fe600, Version 1
FE 3: Type fe600, Version 1
Switch Fabric Module 2 Up Time is 23 hours 40 minutes 27 seconds
NI-X-HSF Switch Fabric Module 3 (Serial #:, Part #: 60-1001588-12)
FE 1: Type fe600, Version 1
FE 3: Type fe600, Version 1
Switch Fabric Module 3 Up Time is 23 hours 40 minutes 27 seconds
==========================================================================
SL M1: BR-MLX-MR2-X Management Module Active (Serial #:, Part #:
60-1002375-06):
Boot : Version 5.6.0T165 Copyright (c) 1996-2013 Brocade Communications
Systems, Inc.
Compiled on Sep 20 2013 at 16:42:38 labeled as xmprm05600
(516258 bytes) from boot flash
Monitor : Version 5.6.0T165 Copyright (c) 1996-2013 Brocade Communications
Systems, Inc.
Compiled on Sep 20 2013 at 16:41:56 labeled as xmb05600
(534157 bytes) from code flash
IronWare : Version 5.6.0fT163 Copyright (c) 1996-2013 Brocade
Communications Systems, Inc.
Compiled on Feb 2 2015 at 09:48:14 labeled as xmr05600f
(9453554 bytes) from Primary
Board ID : 00 MBRIDGE Revision : 37
1666 MHz Power PC processor 7448 (version 8004/0202) 166 MHz bus
512 KB Boot Flash (MX29LV040C), 128 MB Code Flash (MT28F256J3)
4096 MB DRAM INSTALLED
4096 MB DRAM ADDRESSABLE
Active Management uptime is 23 hours 40 minutes 27 seconds
==========================================================================
SL 1: NI-XMR-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35546-305M)
Boot : Version 5.6.0T175 Copyright (c) 1996-2013 Brocade Communications
Systems, Inc.
Compiled on Sep 20 2013 at 16:43:00 labeled as xmlprm05600
(423373 bytes) from boot flash
Monitor : Version 5.6.0T175 Copyright (c) 1996-2013 Brocade Communications
Systems, Inc.
Compiled on Sep 20 2013 at 16:43:26 labeled as xmlb05600
(539767 bytes) from code flash
IronWare : Version 5.6.0fT177 Copyright (c) 1996-2013 Brocade
Communications Systems, Inc.
Compiled on Feb 2 2015 at 09:55:38 labeled as xmlp05600f
(7500741 bytes) from Primary
FPGA versions:
Valid PBIF Version = 4.02, Build Time = 8/26/2013 14:30:00

Valid XPP Version = 1.01, Build Time = 9/6/2013 14:17:00

Valid XGMAC Version = 0.17, Build Time = 1/7/2015 10:29:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (MX29LV040C), 16 MB Code Flash (MT28F640J3)
1024 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
LP Slot 1 uptime is 23 hours 39 minutes 41 seconds
==========================================================================
SL 2: NI-XMR-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35546-303C)
Boot : Version 5.6.0T175 Copyright (c) 1996-2013 Brocade Communications
Systems, Inc.
Compiled on Sep 20 2013 at 16:43:00 labeled as xmlprm05600
(423373 bytes) from boot flash
Monitor : Version 5.6.0T175 Copyright (c) 1996-2013 Brocade Communications
Systems, Inc.
Compiled on Sep 20 2013 at 16:43:26 labeled as xmlb05600
(539767 bytes) from code flash
IronWare : Version 5.6.0fT177 Copyright (c) 1996-2013 Brocade
Communications Systems, Inc.
Compiled on Feb 2 2015 at 09:55:38 labeled as xmlp05600f
(7500741 bytes) from Primary
FPGA versions:
Valid PBIF Version = 4.02, Build Time = 8/26/2013 14:30:00

Valid XPP Version = 1.01, Build Time = 9/6/2013 14:17:00

Valid XGMAC Version = 0.17, Build Time = 1/7/2015 10:29:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
1024 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
LP Slot 2 uptime is 23 hours 39 minutes 44 seconds
==========================================================================
SL 3: NI-XMR-10Gx4 4-port 10GbE Module (Serial #:, Part #: 35546-303C)
Boot : Version 5.6.0T175 Copyright (c) 1996-2013 Brocade Communications
Systems, Inc.
Compiled on Sep 20 2013 at 16:43:00 labeled as xmlprm05600
(423373 bytes) from boot flash
Monitor : Version 5.6.0T175 Copyright (c) 1996-2013 Brocade Communications
Systems, Inc.
Compiled on Sep 20 2013 at 16:43:26 labeled as xmlb05600
(539767 bytes) from code flash
IronWare : Version 5.6.0fT177 Copyright (c) 1996-2013 Brocade
Communications Systems, Inc.
Compiled on Feb 2 2015 at 09:55:38 labeled as xmlp05600f
(7500741 bytes) from Primary
FPGA versions:
Valid PBIF Version = 4.02, Build Time = 8/26/2013 14:30:00

Valid XPP Version = 1.01, Build Time = 9/6/2013 14:17:00

Valid XGMAC Version = 0.17, Build Time = 1/7/2015 10:29:00

X10G2MAC 0
X10G2MAC 1
666 MHz MPC 8541 (version 8020/0020) 333 MHz bus
512 KB Boot Flash (AM29LV040B), 16 MB Code Flash (MT28F640J3)
1024 MB DRAM, 8 KB SRAM, 0 Bytes BRAM
LP Slot 3 uptime is 23 hours 39 minutes 56 seconds
==========================================================================


On Tue, Mar 10, 2015 at 3:25 PM, Takahiro Masuda <tmasuda@vpls.net> wrote:

> What's the bgp config look like?
> Your modules updated properly as well? How about showing us the whole
> 'show version' with the modules.
>
> ----- Original Message -----
> From: "Chris O'Brien" <chris.obrien.1021@gmail.com>
> To: foundry-nsp@puck.nether.net
> Sent: Tuesday, March 10, 2015 8:30:55 AM
> Subject: [f-nsp] Router Becomes Unresponsive
>
> Hi,
>
> I was looking for some feedback on a strange issue. We are performing a
> router upgrade. On the new gear, when certain BGP peers are established,
> the router becomes unresponsive via telnet and the network encounters heavy
> packet loss/latency. CPU shows idle and the log just shows interfaces
> flapping. Serial access is OK. When you turn these BGP peers down, the
> issue goes away. When you turn them back up, the issue returns. It is very
> reproducible.
>
> Configs are the same.
>
> Here is our current setup--
>
> SL M1: NI-MLX-32_MR Management Module Active (Serial #:, Part #:
> 35639-300C):
> Boot : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade Communications
> Systems, Inc.
> Compiled on Nov 16 2011 at 10:05:30 labeled as xmprm05300
> (517880 bytes) from boot flash
> Monitor : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade Communications
> Systems, Inc.
> Compiled on Nov 16 2011 at 10:04:52 labeled as xmb05300
> (524496 bytes) from code flash
> IronWare : Version 5.3.0aT163 Copyright (c) 1996-2009 Brocade
> Communications Systems, Inc.
> Compiled on Apr 6 2012 at 10:27:24 labeled as xmr05300a
> (8063716 bytes) from Primary
> Board ID : 00 MBRIDGE32 Revision : 35
> 916 MHz Power PC processor 7447A (version 8003/0101) 166 MHz bus
> 512 KB Boot Flash (AM29LV040B), 32 MB Code Flash (MT28F128J3)
> 2048 MB DRAM INSTALLED
> 2048 MB DRAM ADDRESSABLE
>
> And, we are migrating to--
>
> SL M1: BR-MLX-MR2-X Management Module Active (Serial #: , Part #:
> 60-1002375-06):
> Boot : Version 5.6.0T165 Copyright (c) 1996-2013 Brocade Communications
> Systems, Inc.
> Compiled on Sep 20 2013 at 16:42:38 labeled as xmprm05600
> (516258 bytes) from boot flash
> Monitor : Version 5.6.0T165 Copyright (c) 1996-2013 Brocade Communications
> Systems, Inc.
> Compiled on Sep 20 2013 at 16:41:56 labeled as xmb05600
> (534157 bytes) from code flash
> IronWare : Version 5.6.0dT163 Copyright (c) 1996-2013 Brocade
> Communications Systems, Inc.
> Compiled on Jul 24 2014 at 22:51:20 labeled as xmr05600d
> (9442445 bytes) from Primary
> Board ID : 00 MBRIDGE Revision : 37
> 1666 MHz Power PC processor 7448 (version 8004/0202) 166 MHz bus
> 512 KB Boot Flash (MX29LV040C), 128 MB Code Flash (MT28F256J3)
> 4096 MB DRAM INSTALLED
> 4096 MB DRAM ADDRESSABLE
>
>
> _______________________________________________
> foundry-nsp mailing list
> foundry-nsp@puck.nether.net
> http://puck.nether.net/mailman/listinfo/foundry-nsp
>
Re: Router Becomes Unresponsive [ In reply to ]
tmasuda at vpls
Mar 11, 2015, 3:42 PM
Post #5 of 6 (2413 views)
Permalink
In a stick configuration make sure 'no route-only' is entered if you are using VLANs w/ VEs. This one used to get me all the time because default is route-only.

Also have your cam-partition profile and system-maxes setup for 1mil routes.



----- Original Message -----
From: "Chris O'Brien" <chris.obrien.1021@gmail.com>
To: "Jake Mertel" <jake@nobistech.net>, foundry-nsp@puck.nether.net
Sent: Wednesday, March 11, 2015 12:58:01 PM
Subject: Re: [f-nsp] Router Becomes Unresponsive

Jake,

Comments inline. Thanks in advance for your help.

"1) When the issue is occurring, what are you seeing in 'show tasks' and 'show cpu lp'?"

CPU was showing 100% idle.

1A) Is the BGP task what is taking up your MP CPU in 'show tasks'?

BGP was not accounting for any CPU.

1B) Is the line card where the provider circuit for which you are turning up BGP showing high load? In my experience, anywhere about 45 or 50 will cause issues.

All the line cards were showing low utilization.

2) Do you have enough space in your FIB to account for all of the 'best' routes that are being installed? I think the MLX has a limit of 512,000 FIB entries. If you're trying to install more routes then that, perhaps what you are seeing is the result of the popping out of the old entities -- I've seen similar performance degradation under this circumstance.

We are essentially upgrading from the MLX32 to the MLXE8 for this reason. The new router (MLXE8) supports 1M routes. The current router (MLX32) supports 512K, but we're not encountering this issue.

I should point out that we're using the MLXE8 in a stick configuration. The Layer 3 config moves over to the MLXE8 and the MLX32 remains online with Layer 2 config only.


On Tue, Mar 10, 2015 at 12:05 PM, Jake Mertel < jake@nobistech.net > wrote:



Couple of thoughts off the top of my head:

1) When the issue is occurring, what are you seeing in 'show tasks' and 'show cpu lp'?
1A) Is the BGP task what is taking up your MP CPU in 'show tasks'?
1B) Is the line card where the provider circuit for which you are turning up BGP showing high load? In my experience, anywhere about 45 or 50 will cause issues.

2) Do you have enough space in your FIB to account for all of the 'best' routes that are being installed? I think the MLX has a limit of 512,000 FIB entries. If you're trying to install more routes then that, perhaps what you are seeing is the result of the popping out of the old entities -- I've seen similar performance degradation under this circumstance.




--
Regards,

Jake Mertel
Nobis Technology Group, LLC




Web: http://www.nobistech.net
Phone: 1-480-212-1710
Mail: 5350 East High Street, Suite 300, Phoenix, AZ 85054



On Tue, Mar 10, 2015 at 8:30 AM, Chris O'Brien < chris.obrien.1021@gmail.com > wrote:



Hi,

I was looking for some feedback on a strange issue. We are performing a router upgrade. On the new gear, when certain BGP peers are established, the router becomes unresponsive via telnet and the network encounters heavy packet loss/latency. CPU shows idle and the log just shows interfaces flapping. Serial access is OK. When you turn these BGP peers down, the issue goes away. When you turn them back up, the issue returns. It is very reproducible.

Configs are the same.

Here is our current setup--

SL M1: NI-MLX-32_MR Management Module Active (Serial #:, Part #: 35639-300C):
Boot : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade Communications Systems, Inc.
Compiled on Nov 16 2011 at 10:05:30 labeled as xmprm05300
(517880 bytes) from boot flash
Monitor : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade Communications Systems, Inc.
Compiled on Nov 16 2011 at 10:04:52 labeled as xmb05300
(524496 bytes) from code flash
IronWare : Version 5.3.0aT163 Copyright (c) 1996-2009 Brocade Communications Systems, Inc.
Compiled on Apr 6 2012 at 10:27:24 labeled as xmr05300a
(8063716 bytes) from Primary
Board ID : 00 MBRIDGE32 Revision : 35
916 MHz Power PC processor 7447A (version 8003/0101) 166 MHz bus
512 KB Boot Flash (AM29LV040B), 32 MB Code Flash (MT28F128J3)
2048 MB DRAM INSTALLED
2048 MB DRAM ADDRESSABLE

And, we are migrating to--

SL M1: BR-MLX-MR2-X Management Module Active (Serial #: , Part #: 60-1002375-06):
Boot : Version 5.6.0T165 Copyright (c) 1996-2013 Brocade Communications Systems, Inc.
Compiled on Sep 20 2013 at 16:42:38 labeled as xmprm05600
(516258 bytes) from boot flash
Monitor : Version 5.6.0T165 Copyright (c) 1996-2013 Brocade Communications Systems, Inc.
Compiled on Sep 20 2013 at 16:41:56 labeled as xmb05600
(534157 bytes) from code flash
IronWare : Version 5.6.0dT163 Copyright (c) 1996-2013 Brocade Communications Systems, Inc.
Compiled on Jul 24 2014 at 22:51:20 labeled as xmr05600d
(9442445 bytes) from Primary
Board ID : 00 MBRIDGE Revision : 37
1666 MHz Power PC processor 7448 (version 8004/0202) 166 MHz bus
512 KB Boot Flash (MX29LV040C), 128 MB Code Flash (MT28F256J3)
4096 MB DRAM INSTALLED
4096 MB DRAM ADDRESSABLE


_______________________________________________
foundry-nsp mailing list
foundry-nsp@puck.nether.net
http://puck.nether.net/mailman/listinfo/foundry-nsp



_______________________________________________
foundry-nsp mailing list
foundry-nsp@puck.nether.net
http://puck.nether.net/mailman/listinfo/foundry-nsp
_______________________________________________
foundry-nsp mailing list
foundry-nsp@puck.nether.net
http://puck.nether.net/mailman/listinfo/foundry-nsp
Re: Router Becomes Unresponsive [ In reply to ]
chris.obrien.1021 at gmail
Mar 29, 2015, 1:53 PM
Post #6 of 6 (2354 views)
Permalink
'no ip icmp redirects' corrected this issue. The new router was in a stick
configuration.

On Tue, Mar 10, 2015 at 10:30 AM, Chris O'Brien <chris.obrien.1021@gmail.com
> wrote:

> Hi,
>
> I was looking for some feedback on a strange issue. We are performing a
> router upgrade. On the new gear, when certain BGP peers are established,
> the router becomes unresponsive via telnet and the network encounters heavy
> packet loss/latency. CPU shows idle and the log just shows interfaces
> flapping. Serial access is OK. When you turn these BGP peers down, the
> issue goes away. When you turn them back up, the issue returns. It is very
> reproducible.
>
> Configs are the same.
>
> Here is our current setup--
>
> SL M1: NI-MLX-32_MR Management Module Active (Serial #:, Part #:
> 35639-300C):
> Boot : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade
> Communications Systems, Inc.
> Compiled on Nov 16 2011 at 10:05:30 labeled as xmprm05300
> (517880 bytes) from boot flash
> Monitor : Version 5.3.0T165 Copyright (c) 1996-2009 Brocade
> Communications Systems, Inc.
> Compiled on Nov 16 2011 at 10:04:52 labeled as xmb05300
> (524496 bytes) from code flash
> IronWare : Version 5.3.0aT163 Copyright (c) 1996-2009 Brocade
> Communications Systems, Inc.
> Compiled on Apr 6 2012 at 10:27:24 labeled as xmr05300a
> (8063716 bytes) from Primary
> Board ID : 00 MBRIDGE32 Revision : 35
> 916 MHz Power PC processor 7447A (version 8003/0101) 166 MHz bus
> 512 KB Boot Flash (AM29LV040B), 32 MB Code Flash (MT28F128J3)
> 2048 MB DRAM INSTALLED
> 2048 MB DRAM ADDRESSABLE
>
> And, we are migrating to--
>
> SL M1: BR-MLX-MR2-X Management Module Active (Serial #: , Part #:
> 60-1002375-06):
> Boot : Version 5.6.0T165 Copyright (c) 1996-2013 Brocade
> Communications Systems, Inc.
> Compiled on Sep 20 2013 at 16:42:38 labeled as xmprm05600
> (516258 bytes) from boot flash
> Monitor : Version 5.6.0T165 Copyright (c) 1996-2013 Brocade
> Communications Systems, Inc.
> Compiled on Sep 20 2013 at 16:41:56 labeled as xmb05600
> (534157 bytes) from code flash
> IronWare : Version 5.6.0dT163 Copyright (c) 1996-2013 Brocade
> Communications Systems, Inc.
> Compiled on Jul 24 2014 at 22:51:20 labeled as xmr05600d
> (9442445 bytes) from Primary
> Board ID : 00 MBRIDGE Revision : 37
> 1666 MHz Power PC processor 7448 (version 8004/0202) 166 MHz bus
> 512 KB Boot Flash (MX29LV040C), 128 MB Code Flash (MT28F256J3)
> 4096 MB DRAM INSTALLED
> 4096 MB DRAM ADDRESSABLE
>
>

©2024 GT.net. A Gossamer Threads company.
5th Floor, 455 Granville St., Vancouver, BC V6C 1T1, Canada | Legal