Mailing List Archive

x650 CPU Load
hello,

I have 2x X650 connected via classical stack. CPU load between 50 and
60% on slot one looks strange.
Is this normal ?

CPU Utilization Statistics - Monitored every 5 seconds
-------------------------------------------------------------------------------

Card Process 5 10 30 1 5 30 1 Max Total
secs secs secs min mins mins hour User/System
util util util util util util util util CPU Usage
(%) (%) (%) (%) (%) (%) (%) (%) (secs)
-------------------------------------------------------------------------------

Slot-1 System 52.4 51.6 50.4 50.2 48.9 51.7 51.9 99.9 4.27 35691.25
Slot-2 System 6.2 7.0 6.8 6.6 6.7 6.1 6.1 36.3 0.00 0.00

ExtremeXOS version 15.1.3.4 v1513b4-patch1-8

Regards,
Marcin

_______________________________________________
extreme-nsp mailing list
extreme-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/extreme-nsp
Re: x650 CPU Load [ In reply to ]
Hi Marcin,

Could you show the output from the command 'top'

Also press the number 1, to show any additional CPU cores and their load.

It should show which process is so busy.

Regards,
Erik Bais

-----Original Message-----
From: extreme-nsp-bounces@puck.nether.net [mailto:extreme-nsp-bounces@puck.nether.net] On Behalf Of Marcin Kuczera
Sent: dinsdag 26 februari 2013 14:31
To: extreme-nsp@puck.nether.net
Subject: [e-nsp] x650 CPU Load

hello,

I have 2x X650 connected via classical stack. CPU load between 50 and 60% on slot one looks strange.
Is this normal ?

CPU Utilization Statistics - Monitored every 5 seconds
-------------------------------------------------------------------------------

Card Process 5 10 30 1 5 30 1 Max Total
secs secs secs min mins mins hour User/System
util util util util util util util util CPU Usage
(%) (%) (%) (%) (%) (%) (%) (%) (secs)
-------------------------------------------------------------------------------

Slot-1 System 52.4 51.6 50.4 50.2 48.9 51.7 51.9 99.9 4.27 35691.25
Slot-2 System 6.2 7.0 6.8 6.6 6.7 6.1 6.1 36.3 0.00 0.00

ExtremeXOS version 15.1.3.4 v1513b4-patch1-8

Regards,
Marcin

_______________________________________________
extreme-nsp mailing list
extreme-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/extreme-nsp

_______________________________________________
extreme-nsp mailing list
extreme-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/extreme-nsp
Re: x650 CPU Load [ In reply to ]
On 2013-02-26 14:34, Erik Bais wrote:
> Hi Marcin,
>
> Could you show the output from the command 'top'
>
> Also press the number 1, to show any additional CPU cores and their load.
>
> It should show which process is so busy.
Mem: 415392K used, 601052K free, 0K shrd, 70472K buff, 110704K cached
CPU0: 5.2% usr 11.9% sys 0.0% nic 67.5% idle 0.0% io 15.2% irq 0.0% sirq
CPU1: 6.6% usr 28.8% sys 0.0% nic 53.3% idle 0.0% io 0.0% irq 11.2% sirq
Load average: 7.84 8.19 8.10 8/207 4795
PID PPID USER STAT RSS %MEM CPU %CPU COMMAND
1305 2 root SW 0 0.0 1 18.3 [bcmRX]
1477 1 root S 7868 0.7 0 4.3 ./fdb
1255 2 root SW< 0 0.0 0 2.4 [bcmLINK.1]
1457 1 root S < 21964 2.1 0 1.8 ./hal
1253 2 root SW< 0 0.0 0 1.4 [bcmLINK.0]
1517 1 root S 7028 0.6 1 0.9 ./mcmgr
3039 2 root SW< 0 0.0 0 0.9 [bcmCNTR.0]
3040 2 root SW< 0 0.0 0 0.9 [bcmCNTR.1]
1541 1 root S 2824 0.2 1 0.5 ./pim
1110 1 root S 2848 0.2 1 0.3 /exos/bin/epm -t 40 -f
/exos/config/epmrc.AdvEdge -d /exos/config/epmdprc
4795 4794 root R 796 0.0 0 0.3 top -d 3
1701 2 root SWN 0 0.0 0 0.3 [bcmL2XAGE.1]
1292 2 root DW< 0 0.0 1 0.3 [tocpd_tx]
1501 1 root R 4340 0.4 0 0.1 ./eaps
1487 1 root S 3708 0.3 0 0.1 ./elsm
1507 1 root S 3420 0.3 1 0.1 ./rtmgr update
1547 1 root S 3052 0.3 1 0.1 ./acl
1531 1 root S 2652 0.2 1 0.1 ./rip
1536 1 root S 2332 0.2 0 0.1 ./ripng
1700 2 root SW< 0 0.0 1 0.1 [bcmL2X.1]
1698 2 root RW< 0 0.0 0 0.1 [bcmL2X.0]
1256 2 root SW< 0 0.0 0 0.1 [bcmASYNC]
1257 2 root RW< 0 0.0 1 0.1 [bcmRLINK]
1461 1 root S 36856 3.6 0 0.0 ./cliMaster
1582 1 root S 7100 0.6 1 0.0 ./etmon
1475 1 root S 6748 0.6 0 0.0 ./vlan
1610 1 root S 5668 0.5 1 0.0 ./idMgr
1596 1 root S 5648 0.5 1 0.0 ./xmld
1463 1 root S 5084 0.5 0 0.0 ./cfgmgr
1470 1 root S 4956 0.4 0 0.0 ./snmpSubagent
1489 1 root S 4620 0.4 1 0.0 ./edp
Slot-1 SummitStack-GZE.2 #

Regards,
Marcin


>
> Regards,
> Erik Bais
>
> -----Original Message-----
> From: extreme-nsp-bounces@puck.nether.net [mailto:extreme-nsp-bounces@puck.nether.net] On Behalf Of Marcin Kuczera
> Sent: dinsdag 26 februari 2013 14:31
> To: extreme-nsp@puck.nether.net
> Subject: [e-nsp] x650 CPU Load
>
> hello,
>
> I have 2x X650 connected via classical stack. CPU load between 50 and 60% on slot one looks strange.
> Is this normal ?
>
> CPU Utilization Statistics - Monitored every 5 seconds
> -------------------------------------------------------------------------------
>
> Card Process 5 10 30 1 5 30 1 Max Total
> secs secs secs min mins mins hour User/System
> util util util util util util util util CPU Usage
> (%) (%) (%) (%) (%) (%) (%) (%) (secs)
> -------------------------------------------------------------------------------
>
> Slot-1 System 52.4 51.6 50.4 50.2 48.9 51.7 51.9 99.9 4.27 35691.25
> Slot-2 System 6.2 7.0 6.8 6.6 6.7 6.1 6.1 36.3 0.00 0.00
>
> ExtremeXOS version 15.1.3.4 v1513b4-patch1-8
>
> Regards,
> Marcin
>
> _______________________________________________
> extreme-nsp mailing list
> extreme-nsp@puck.nether.net
> https://puck.nether.net/mailman/listinfo/extreme-nsp

_______________________________________________
extreme-nsp mailing list
extreme-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/extreme-nsp
Re: x650 CPU Load [ In reply to ]
On 2013-03-01 11:32, Shankar wrote:
> Traffic is getting CPU forwarded. You might need to check why ??

Is there any set of commands that could guide me to get the reason ?

Regards,
Marcin

>
>
> On Fri, Mar 1, 2013 at 3:04 PM, Marcin Kuczera <marcin@leon.pl
> <mailto:marcin@leon.pl>> wrote:
>
> On 2013-02-26 14:34, Erik Bais wrote:
>
> Hi Marcin,
>
> Could you show the output from the command 'top'
>
> Also press the number 1, to show any additional CPU cores and
> their load.
>
> It should show which process is so busy.
>
> Mem: 415392K used, 601052K free, 0K shrd, 70472K buff, 110704K cached
> CPU0: 5.2% usr 11.9% sys 0.0% nic 67.5% idle 0.0% io 15.2% irq
> 0.0% sirq
> CPU1: 6.6% usr 28.8% sys 0.0% nic 53.3% idle 0.0% io 0.0% irq
> 11.2% sirq
> Load average: 7.84 8.19 8.10 8/207 4795
> PID PPID USER STAT RSS %MEM CPU %CPU COMMAND
> 1305 2 root SW 0 0.0 1 18.3 [bcmRX]
> 1477 1 root S 7868 0.7 0 4.3 ./fdb
> 1255 2 root SW< 0 0.0 0 2.4 [bcmLINK.1]
> 1457 1 root S < 21964 2.1 0 1.8
> <tel:21964%20%202.1%20%20%200%20%201.8> ./hal
> 1253 2 root SW< 0 0.0 0 1.4 [bcmLINK.0]
> 1517 1 root S 7028 0.6 1 0.9 ./mcmgr
> 3039 2 root SW< 0 0.0 0 0.9 [bcmCNTR.0]
> 3040 2 root SW< 0 0.0 0 0.9 [bcmCNTR.1]
> 1541 1 root S 2824 0.2 1 0.5 ./pim
> 1110 1 root S 2848 0.2 1 0.3 /exos/bin/epm -t 40
> -f /exos/config/epmrc.AdvEdge -d /exos/config/epmdprc
> 4795 4794 root R 796 0.0 0 0.3 top -d 3
> 1701 2 root SWN 0 0.0 0 0.3 [bcmL2XAGE.1]
> 1292 2 root DW< 0 0.0 1 0.3 [tocpd_tx]
> 1501 1 root R 4340 0.4 0 0.1 ./eaps
> 1487 1 root S 3708 0.3 0 0.1 ./elsm
> 1507 1 root S 3420 0.3 1 0.1 ./rtmgr update
> 1547 1 root S 3052 0.3 1 0.1 ./acl
> 1531 1 root S 2652 0.2 1 0.1 ./rip
> 1536 1 root S 2332 0.2 0 0.1 ./ripng
> 1700 2 root SW< 0 0.0 1 0.1 [bcmL2X.1]
> 1698 2 root RW< 0 0.0 0 0.1 [bcmL2X.0]
> 1256 2 root SW< 0 0.0 0 0.1 [bcmASYNC]
> 1257 2 root RW< 0 0.0 1 0.1 [bcmRLINK]
> 1461 1 root S 36856 3.6 0 0.0 ./cliMaster
> 1582 1 root S 7100 0.6 1 0.0 ./etmon
> 1475 1 root S 6748 0.6 0 0.0 ./vlan
> 1610 1 root S 5668 0.5 1 0.0 ./idMgr
> 1596 1 root S 5648 0.5 1 0.0 ./xmld
> 1463 1 root S 5084 0.5 0 0.0 ./cfgmgr
> 1470 1 root S 4956 0.4 0 0.0 ./snmpSubagent
> 1489 1 root S 4620 0.4 1 0.0 ./edp
> Slot-1 SummitStack-GZE.2 #
>
> Regards,
> Marcin
>
>
>
>
> Regards,
> Erik Bais
>
> -----Original Message-----
> From: extreme-nsp-bounces@puck.nether.net
> <mailto:extreme-nsp-bounces@puck.nether.net>
> [mailto:extreme-nsp-bounces@puck.nether.net
> <mailto:extreme-nsp-bounces@puck.nether.net>] On Behalf Of
> Marcin Kuczera
> Sent: dinsdag 26 februari 2013 14:31
> To: extreme-nsp@puck.nether.net
> <mailto:extreme-nsp@puck.nether.net>
> Subject: [e-nsp] x650 CPU Load
>
> hello,
>
> I have 2x X650 connected via classical stack. CPU load between
> 50 and 60% on slot one looks strange.
> Is this normal ?
>
> CPU Utilization Statistics - Monitored every 5 seconds
> -------------------------------------------------------------------------------
>
> Card Process 5 10 30 1 5 30 1
> <tel:5%20%20%20%2010%20%20%2030%20%20%201%20%20%20%205%20%20%20%2030%20%20%201>
> Max Total
> secs secs secs min mins mins hour
> User/System
> util util util util util util util util
> CPU Usage
> (%) (%) (%) (%) (%) (%) (%) (%)
> (secs)
> -------------------------------------------------------------------------------
>
> Slot-1 System 52.4 51.6 50.4 50.2 48.9 51.7 51.9 99.9
> 4.27 35691.25
> Slot-2 System 6.2 7.0 6.8 6.6 6.7 6.1 6.1 36.3
> 0.00 0.00
>
> ExtremeXOS version 15.1.3.4 v1513b4-patch1-8
>
> Regards,
> Marcin
>
> _______________________________________________
> extreme-nsp mailing list
> extreme-nsp@puck.nether.net <mailto:extreme-nsp@puck.nether.net>
> https://puck.nether.net/mailman/listinfo/extreme-nsp
>
>
> _______________________________________________
> extreme-nsp mailing list
> extreme-nsp@puck.nether.net <mailto:extreme-nsp@puck.nether.net>
> https://puck.nether.net/mailman/listinfo/extreme-nsp
>
>
Re: x650 CPU Load [ In reply to ]
Hi Marcin,

Can you make a top screendump when there is a high cpu load. This info doesn't give much info.

It might be a good idea to open a TAC case.

Erik

Verstuurd vanaf mijn iPad

Op 1 mrt. 2013 om 17:16 heeft "Marcin Kuczera" <marcin@leon.pl<mailto:marcin@leon.pl>> het volgende geschreven:

On 2013-03-01 11:32, Shankar wrote:
Traffic is getting CPU forwarded. You might need to check why ??

Is there any set of commands that could guide me to get the reason ?

Regards,
Marcin



On Fri, Mar 1, 2013 at 3:04 PM, Marcin Kuczera <marcin@leon.pl<mailto:marcin@leon.pl>> wrote:
On 2013-02-26 14:34, Erik Bais wrote:
Hi Marcin,

Could you show the output from the command 'top'

Also press the number 1, to show any additional CPU cores and their load.

It should show which process is so busy.
Mem: 415392K used, 601052K free, 0K shrd, 70472K buff, 110704K cached
CPU0: 5.2% usr 11.9% sys 0.0% nic 67.5% idle 0.0% io 15.2% irq 0.0% sirq
CPU1: 6.6% usr 28.8% sys 0.0% nic 53.3% idle 0.0% io 0.0% irq 11.2% sirq
Load average: 7.84 8.19 8.10 8/207 4795
PID PPID USER STAT RSS %MEM CPU %CPU COMMAND
1305 2 root SW 0 0.0 1 18.3 [bcmRX]
1477 1 root S 7868 0.7 0 4.3 ./fdb
1255 2 root SW< 0 0.0 0 2.4 [bcmLINK.1]
1457 1 root S < 21964 2.1 0 1.8<tel:21964%20%202.1%20%20%200%20%201.8> ./hal
1253 2 root SW< 0 0.0 0 1.4 [bcmLINK.0]
1517 1 root S 7028 0.6 1 0.9 ./mcmgr
3039 2 root SW< 0 0.0 0 0.9 [bcmCNTR.0]
3040 2 root SW< 0 0.0 0 0.9 [bcmCNTR.1]
1541 1 root S 2824 0.2 1 0.5 ./pim
1110 1 root S 2848 0.2 1 0.3 /exos/bin/epm -t 40 -f /exos/config/epmrc.AdvEdge -d /exos/config/epmdprc
4795 4794 root R 796 0.0 0 0.3 top -d 3
1701 2 root SWN 0 0.0 0 0.3 [bcmL2XAGE.1]
1292 2 root DW< 0 0.0 1 0.3 [tocpd_tx]
1501 1 root R 4340 0.4 0 0.1 ./eaps
1487 1 root S 3708 0.3 0 0.1 ./elsm
1507 1 root S 3420 0.3 1 0.1 ./rtmgr update
1547 1 root S 3052 0.3 1 0.1 ./acl
1531 1 root S 2652 0.2 1 0.1 ./rip
1536 1 root S 2332 0.2 0 0.1 ./ripng
1700 2 root SW< 0 0.0 1 0.1 [bcmL2X.1]
1698 2 root RW< 0 0.0 0 0.1 [bcmL2X.0]
1256 2 root SW< 0 0.0 0 0.1 [bcmASYNC]
1257 2 root RW< 0 0.0 1 0.1 [bcmRLINK]
1461 1 root S 36856 3.6 0 0.0 ./cliMaster
1582 1 root S 7100 0.6 1 0.0 ./etmon
1475 1 root S 6748 0.6 0 0.0 ./vlan
1610 1 root S 5668 0.5 1 0.0 ./idMgr
1596 1 root S 5648 0.5 1 0.0 ./xmld
1463 1 root S 5084 0.5 0 0.0 ./cfgmgr
1470 1 root S 4956 0.4 0 0.0 ./snmpSubagent
1489 1 root S 4620 0.4 1 0.0 ./edp
Slot-1 SummitStack-GZE.2 #

Regards,
Marcin




Regards,
Erik Bais

-----Original Message-----
From: extreme-nsp-bounces@puck.nether.net<mailto:extreme-nsp-bounces@puck.nether.net> [mailto:extreme-nsp-bounces@puck.nether.net<mailto:extreme-nsp-bounces@puck.nether.net>] On Behalf Of Marcin Kuczera
Sent: dinsdag 26 februari 2013 14:31
To: extreme-nsp@puck.nether.net<mailto:extreme-nsp@puck.nether.net>
Subject: [e-nsp] x650 CPU Load

hello,

I have 2x X650 connected via classical stack. CPU load between 50 and 60% on slot one looks strange.
Is this normal ?

CPU Utilization Statistics - Monitored every 5 seconds
-------------------------------------------------------------------------------

Card Process 5 10 30 1 5 30 1<tel:5%20%20%20%2010%20%20%2030%20%20%201%20%20%20%205%20%20%20%2030%20%20%201> Max Total
secs secs secs min mins mins hour User/System
util util util util util util util util CPU Usage
(%) (%) (%) (%) (%) (%) (%) (%) (secs)
-------------------------------------------------------------------------------

Slot-1 System 52.4 51.6 50.4 50.2 48.9 51.7 51.9 99.9 4.27 35691.25
Slot-2 System 6.2 7.0 6.8 6.6 6.7 6.1 6.1 36.3 0.00 0.00

ExtremeXOS version 15.1.3.4 v1513b4-patch1-8

Regards,
Marcin

_______________________________________________
extreme-nsp mailing list
extreme-nsp@puck.nether.net<mailto:extreme-nsp@puck.nether.net>
https://puck.nether.net/mailman/listinfo/extreme-nsp

_______________________________________________
extreme-nsp mailing list
extreme-nsp@puck.nether.net<mailto:extreme-nsp@puck.nether.net>
https://puck.nether.net/mailman/listinfo/extreme-nsp


_______________________________________________
extreme-nsp mailing list
extreme-nsp@puck.nether.net<mailto:extreme-nsp@puck.nether.net>
https://puck.nether.net/mailman/listinfo/extreme-nsp
Re: x650 CPU Load [ In reply to ]
On 2013-03-01 17:19, Erik Bais wrote:
> Hi Marcin,
>
> Can you make a top screendump when there is a high cpu load. This info
> doesn't give much info.

It is difficult to catch it, I have seen 36.6 on bcmRX process, that is
the only thing that goes high.
This is I suppose related to IRQ load on CPU0 ~20%

There is almost no IP configuration on that switch except of management
on vlan Default.
The only features used are:
- elsm on 12 ports
- eaps - 3 rings
- vlan statistics - 2 vlans are monitored on one of the ports in slot-2
- 644 vlans

I have noticed a problem with Cacti.
look:
+ Running data query [1].
+ Found type = '3' [SNMP Query].
+ Found data query XML file at
'/usr/local/share/cacti/resource/snmp_queries/interface.xml'
+ XML file parsed ok.
+ Executing SNMP get for num of indexes @ '.1.3.6.1.2.1.2.1.0' Index
Count: 705
+ Executing SNMP walk for list of indexes @ '.1.3.6.1.2.1.2.2.1.1' Index
Count: 0
+ No SNMP data returned


However when I use classical snmpwalk it works fine !
Cacti works great with x450 with 12.4 - have no idea if there is any
relation here, but it is strage.

Besides - switch seems to work fine ;)

>
> It might be a good idea to open a TAC case.

Yeap, no support purchased ;)

Marcin

>
> Erik
>
> Verstuurd vanaf mijn iPad
>
> Op 1 mrt. 2013 om 17:16 heeft "Marcin Kuczera" <marcin@leon.pl
> <mailto:marcin@leon.pl>> het volgende geschreven:
>
>> On 2013-03-01 11:32, Shankar wrote:
>>> Traffic is getting CPU forwarded. You might need to check why ??
>>
>> Is there any set of commands that could guide me to get the reason ?
>>
>> Regards,
>> Marcin
>>
>>>
>>>
>>> On Fri, Mar 1, 2013 at 3:04 PM, Marcin Kuczera <marcin@leon.pl
>>> <mailto:marcin@leon.pl>> wrote:
>>>
>>> On 2013-02-26 14:34, Erik Bais wrote:
>>>
>>> Hi Marcin,
>>>
>>> Could you show the output from the command 'top'
>>>
>>> Also press the number 1, to show any additional CPU cores
>>> and their load.
>>>
>>> It should show which process is so busy.
>>>
>>> Mem: 415392K used, 601052K free, 0K shrd, 70472K buff, 110704K
>>> cached
>>> CPU0: 5.2% usr 11.9% sys 0.0% nic 67.5% idle 0.0% io 15.2%
>>> irq 0.0% sirq
>>> CPU1: 6.6% usr 28.8% sys 0.0% nic 53.3% idle 0.0% io 0.0%
>>> irq 11.2% sirq
>>> Load average: 7.84 8.19 8.10 8/207 4795
>>> PID PPID USER STAT RSS %MEM CPU %CPU COMMAND
>>> 1305 2 root SW 0 0.0 1 18.3 [bcmRX]
>>> 1477 1 root S 7868 0.7 0 4.3 ./fdb
>>> 1255 2 root SW< 0 0.0 0 2.4 [bcmLINK.1]
>>> 1457 1 root S < 21964 2.1 0 1.8
>>> <tel:21964%20%202.1%20%20%200%20%201.8> ./hal
>>> 1253 2 root SW< 0 0.0 0 1.4 [bcmLINK.0]
>>> 1517 1 root S 7028 0.6 1 0.9 ./mcmgr
>>> 3039 2 root SW< 0 0.0 0 0.9 [bcmCNTR.0]
>>> 3040 2 root SW< 0 0.0 0 0.9 [bcmCNTR.1]
>>> 1541 1 root S 2824 0.2 1 0.5 ./pim
>>> 1110 1 root S 2848 0.2 1 0.3 /exos/bin/epm -t
>>> 40 -f /exos/config/epmrc.AdvEdge -d /exos/config/epmdprc
>>> 4795 4794 root R 796 0.0 0 0.3 top -d 3
>>> 1701 2 root SWN 0 0.0 0 0.3 [bcmL2XAGE.1]
>>> 1292 2 root DW< 0 0.0 1 0.3 [tocpd_tx]
>>> 1501 1 root R 4340 0.4 0 0.1 ./eaps
>>> 1487 1 root S 3708 0.3 0 0.1 ./elsm
>>> 1507 1 root S 3420 0.3 1 0.1 ./rtmgr update
>>> 1547 1 root S 3052 0.3 1 0.1 ./acl
>>> 1531 1 root S 2652 0.2 1 0.1 ./rip
>>> 1536 1 root S 2332 0.2 0 0.1 ./ripng
>>> 1700 2 root SW< 0 0.0 1 0.1 [bcmL2X.1]
>>> 1698 2 root RW< 0 0.0 0 0.1 [bcmL2X.0]
>>> 1256 2 root SW< 0 0.0 0 0.1 [bcmASYNC]
>>> 1257 2 root RW< 0 0.0 1 0.1 [bcmRLINK]
>>> 1461 1 root S 36856 3.6 0 0.0 ./cliMaster
>>> 1582 1 root S 7100 0.6 1 0.0 ./etmon
>>> 1475 1 root S 6748 0.6 0 0.0 ./vlan
>>> 1610 1 root S 5668 0.5 1 0.0 ./idMgr
>>> 1596 1 root S 5648 0.5 1 0.0 ./xmld
>>> 1463 1 root S 5084 0.5 0 0.0 ./cfgmgr
>>> 1470 1 root S 4956 0.4 0 0.0 ./snmpSubagent
>>> 1489 1 root S 4620 0.4 1 0.0 ./edp
>>> Slot-1 SummitStack-GZE.2 #
>>>
>>> Regards,
>>> Marcin
>>>
>>>
>>>
>>>
>>> Regards,
>>> Erik Bais
>>>
>>> -----Original Message-----
>>> From: extreme-nsp-bounces@puck.nether.net
>>> <mailto:extreme-nsp-bounces@puck.nether.net>
>>> [mailto:extreme-nsp-bounces@puck.nether.net
>>> <mailto:extreme-nsp-bounces@puck.nether.net>] On Behalf Of
>>> Marcin Kuczera
>>> Sent: dinsdag 26 februari 2013 14:31
>>> To: extreme-nsp@puck.nether.net
>>> <mailto:extreme-nsp@puck.nether.net>
>>> Subject: [e-nsp] x650 CPU Load
>>>
>>> hello,
>>>
>>> I have 2x X650 connected via classical stack. CPU load
>>> between 50 and 60% on slot one looks strange.
>>> Is this normal ?
>>>
>>> CPU Utilization Statistics - Monitored every 5 seconds
>>> -------------------------------------------------------------------------------
>>>
>>> Card Process 5 10 30 1 5 30 1
>>> <tel:5%20%20%20%2010%20%20%2030%20%20%201%20%20%20%205%20%20%20%2030%20%20%201>
>>> Max Total
>>> secs secs secs min mins mins hour
>>> User/System
>>> util util util util util util util
>>> util CPU Usage
>>> (%) (%) (%) (%) (%) (%) (%)
>>> (%) (secs)
>>> -------------------------------------------------------------------------------
>>>
>>> Slot-1 System 52.4 51.6 50.4 50.2 48.9 51.7 51.9 99.9
>>> 4.27 35691.25
>>> Slot-2 System 6.2 7.0 6.8 6.6 6.7 6.1 6.1 36.3
>>> 0.00 0.00
>>>
>>> ExtremeXOS version 15.1.3.4 v1513b4-patch1-8
>>>
>>> Regards,
>>> Marcin
>>>
>>> _______________________________________________
>>> extreme-nsp mailing list
>>> extreme-nsp@puck.nether.net <mailto:extreme-nsp@puck.nether.net>
>>> https://puck.nether.net/mailman/listinfo/extreme-nsp
>>>
>>>
>>> _______________________________________________
>>> extreme-nsp mailing list
>>> extreme-nsp@puck.nether.net <mailto:extreme-nsp@puck.nether.net>
>>> https://puck.nether.net/mailman/listinfo/extreme-nsp
>>>
>>>
>>
>> _______________________________________________
>> extreme-nsp mailing list
>> extreme-nsp@puck.nether.net <mailto:extreme-nsp@puck.nether.net>
>> https://puck.nether.net/mailman/listinfo/extreme-nsp
Re: x650 CPU Load [ In reply to ]
On 01/03/13 15:36, Marcin Kuczera wrote:
> On 2013-03-01 11:32, Shankar wrote:
>> Traffic is getting CPU forwarded. You might need to check why ??

> Is there any set of commands that could guide me to get the reason ?

If you do show l2stats you can see the 'number of packets to CPU' per
VLAN - which might help you tell if it's a particular VLAN causing the
problem. Typically the things going to the CPU are stuff that will be
flooded, so high levels of broadcast or flooded multicast on a
particular VLAN might be responsible.

The only way to tell for sure what is causing it is to tcpdump the
packets going to the CPU - but you can only so this in debug mode, which
requires getting a debug password from TAC. This is one of the most
annoying things about extreme IMO, particularly as the passwords are
only valid for a short period of time. If you're trying to debug
something intermittent the problem is often gone by the time you can get
hold of someone with the ability to generate the password.

--
Robert Kerr







_______________________________________________
extreme-nsp mailing list
extreme-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/extreme-nsp
Re: x650 CPU Load [ In reply to ]
On 2013-03-05 11:21, Robert Kerr wrote:
> On 04/03/13 22:26, Marcin Kuczera wrote:
>> On 2013-03-04 10:30, Robert Kerr wrote:
>>> On 01/03/13 15:36, Marcin Kuczera wrote:
>>>> On 2013-03-01 11:32, Shankar wrote:
>>>>> Traffic is getting CPU forwarded. You might need to check why ??
>>>> Is there any set of commands that could guide me to get the reason ?
>>> If you do show l2stats you can see the 'number of packets to CPU' per
>>> VLAN - which might help you tell if it's a particular VLAN causing the
>>> problem. Typically the things going to the CPU are stuff that will be
>>> flooded, so high levels of broadcast or flooded multicast on a
>>> particular VLAN might be responsible.
>> Well,
>> I have a lot of vlans with stats like that:
>> Slot-1 SummitStack-GZE.3 # show l2stats Default
>> Bridge interface on VLAN Default:
>> Total number of packets to CPU = 1822970.
>> Total number of packets learned = 941959.
>> Total number of IGMP control packets snooped = 28545.
>> Total number of IGMP data packets switched = 0.
>> however, still - I don't think that these are reasonable packets to be
>> sent to CPU,
>> this looks like CPU gets something that it shouldn't, some kind of a bug.
> It's certainly normal to have some packets to CPU... but it can be hard
> to tell how much as it depends on how much other traffic is on that
> VLAN. You can clear l2stats first to zero the counter then see what the
> counters look like after a minute or two.
>
> One thing I know causes a lot of packets to CPU is microsoft network
> load balancing set to active-active. I have never got a straight answer
> from extreme as to whether this is a bug or not, they just kept telling
> me to set it to active-passive.

Ok, I know the vlan that causes high load.

This is a vlan without any IP and a lot of traffic that is 100% broadcasts.
Reason for this traffic is a mirror from a specyfic traffic on a router
forwarded to a particular VLAN.
Because of DST is unknown, it is ff:ff:ff:ff:ff:ff - then it is
intercepted on interface working in promisc mode
and some analysis is performed.

So - pure L2 VLAN with broadcast traffic that 100% goes towards CPU -
isn't is strage ?
No L3 interface on that vlan, but switch behaves like it is in promisc
mode on that and any other vlan !
We tried to disable learning on that vlan but it doesn't help, only
taking down this broadcast oriented traffic help.
(and than Cacti works fine, so snmpwalk has some low timeout on snmpwalk..)


Is there any command to turn on/off promisc mode for CPU ?
For me it rather looks like a bug ?

Regards,
Marcin

_______________________________________________
extreme-nsp mailing list
extreme-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/extreme-nsp
Re: x650 CPU Load [ In reply to ]
On 05/03/13 12:03, Marcin Kuczera wrote:

> So - pure L2 VLAN with broadcast traffic that 100% goes towards CPU -
> isn't is strage ?
> No L3 interface on that vlan, but switch behaves like it is in promisc
> mode on that and any other vlan !
> We tried to disable learning on that vlan but it doesn't help, only
> taking down this broadcast oriented traffic help.
> (and than Cacti works fine, so snmpwalk has some low timeout on snmpwalk..

> Is there any command to turn on/off promisc mode for CPU ?
> For me it rather looks like a bug ?

In addition to disabling learning, have you made sure IGMP snooping and
bootprelay are switched off for the VLAN?

You might also try an ACL with the 'deny-cpu' action? Totally untested
of course... it might just blackhole the traffic entirely.

Other than that I don't know - I have heard of people wrapping mirrored
traffic in GRE tunnels to avoid such issues (cisco ERSPAN does this).
Perhaps this may be an option depending on the source and destination.

We tend to use passive taps with direct cabling to the monitoring box to
avoid this sort of thing.

--
Robert Kerr

_______________________________________________
extreme-nsp mailing list
extreme-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/extreme-nsp
Re: x650 CPU Load [ In reply to ]
On 2013-03-05 14:09, Robert Kerr wrote:
> On 05/03/13 12:03, Marcin Kuczera wrote:
>
>> So - pure L2 VLAN with broadcast traffic that 100% goes towards CPU -
>> isn't is strage ?
>> No L3 interface on that vlan, but switch behaves like it is in promisc
>> mode on that and any other vlan !
>> We tried to disable learning on that vlan but it doesn't help, only
>> taking down this broadcast oriented traffic help.
>> (and than Cacti works fine, so snmpwalk has some low timeout on snmpwalk..
>> Is there any command to turn on/off promisc mode for CPU ?
>> For me it rather looks like a bug ?
> In addition to disabling learning, have you made sure IGMP snooping and
> bootprelay are switched off for the VLAN?
I tried that also, no positive result.

I understand that there are cases when bcasts need to be forwarded to
CPU, i.e. when
there is IP interface on particular VLAN.
There is also traffic like IGMP that needs to go to CPU, but all of
these should be recognized by switching chipset
and then forwarded.
If VLAN has no L3 interface than broadcast shouldn't go to CPU.

>
> You might also try an ACL with the 'deny-cpu' action? Totally untested
> of course... it might just blackhole the traffic entirely.
I can do test on that VLAN so if you have some example (I have never
done that before) I'll appreciate.


> Other than that I don't know - I have heard of people wrapping mirrored
> traffic in GRE tunnels to avoid such issues (cisco ERSPAN does this).
> Perhaps this may be an option depending on the source and destination.
That would have to be L3 forwarding, will work however it just workaround..

> We tend to use passive taps with direct cabling to the monitoring box to
> avoid this sort of thing.

Passive tap ? Could you expand this ?

Regards,
Marcin


_______________________________________________
extreme-nsp mailing list
extreme-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/extreme-nsp