Mailing List Archive: ASR1001X additional EBGP peer

ASR1001X additional EBGP peer

Mar 7, 2020, 10:48 PM

Post #1 of 6 (1322 views)

Dear all
I'd like to have your recommandation.

Our customer runs on ASR1001X an EBGP peering (full routing) with one ISP
and some internal IBGP peering (full routing) with other sites of the
customer.

ASR1001xxx#sh ip bgp summary
BGP router identifier 185.x.xxx, local AS number 12111
BGP table version is 165259260, main routing table version 165259260
791972 network entries using 196409056 bytes of memory
2581993 path entries using 330495104 bytes of memory
458319/118958 BGP path/bestpath attribute entries using 120996216 bytes of
memory
233298 BGP AS-PATH entries using 11620238 bytes of memory
84 BGP community entries using 2704 bytes of memory
0 BGP route-map cache entries using 0 bytes of memory
0 BGP filter-list cache entries using 0 bytes of memory
BGP using 659523318 total bytes of memory
BGP activity 5705457/4913485 prefixes, 122354684/119772691 paths, scan
interval 60 secs

Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down
State/PfxRcd
80.14.x.1 4 32x 2702998 53942 165259167 0 0 1w4d
791619
185.71.x.1 4 121xx 28908450 37253524 165259260 0 0 31w0d
756795
185.71.x.2 4 121xx 36083442 31272759 165259260 0 0 26w0d
276292
185.71.x.3 4 121xx 28549167 37251270 165259260 0 0 31w0d
757279

We'd like to add a new EBGP peering on the same router (with full routing
received from a second carrier) in order to load balance traffic (mainly in
output).
The question is: do you see any issue in terms of
performance/memory/whatelse in adding a new EBGP peering ?
Which is the best way to try to load balance in output ?

From output following I am not sure if going to upgrade the RAM or not...

Thanks in advance for your help!
Cheers
James

ASR1001xxx#sh ver
Cisco IOS XE Software, Version 16.03.07
Cisco IOS Software [Denali], ASR1000 Software
(X86_64_LINUX_IOSD-UNIVERSALK9-M), Version 16.3.7, RELEASE SOFTWARE (fc4)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2018 by Cisco Systems, Inc.
Compiled Sat 04-Aug-18 00:51 by mcpre

Cisco IOS-XE software, Copyright (c) 2005-2018 by cisco Systems, Inc.
All rights reserved. Certain components of Cisco IOS-XE software are
licensed under the GNU General Public License ("GPL") Version 2.0. The
software code licensed under GPL Version 2.0 is free software that comes
with ABSOLUTELY NO WARRANTY. You can redistribute and/or modify such
GPL code under the terms of GPL Version 2.0. For more details, see the
documentation or "License Notice" file accompanying the IOS-XE software,
or the applicable URL provided on the flyer accompanying the IOS-XE
software.

ROM: IOS-XE ROMMON

ASR1001xxx uptime is 31 weeks, 47 minutes
Uptime for this control processor is 31 weeks, 49 minutes
System returned to ROM by reload at 08:25:36 CET Sun Aug 4 2019
System restarted at 08:29:12 CET Sun Aug 4 2019
System image file is "bootflash:asr1001x-universalk9.16.03.07.SPA.bin"
Last reload reason: Reload Command

This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found
at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

License Type: Permanent
License Level: ipbase
Next reload license Level: ipbase

cisco ASR1001-X (1NG) processor (revision 1NG) with 3728595K/6147K bytes of
memory.
Processor board ID FXSrrrrrr
6 Gigabit Ethernet interfaces
2 Ten Gigabit Ethernet interfaces
32768K bytes of non-volatile configuration memory.
8388608K bytes of physical memory.
6594559K bytes of eUSB flash at bootflash:.
0K bytes of at harddisk:.
0K bytes of at webui:.

Configuration register is 0x2102

ASR1001xxx#sh cef fib
792336 allocated IPv4 entries, 0 failed allocations
1 allocated IPv6 entry, 0 failed allocations

ASR1001xxx#show platform software status control-processor brief
Load Average
Slot Status 1-Min 5-Min 15-Min
RP0 Healthy 0.19 0.17 0.14

Memory (kB)
Slot Status Total Used (Pct) Free (Pct) Committed (Pct)
RP0 Healthy 8058752 5470576 (68%) 2588176 (32%) 6986084 (87%)

CPU Utilization
Slot CPU User System Nice Idle IRQ SIRQ IOwait
RP0 0 1.10 2.50 0.00 96.20 0.00 0.20 0.00
1 1.20 0.90 0.00 97.90 0.00 0.00 0.00
2 0.50 0.50 0.00 99.00 0.00 0.00 0.00
3 0.49 0.79 0.00 98.70 0.00 0.00 0.00
4 0.89 1.59 0.00 97.50 0.00 0.00 0.00
5 8.10 0.60 0.00 91.29 0.00 0.00 0.00
6 0.70 0.50 0.00 98.80 0.00 0.00 0.00
7 0.70 1.20 0.00 98.10 0.00 0.00 0.00

ASR1001xxx#sh memory
Head Total(b) Used(b) Free(b) Lowest(b)
Largest(b)
Processor 7FAA04789010 3817942128 1879191444 1938750684 1929980360
1931880324
lsmpi_io 7FA9FF9FF1A8 6295128 6294304 824 824
412
_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

Re: ASR1001X additional EBGP peer [ In reply to ]

mark.tinka at seacom

Mar 8, 2020, 3:02 AM

Post #2 of 6 (1321 views)

Permalink

On 8/Mar/20 09:48, james list wrote:

> We'd like to add a new EBGP peering on the same router (with full routing
> received from a second carrier) in order to load balance traffic (mainly in
> output).
> The question is: do you see any issue in terms of
> performance/memory/whatelse in adding a new EBGP peering ?
> Which is the best way to try to load balance in output ?

The ASR1001-X ships with 8GB RAM. That's more than enough to hold 2 full
tables.

Load balancing on egress for BGP is not like load balancing for ECMP.
Your router will decide which of your upstreams has the best path toward
a destination. This is not always an exact science as it will depend on
if you are buying from a large global carrier or mid-size global
carrier, a large local/regional carrier or a mid-size local/regional
carrier.

BGP always chooses one best path. So if both of your upstreams announce
the same path, only one of them will be used. You can use features like
BGP Multipath to load balance egress traffic over the two upstreams, but
this isn't the default BGP behaviour, and you'll have to turn it on and
confirm it does what you want.

The good news is that the upstream with the best path toward a
destination will always be used, so your customers will be happy about
that. But it may not result in equal sharing of traffic. You might have
to tweak a number of BGP bits about to get it to close to 50/50 as
possible, if that is your desire.

For us, we connect to a ton of transit providers and peers. Our
motivation isn't to load balance traffic (in either direction), but to
provide shortest path routing as well as redundancy. Often times, we've
had to manually prefer certain egress destinations via specific upstream
providers than what the default chose, as BGP doesn't typically take
things like latency into account.

Mark.

_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

Re: ASR1001X additional EBGP peer [ In reply to ]

saku at ytti

Mar 8, 2020, 3:11 AM

Post #3 of 6 (1321 views)

Permalink

On Sun, 8 Mar 2020 at 12:04, Mark Tinka <mark.tinka@seacom.mu> wrote:

> BGP always chooses one best path. So if both of your upstreams announce
> the same path, only one of them will be used. You can use features like
> BGP Multipath to load balance egress traffic over the two upstreams, but
> this isn't the default BGP behaviour, and you'll have to turn it on and
> confirm it does what you want.

Cisco won't ECMP with different peer-as by default even with multipath
enabled, you'll also need hidden command 'bgp bestpath as-path
multipath-relax'.

--
++ytti
_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

Re: ASR1001X additional EBGP peer [ In reply to ]

mark.tinka at seacom

Mar 8, 2020, 3:17 AM

Post #4 of 6 (1321 views)

Permalink

On 8/Mar/20 12:11, Saku Ytti wrote:

>
> Cisco won't ECMP with different peer-as by default even with multipath
> enabled, you'll also need hidden command 'bgp bestpath as-path
> multipath-relax'.

That's why I don't mess around with some of these things :-).

Mark.
_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

Re: ASR1001X additional EBGP peer [ In reply to ]

jameslist72 at gmail

Mar 8, 2020, 6:34 AM

Post #5 of 6 (1315 views)

Permalink

Mark, Saku,
Thanks for your help.

If you see the output provided we run one ebgp (full routing) and then we
have three ibpg (full routing).
We need to add one egbp due to high bandwidth needed and since we want to
use ibgp only in case of wan faults.

Can I run bgp multipath only on ebgp session?

We decided to add a link with the same carrier and we are aware we will not
reach 50/50 balancing.

What about RAM memory? Don t you see any issue?

Cheers

Il Dom 8 Mar 2020, 08:48 james list <jameslist72@gmail.com> ha scritto:

> Dear all
> I'd like to have your recommandation.
>
> Our customer runs on ASR1001X an EBGP peering (full routing) with one ISP
> and some internal IBGP peering (full routing) with other sites of the
> customer.
>
> ASR1001xxx#sh ip bgp summary
> BGP router identifier 185.x.xxx, local AS number 12111
> BGP table version is 165259260, main routing table version 165259260
> 791972 network entries using 196409056 bytes of memory
> 2581993 path entries using 330495104 bytes of memory
> 458319/118958 BGP path/bestpath attribute entries using 120996216 bytes of
> memory
> 233298 BGP AS-PATH entries using 11620238 bytes of memory
> 84 BGP community entries using 2704 bytes of memory
> 0 BGP route-map cache entries using 0 bytes of memory
> 0 BGP filter-list cache entries using 0 bytes of memory
> BGP using 659523318 total bytes of memory
> BGP activity 5705457/4913485 prefixes, 122354684/119772691 paths, scan
> interval 60 secs
>
> Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down
> State/PfxRcd
> 80.14.x.1 4 32x 2702998 53942 165259167 0 0 1w4d
> 791619
> 185.71.x.1 4 121xx 28908450 37253524 165259260 0 0 31w0d
> 756795
> 185.71.x.2 4 121xx 36083442 31272759 165259260 0 0 26w0d
> 276292
> 185.71.x.3 4 121xx 28549167 37251270 165259260 0 0 31w0d
> 757279
>
> We'd like to add a new EBGP peering on the same router (with full routing
> received from a second carrier) in order to load balance traffic (mainly in
> output).
> The question is: do you see any issue in terms of
> performance/memory/whatelse in adding a new EBGP peering ?
> Which is the best way to try to load balance in output ?
>
> From output following I am not sure if going to upgrade the RAM or not...
>
> Thanks in advance for your help!
> Cheers
> James
>
>
> ASR1001xxx#sh ver
> Cisco IOS XE Software, Version 16.03.07
> Cisco IOS Software [Denali], ASR1000 Software
> (X86_64_LINUX_IOSD-UNIVERSALK9-M), Version 16.3.7, RELEASE SOFTWARE (fc4)
> Technical Support: http://www.cisco.com/techsupport
> Copyright (c) 1986-2018 by Cisco Systems, Inc.
> Compiled Sat 04-Aug-18 00:51 by mcpre
>
>
> Cisco IOS-XE software, Copyright (c) 2005-2018 by cisco Systems, Inc.
> All rights reserved. Certain components of Cisco IOS-XE software are
> licensed under the GNU General Public License ("GPL") Version 2.0. The
> software code licensed under GPL Version 2.0 is free software that comes
> with ABSOLUTELY NO WARRANTY. You can redistribute and/or modify such
> GPL code under the terms of GPL Version 2.0. For more details, see the
> documentation or "License Notice" file accompanying the IOS-XE software,
> or the applicable URL provided on the flyer accompanying the IOS-XE
> software.
>
>
> ROM: IOS-XE ROMMON
>
> ASR1001xxx uptime is 31 weeks, 47 minutes
> Uptime for this control processor is 31 weeks, 49 minutes
> System returned to ROM by reload at 08:25:36 CET Sun Aug 4 2019
> System restarted at 08:29:12 CET Sun Aug 4 2019
> System image file is "bootflash:asr1001x-universalk9.16.03.07.SPA.bin"
> Last reload reason: Reload Command
>
>
>
> This product contains cryptographic features and is subject to United
> States and local country laws governing import, export, transfer and
> use. Delivery of Cisco cryptographic products does not imply
> third-party authority to import, export, distribute or use encryption.
> Importers, exporters, distributors and users are responsible for
> compliance with U.S. and local country laws. By using this product you
> agree to comply with applicable laws and regulations. If you are unable
> to comply with U.S. and local laws, return this product immediately.
>
> A summary of U.S. laws governing Cisco cryptographic products may be found
> at:
> http://www.cisco.com/wwl/export/crypto/tool/stqrg.html
>
> If you require further assistance please contact us by sending email to
> export@cisco.com.
>
> License Type: Permanent
> License Level: ipbase
> Next reload license Level: ipbase
>
> cisco ASR1001-X (1NG) processor (revision 1NG) with 3728595K/6147K bytes
> of memory.
> Processor board ID FXSrrrrrr
> 6 Gigabit Ethernet interfaces
> 2 Ten Gigabit Ethernet interfaces
> 32768K bytes of non-volatile configuration memory.
> 8388608K bytes of physical memory.
> 6594559K bytes of eUSB flash at bootflash:.
> 0K bytes of at harddisk:.
> 0K bytes of at webui:.
>
> Configuration register is 0x2102
>
>
>
> ASR1001xxx#sh cef fib
> 792336 allocated IPv4 entries, 0 failed allocations
> 1 allocated IPv6 entry, 0 failed allocations
>
> ASR1001xxx#show platform software status control-processor brief
> Load Average
> Slot Status 1-Min 5-Min 15-Min
> RP0 Healthy 0.19 0.17 0.14
>
> Memory (kB)
> Slot Status Total Used (Pct) Free (Pct) Committed (Pct)
> RP0 Healthy 8058752 5470576 (68%) 2588176 (32%) 6986084 (87%)
>
> CPU Utilization
> Slot CPU User System Nice Idle IRQ SIRQ IOwait
> RP0 0 1.10 2.50 0.00 96.20 0.00 0.20 0.00
> 1 1.20 0.90 0.00 97.90 0.00 0.00 0.00
> 2 0.50 0.50 0.00 99.00 0.00 0.00 0.00
> 3 0.49 0.79 0.00 98.70 0.00 0.00 0.00
> 4 0.89 1.59 0.00 97.50 0.00 0.00 0.00
> 5 8.10 0.60 0.00 91.29 0.00 0.00 0.00
> 6 0.70 0.50 0.00 98.80 0.00 0.00 0.00
> 7 0.70 1.20 0.00 98.10 0.00 0.00 0.00
>
>
> ASR1001xxx#sh memory
> Head Total(b) Used(b) Free(b) Lowest(b)
> Largest(b)
> Processor 7FAA04789010 3817942128 1879191444 1938750684
> 1929980360 1931880324
> lsmpi_io 7FA9FF9FF1A8 6295128 6294304 824 824
> 412
>
>
_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

Re: ASR1001X additional EBGP peer [ In reply to ]

mark.tinka at seacom

Mar 8, 2020, 10:42 PM

Post #6 of 6 (1305 views)

Permalink

On 8/Mar/20 15:34, james list wrote:

> If you see the output provided we run one ebgp (full routing) and then we
> have three ibpg (full routing).
> We need to add one egbp due to high bandwidth needed and since we want to
> use ibgp only in case of wan faults.

It would be good to track how much memory you're currently using for all
the sessions you have so far. Is this something you're graphing?

>
> Can I run bgp multipath only on ebgp session?

BGP Multi-Path is supported both on eBGP and iBGP sessions.

>
> We decided to add a link with the same carrier and we are aware we will not
> reach 50/50 balancing.

If you are going to multi-home to the same carrier, then there are
better chances of load balancing depending on how much more complex you
want to set yourself up. However, what you gain in extra load balancing,
you lose in outright resiliency, as you're still putting all your eggs
in one basket.

>
> What about RAM memory? Don t you see any issue?

Not immediately, but check your memory utilization graphs as at now. If
you aren't doing that, just run a simple "sh processes memory platform".

Mark.

_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/