Mailing List Archive

On 5/15/19 4:53 AM, Erik Sundberg wrote:
> Has anyone been able to install\copy software images from a USB key to a ASR9906. It take for ever to copy files from a http server, I would like to try from a USB key to see if it's faster.
>
> The router never recognizes the usb key when it put into the rsp. The Cisco Linux (Admin VM) also does not recognize it either.
>
> I am specifically running a Cisco ASR9906 with A99-RSP-SE 6.3.3 (32-bit). I am Upgrading to 6.3.3 64-bit then to 6.5.3 (64 bit) the current process take 3-4 hours.
>
>
> Thanks
>
> Erik


I've definitely copied files from a USB stick onto an ASR9001, so I
can't imagine why you wouldn't be able to on a 990x platform. Pretty
sure I did it on a 9006 with RP880s, but it's been awhile.

The trick is usually figuring out the correct device name. In my travels
I've seen "usb:", "disk2:" ... ymmv.

_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

If you do a "dir ?" it should show you the possabilities... often "usb0:".
The size of the usb stick matters sometimes. Try a small < 8G stick.

Peter

On Wed, May 15, 2019 at 1:36 PM Bryan Holloway <bryan@shout.net> wrote:

>
> On 5/15/19 4:53 AM, Erik Sundberg wrote:
> > Has anyone been able to install\copy software images from a USB key to a
> ASR9906. It take for ever to copy files from a http server, I would like to
> try from a USB key to see if it's faster.
> >
> > The router never recognizes the usb key when it put into the rsp. The
> Cisco Linux (Admin VM) also does not recognize it either.
> >
> > I am specifically running a Cisco ASR9906 with A99-RSP-SE 6.3.3
> (32-bit). I am Upgrading to 6.3.3 64-bit then to 6.5.3 (64 bit) the current
> process take 3-4 hours.
> >
> >
> > Thanks
> >
> > Erik
>
>
> I've definitely copied files from a USB stick onto an ASR9001, so I
> can't imagine why you wouldn't be able to on a 990x platform. Pretty
> sure I did it on a 9006 with RP880s, but it's been awhile.
>
> The trick is usually figuring out the correct device name. In my travels
> I've seen "usb:", "disk2:" ... ymmv.
>
> _______________________________________________
> cisco-nsp mailing list cisco-nsp@puck.nether.net
> https://puck.nether.net/mailman/listinfo/cisco-nsp
> archive at http://puck.nether.net/pipermail/cisco-nsp/
>


--
Thank you,

Peter Bruno
609.335.6887 c
_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

Thanks Guys!!!

It’s showing up as disk2: using a 4G USB Key formatted as FAT32

Works on 9906 running 6.3.2 64-bit, 6.5.3 64-bit

Going to try installing the software via a USB key next week. Right now it’s taking about 1 ½ Hours to upload the 1.3G iso’s using http download. Painfully slow. And don’t let your session timeout.



RP/0/RSP0/CPU0:CR2.DAL1#sh log | i usb
Wed May 15 21:27:47.486 UTC
RP/0/RSP0/CPU0:May 15 21:13:50.304 UTC: usb_disk[69610]: %OS-SYSLOG-6-LOG_INFO : mounted device to /disk2:
RP/0/RSP0/CPU0:May 15 21:18:50.347 UTC: usb_disk[66997]: %OS-SYSLOG-6-LOG_INFO : disk removed /disk2:
RP/0/RSP0/CPU0:May 15 21:18:50.615 UTC: usb_disk[67016]: %OS-SYSLOG-6-LOG_INFO : disk removed
RP/0/RSP0/CPU0:May 15 21:20:46.362 UTC: usb_disk[67216]: %OS-SYSLOG-6-LOG_INFO : mounted device to /disk2:


RP/0/RSP0/CPU0:CR2.DAL1#show filesystem
Wed May 15 21:15:59.776 UTC
File Systems:

Size(b) Free(b) Type Flags Prefixes
1014255616 1003970560 flash-disk rw disk0:
0 0 network rw tftp:
491065344 489840640 flash rw /misc/config
3561914368 3555708928 harddisk rw harddiska:
4073914368 2378563584 flash-disk rw disk2:
3561914368 3555708928 harddisk rw harddiskb:
2513158144 2449240064 flash-disk rw apphost:
5814747136 5796179968 harddisk rw harddisk:
0 0 network rw ftp:


RP/0/RSP0/CPU0:CR2.DAL1#dir disk2:
Wed May 15 21:16:06.655 UTC

Directory of disk2:
6 drwxr-xr-x 2 4096 May 3 18:32 System\ Volume\ Information
7 -rwxr-xr-x 1 106444800 May 2 23:15 ASR9K-x64-iosxr-px-k9-6.5.3.tar
8 -rwxr-xr-x 1 1588887552 Apr 23 11:43 asr9k-mini-x64-6.5.3.iso

3978432 kbytes total (2322816 kbytes free)



RP/0/RSP0/CPU0:CR2.DAL1#run
Wed May 15 21:16:09.650 UTC

[xr-vm_node0_RSP0_CPU0:~]$mount | grep usb
/dev/vdd on /eusb type ext2 (rw,relatime,sync,errors=continue,user_xattr,acl)
/dev/vdg on /mnt/usb/vdg type vfat (rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro)


[xr-vm_node0_RSP0_CPU0:~]$ls /mnt/usb/vdg
ASR9K-x64-iosxr-px-k9-6.5.3.tar System Volume Information asr9k-mini-x64-6.5.3.iso







From: Peter Bruno <brunopeter@gmail.com>
Sent: Wednesday, May 15, 2019 2:11 PM
To: Bryan Holloway <bryan@shout.net>
Cc: Erik Sundberg <ESundberg@nitelusa.com>; cisco-nsp@puck.nether.net
Subject: Re: [c-nsp] ASR9900 - Copy files from USB key

If you do a "dir ?" it should show you the possabilities... often "usb0:". The size of the usb stick matters sometimes. Try a small < 8G stick.

Peter

On Wed, May 15, 2019 at 1:36 PM Bryan Holloway <bryan@shout.net<mailto:bryan@shout.net>> wrote:

On 5/15/19 4:53 AM, Erik Sundberg wrote:
> Has anyone been able to install\copy software images from a USB key to a ASR9906. It take for ever to copy files from a http server, I would like to try from a USB key to see if it's faster.
>
> The router never recognizes the usb key when it put into the rsp. The Cisco Linux (Admin VM) also does not recognize it either.
>
> I am specifically running a Cisco ASR9906 with A99-RSP-SE 6.3.3 (32-bit). I am Upgrading to 6.3.3 64-bit then to 6.5.3 (64 bit) the current process take 3-4 hours.
>
>
> Thanks
>
> Erik


I've definitely copied files from a USB stick onto an ASR9001, so I
can't imagine why you wouldn't be able to on a 990x platform. Pretty
sure I did it on a 9006 with RP880s, but it's been awhile.

The trick is usually figuring out the correct device name. In my travels
I've seen "usb:", "disk2:" ... ymmv.

_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net<mailto:cisco-nsp@puck.nether.net>
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/


--
Thank you,
Peter Bruno
609.335.6887 c

________________________________

CONFIDENTIALITY NOTICE: This e-mail transmission, and any documents, files or previous e-mail messages attached to it may contain confidential information that is legally privileged. If you are not the intended recipient, or a person responsible for delivering it to the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of any of the information contained in or attached to this transmission is STRICTLY PROHIBITED. If you have received this transmission in error please notify the sender immediately by replying to this e-mail. You must destroy the original transmission and its attachments without reading or saving in any manner. Thank you.
_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

Little follow up.

On a ASR9906 6.3.3 (32bit) the usb key comes up as usb: but on 6.3.3 (64-bit) it's disk2:


Copying the 6.3.3 migration files from a USB Key was 182 seconds, with HTTP it was around 1 hour. (1.3 G File)
Doing a install add source 6.5.3 64-bit from a USB Key was 15 minutes and using http was an 1 1/2 hours. (1.5 G File)

So sourcing files from a USB key are 4x times... Which is to be expected.

The bandwidth to the HTTP server is 100M and <30msec latency, but the circuit was never maxed. For some reason coping from a HTTP server is just super slow...

Erik

-----Original Message-----
From: cisco-nsp <cisco-nsp-bounces@puck.nether.net> On Behalf Of Erik Sundberg
Sent: Wednesday, May 15, 2019 11:29 PM
To: Peter Bruno <brunopeter@gmail.com>; Bryan Holloway <bryan@shout.net>
Cc: cisco-nsp@puck.nether.net
Subject: Re: [c-nsp] ASR9900 - Copy files from USB key

Thanks Guys!!!

It’s showing up as disk2: using a 4G USB Key formatted as FAT32

Works on 9906 running 6.3.2 64-bit, 6.5.3 64-bit

Going to try installing the software via a USB key next week. Right now it’s taking about 1 ½ Hours to upload the 1.3G iso’s using http download. Painfully slow. And don’t let your session timeout.



RP/0/RSP0/CPU0:CR2.DAL1#sh log | i usb
Wed May 15 21:27:47.486 UTC
RP/0/RSP0/CPU0:May 15 21:13:50.304 UTC: usb_disk[69610]: %OS-SYSLOG-6-LOG_INFO : mounted device to /disk2:
RP/0/RSP0/CPU0:May 15 21:18:50.347 UTC: usb_disk[66997]: %OS-SYSLOG-6-LOG_INFO : disk removed /disk2:
RP/0/RSP0/CPU0:May 15 21:18:50.615 UTC: usb_disk[67016]: %OS-SYSLOG-6-LOG_INFO : disk removed RP/0/RSP0/CPU0:May 15 21:20:46.362 UTC: usb_disk[67216]: %OS-SYSLOG-6-LOG_INFO : mounted device to /disk2:


RP/0/RSP0/CPU0:CR2.DAL1#show filesystem
Wed May 15 21:15:59.776 UTC
File Systems:

Size(b) Free(b) Type Flags Prefixes
1014255616 1003970560 flash-disk rw disk0:
0 0 network rw tftp:
491065344 489840640 flash rw /misc/config
3561914368 3555708928 harddisk rw harddiska:
4073914368 2378563584 flash-disk rw disk2:
3561914368 3555708928 harddisk rw harddiskb:
2513158144 2449240064 flash-disk rw apphost:
5814747136 5796179968 harddisk rw harddisk:
0 0 network rw ftp:


RP/0/RSP0/CPU0:CR2.DAL1#dir disk2:
Wed May 15 21:16:06.655 UTC

Directory of disk2:
6 drwxr-xr-x 2 4096 May 3 18:32 System\ Volume\ Information
7 -rwxr-xr-x 1 106444800 May 2 23:15 ASR9K-x64-iosxr-px-k9-6.5.3.tar
8 -rwxr-xr-x 1 1588887552 Apr 23 11:43 asr9k-mini-x64-6.5.3.iso

3978432 kbytes total (2322816 kbytes free)



RP/0/RSP0/CPU0:CR2.DAL1#run
Wed May 15 21:16:09.650 UTC

[xr-vm_node0_RSP0_CPU0:~]$mount | grep usb /dev/vdd on /eusb type ext2 (rw,relatime,sync,errors=continue,user_xattr,acl)
/dev/vdg on /mnt/usb/vdg type vfat (rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro)


[xr-vm_node0_RSP0_CPU0:~]$ls /mnt/usb/vdg ASR9K-x64-iosxr-px-k9-6.5.3.tar System Volume Information asr9k-mini-x64-6.5.3.iso







From: Peter Bruno <brunopeter@gmail.com>
Sent: Wednesday, May 15, 2019 2:11 PM
To: Bryan Holloway <bryan@shout.net>
Cc: Erik Sundberg <ESundberg@nitelusa.com>; cisco-nsp@puck.nether.net
Subject: Re: [c-nsp] ASR9900 - Copy files from USB key

If you do a "dir ?" it should show you the possabilities... often "usb0:". The size of the usb stick matters sometimes. Try a small < 8G stick.

Peter

On Wed, May 15, 2019 at 1:36 PM Bryan Holloway <bryan@shout.net<mailto:bryan@shout.net>> wrote:

On 5/15/19 4:53 AM, Erik Sundberg wrote:
> Has anyone been able to install\copy software images from a USB key to a ASR9906. It take for ever to copy files from a http server, I would like to try from a USB key to see if it's faster.
>
> The router never recognizes the usb key when it put into the rsp. The Cisco Linux (Admin VM) also does not recognize it either.
>
> I am specifically running a Cisco ASR9906 with A99-RSP-SE 6.3.3 (32-bit). I am Upgrading to 6.3.3 64-bit then to 6.5.3 (64 bit) the current process take 3-4 hours.
>
>
> Thanks
>
> Erik


I've definitely copied files from a USB stick onto an ASR9001, so I can't imagine why you wouldn't be able to on a 990x platform. Pretty sure I did it on a 9006 with RP880s, but it's been awhile.

The trick is usually figuring out the correct device name. In my travels I've seen "usb:", "disk2:" ... ymmv.

_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net<mailto:cisco-nsp@puck.nether.net>
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/


--
Thank you,
Peter Bruno
609.335.6887 c

________________________________

CONFIDENTIALITY NOTICE: This e-mail transmission, and any documents, files or previous e-mail messages attached to it may contain confidential information that is legally privileged. If you are not the intended recipient, or a person responsible for delivering it to the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of any of the information contained in or attached to this transmission is STRICTLY PROHIBITED. If you have received this transmission in error please notify the sender immediately by replying to this e-mail. You must destroy the original transmission and its attachments without reading or saving in any manner. Thank you.
_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

________________________________

CONFIDENTIALITY NOTICE: This e-mail transmission, and any documents, files or previous e-mail messages attached to it may contain confidential information that is legally privileged. If you are not the intended recipient, or a person responsible for delivering it to the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of any of the information contained in or attached to this transmission is STRICTLY PROHIBITED. If you have received this transmission in error please notify the sender immediately by replying to this e-mail. You must destroy the original transmission and its attachments without reading or saving in any manner. Thank you.
_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

> On May 20, 2019, at 11:03 PM, Erik Sundberg <ESundberg@nitelusa.com> wrote:
>
> Little follow up.
>
> On a ASR9906 6.3.3 (32bit) the usb key comes up as usb: but on 6.3.3 (64-bit) it's disk2:
>
>
> Copying the 6.3.3 migration files from a USB Key was 182 seconds, with HTTP it was around 1 hour. (1.3 G File)
> Doing a install add source 6.5.3 64-bit from a USB Key was 15 minutes and using http was an 1 1/2 hours. (1.5 G File)
>
> So sourcing files from a USB key are 4x times... Which is to be expected.
>
> The bandwidth to the HTTP server is 100M and <30msec latency, but the circuit was never maxed. For some reason coping from a HTTP server is just super slow…
>

Do you have selective-ack enabled?

Try these and see if your TCP is better:

tcp selective-ack
tcp window-size 65535

We had issues with this in the past at my prior employer and these options solved much of it. I’m trying to recall if we ever got the window scaling stuff fixed but I forget. I think their TCP stack didn’t do window scaling if you tcpdump it. It might be different in eXR.

- Jared

_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

> > On May 20, 2019, at 11:03 PM, Erik Sundberg <ESundberg@nitelusa.com> wrote:
> >
> > Little follow up.
> >
> > On a ASR9906 6.3.3 (32bit) the usb key comes up as usb: but on 6.3.3 (64-bit) it's disk2:
> >
> >
> > Copying the 6.3.3 migration files from a USB Key was 182 seconds, with HTTP it was around 1 hour. (1.3 G File)
> > Doing a install add source 6.5.3 64-bit from a USB Key was 15 minutes and using http was an 1 1/2 hours. (1.5 G File)
> >
> > So sourcing files from a USB key are 4x times... Which is to be expected.
> >
> > The bandwidth to the HTTP server is 100M and <30msec latency, but the circuit was never maxed. For some reason coping from a HTTP server is just super slow…
> >
>
> Do you have selective-ack enabled?
>
> Try these and see if your TCP is better:
>
> tcp selective-ack
> tcp window-size 65535
>
> We had issues with this in the past at my prior employer and these options solved much of it. I’m trying to recall if we ever got the window scaling stuff fixed
but I forget. I think their TCP stack didn’t do window scaling if you
tcpdump it. It might be different in eXR.


On cXR I had a similar experainces to Erik, copying via a network
protocol was very slow (circa 1-2 hours) but copying via USB was
significantly faster (just minutes).

I recently upgraded from eXR 6.5.2 to 6.5.3 and pushed the files using
SCP to the router from a jump box, which was on the same LAN as the
management interface on the RSP. It was copying at 100Mbps (the speed
of the OOB switch) so I think in eXR these issues are more or less
fixed.

Cheers,
James.
_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

> On Jun 2, 2019, at 3:50 AM, James Bensley <jwbensley+cisco-nsp@gmail.com> wrote:
>
>
> I recently upgraded from eXR 6.5.2 to 6.5.3 and pushed the files using
> SCP to the router from a jump box, which was on the same LAN as the
> management interface on the RSP. It was copying at 100Mbps (the speed
> of the OOB switch) so I think in eXR these issues are more or less
> fixed.

I don’t believe you have enough data to conclude that. When copying data from longer distances away (eg: global network with centralized file server/images) I previously saw bad behavior, but when the latency was low it worked well.

This is what led me down the path to determine what was going on with the XR TCP stack. I suggest capturing a PCAP and figuring out if it’s doing SACK or window scaling with appropriate sized buffers.

Even from bash/run on eXR you may also want to check this out. This led to an effort to internally anycast resources as it was a problem that was easier solved that way as Cisco was afraid to fix the TCP stack, and got even more worried when we saw issues with their SACK implementation and reported the details. (It was doing an ACK of the wrong number of bytes, which caused drama with super strict stateful firewalls that tried to be too smart for their own good).

Also beware TCP disconnects as they don’t do TCP keepalives by default so any session that drops in the middle of a transfer would cause it to act like a file transfer is ongoing even though TCP was dead).

- Jared
_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/

On Sun, 2 Jun 2019 at 18:35, Jared Mauch <jared@puck.nether.net> wrote:
>
>
>
> > On Jun 2, 2019, at 3:50 AM, James Bensley <jwbensley+cisco-nsp@gmail.com> wrote:
> >
> >
> > I recently upgraded from eXR 6.5.2 to 6.5.3 and pushed the files using
> > SCP to the router from a jump box, which was on the same LAN as the
> > management interface on the RSP. It was copying at 100Mbps (the speed
> > of the OOB switch) so I think in eXR these issues are more or less
> > fixed.
>
> I don’t believe you have enough data to conclude that. When copying data from longer distances away (eg: global network with centralized file server/images) I previously saw bad behavior, but when the latency was low it worked well.

Right, that's why I made a vague statement.

> This is what led me down the path to determine what was going on with the XR TCP stack. I suggest capturing a PCAP and figuring out if it’s doing SACK or window scaling with appropriate sized buffers.
>
> Even from bash/run on eXR you may also want to check this out. This led to an effort to internally anycast resources as it was a problem that was easier solved that way as Cisco was afraid to fix the TCP stack, and got even more worried when we saw issues with their SACK implementation and reported the details. (It was doing an ACK of the wrong number of bytes, which caused drama with super strict stateful firewalls that tried to be too smart for their own good).
>
> Also beware TCP disconnects as they don’t do TCP keepalives by default so any session that drops in the middle of a transfer would cause it to act like a file transfer is ongoing even though TCP was dead).

All good info. I was just adding an anecdote that I have personally
experienced very slow TCP transfer times on cXR and much faster times
on eXR (my slow experiances on cXR were also when copying from a jump
box on on the OOB LAN). I am semi interested to dig deeper but for me
it's plenty "fast enough" now so it doesn't warrant any more time.

Cheers,
James.
_______________________________________________
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/