Mailing List Archive

Moving data from NT to NetApp painfully slow
Hi Toasters,

we're in the process of consolidating NT file services on a NetApp Filer. We
have an F810 where we want to store all our user's data which is now spread
across multiple servers, some of which are close to being maxed out. We now
have the problem of moving all the data while we're still servicing our
users - we're on 24/7 here. We found that copying the data to the filer is
painfully slow; we're suspecting that NT ACLs might be the culprit. We've
tried robocopy, secure copy and xxcopy to no avail - moving a small part of
the total data took 15 hours. Anybody out there willing to share their
experiences with moving several hundreds of GB across the network? We need
to keep NT permissions, obviously. On the mailing list I saw references to
Fastlane and Aelita's SCW - any experience with those or other 3rd party
products?

Greetings and thanks in advance

Bernhard

--
Bernhard Friedrich
ZIM Uniklinikum Heidelberg
Unix/NT administration
RE: Moving data from NT to NetApp painfully slow [ In reply to ]
We've moved about 500G to the filer from our file servers using SecureCopy.
Have you checked the port speed and duplex settings on your servers and
switches and filer. We have found that if they don't match you will have
excruciating performance.

-----Original Message-----
From: Friedrich, Bernhard [mailto:Bernhard.Friedrich@med.uni-heidelberg.de]
Sent: Friday, September 20, 2002 9:29 AM
To: 'toasters@mathworks.com'
Subject: Moving data from NT to NetApp painfully slow


Hi Toasters,

we're in the process of consolidating NT file services on a NetApp Filer. We
have an F810 where we want to store all our user's data which is now spread
across multiple servers, some of which are close to being maxed out. We now
have the problem of moving all the data while we're still servicing our
users - we're on 24/7 here. We found that copying the data to the filer is
painfully slow; we're suspecting that NT ACLs might be the culprit. We've
tried robocopy, secure copy and xxcopy to no avail - moving a small part of
the total data took 15 hours. Anybody out there willing to share their
experiences with moving several hundreds of GB across the network? We need
to keep NT permissions, obviously. On the mailing list I saw references to
Fastlane and Aelita's SCW - any experience with those or other 3rd party
products?

Greetings and thanks in advance

Bernhard

--
Bernhard Friedrich
ZIM Uniklinikum Heidelberg
Unix/NT administration
Re: Moving data from NT to NetApp painfully slow [ In reply to ]
A coworker of mine states that running robocopy on a multi-CPU box copying
data from NTFS partitions with compression turned on will never finish.
There is a utility called imagecfg.exe that allows you to create a copy of
robocopy.exe which assigns it to a given CPU and does not allow it to
change between CPUs.

If you want a copy of this utility, contact me directly. If you're not
using NTFS with compression enabled, disregard this :)

/Brian/


> Hi Toasters,
>
> we're in the process of consolidating NT file services on a NetApp Filer. We
> have an F810 where we want to store all our user's data which is now spread
> across multiple servers, some of which are close to being maxed out. We now
> have the problem of moving all the data while we're still servicing our
> users - we're on 24/7 here. We found that copying the data to the filer is
> painfully slow; we're suspecting that NT ACLs might be the culprit. We've
> tried robocopy, secure copy and xxcopy to no avail - moving a small part of
> the total data took 15 hours. Anybody out there willing to share their
> experiences with moving several hundreds of GB across the network? We need
> to keep NT permissions, obviously. On the mailing list I saw references to
> Fastlane and Aelita's SCW - any experience with those or other 3rd party
> products?
>
> Greetings and thanks in advance
>
> Bernhard
>
> --
> Bernhard Friedrich
> ZIM Uniklinikum Heidelberg
> Unix/NT administration
>

--
Brian Long | | |
Americas IT Hosting Sys Admin | .|||. .|||.
Phone: (919) 392-7363 | ..:|||||||:...:|||||||:..
Pager: (888) 651-2015 | C i s c o S y s t e m s
Re: Moving data from NT to NetApp painfully slow [ In reply to ]
I disagree, we have copied numerous Terabytes of Data from NT/Novell servers
to Filers using Robocopy. I am not saying it is the best solution but the
best we found with keeping ACLs in place.


>From: Brian Long <brilong@cisco.com>
>To: "Friedrich, Bernhard" <Bernhard.Friedrich@med.uni-heidelberg.de>
>CC: "'toasters@mathworks.com'" <toasters@mathworks.com>
>Subject: Re: Moving data from NT to NetApp painfully slow
>Date: Fri, 20 Sep 2002 11:53:57 -0400 (EDT)
>
>A coworker of mine states that running robocopy on a multi-CPU box copying
>data from NTFS partitions with compression turned on will never finish.
>There is a utility called imagecfg.exe that allows you to create a copy of
>robocopy.exe which assigns it to a given CPU and does not allow it to
>change between CPUs.
>
>If you want a copy of this utility, contact me directly. If you're not
>using NTFS with compression enabled, disregard this :)
>
>/Brian/
>
>
> > Hi Toasters,
> >
> > we're in the process of consolidating NT file services on a NetApp
>Filer. We
> > have an F810 where we want to store all our user's data which is now
>spread
> > across multiple servers, some of which are close to being maxed out. We
>now
> > have the problem of moving all the data while we're still servicing our
> > users - we're on 24/7 here. We found that copying the data to the filer
>is
> > painfully slow; we're suspecting that NT ACLs might be the culprit.
>We've
> > tried robocopy, secure copy and xxcopy to no avail - moving a small part
>of
> > the total data took 15 hours. Anybody out there willing to share their
> > experiences with moving several hundreds of GB across the network? We
>need
> > to keep NT permissions, obviously. On the mailing list I saw references
>to
> > Fastlane and Aelita's SCW - any experience with those or other 3rd party
> > products?
> >
> > Greetings and thanks in advance
> >
> > Bernhard
> >
> > --
> > Bernhard Friedrich
> > ZIM Uniklinikum Heidelberg
> > Unix/NT administration
> >
>
>--
> Brian Long | | |
> Americas IT Hosting Sys Admin | .|||. .|||.
> Phone: (919) 392-7363 | ..:|||||||:...:|||||||:..
> Pager: (888) 651-2015 | C i s c o S y s t e m s
>




_________________________________________________________________
Send and receive Hotmail on your mobile device: http://mobile.msn.com
RE: Moving data from NT to NetApp painfully slow [ In reply to ]
I have to concur with the below. We have moved Terabytes of Data using
Robocopy with no problems at all.

-----Original Message-----
From: Seth Moskowitz [mailto:sethmoskowitz@hotmail.com]
Sent: 25 September 2002 16:26
To: brilong@cisco.com; Bernhard.Friedrich@med.uni-heidelberg.de
Cc: toasters@mathworks.com
Subject: Re: Moving data from NT to NetApp painfully slow


I disagree, we have copied numerous Terabytes of Data from NT/Novell servers

to Filers using Robocopy. I am not saying it is the best solution but the
best we found with keeping ACLs in place.


>From: Brian Long <brilong@cisco.com>
>To: "Friedrich, Bernhard" <Bernhard.Friedrich@med.uni-heidelberg.de>
>CC: "'toasters@mathworks.com'" <toasters@mathworks.com>
>Subject: Re: Moving data from NT to NetApp painfully slow
>Date: Fri, 20 Sep 2002 11:53:57 -0400 (EDT)
>
>A coworker of mine states that running robocopy on a multi-CPU box copying
>data from NTFS partitions with compression turned on will never finish.
>There is a utility called imagecfg.exe that allows you to create a copy of
>robocopy.exe which assigns it to a given CPU and does not allow it to
>change between CPUs.
>
>If you want a copy of this utility, contact me directly. If you're not
>using NTFS with compression enabled, disregard this :)
>
>/Brian/
>
>
> > Hi Toasters,
> >
> > we're in the process of consolidating NT file services on a NetApp
>Filer. We
> > have an F810 where we want to store all our user's data which is now
>spread
> > across multiple servers, some of which are close to being maxed out. We
>now
> > have the problem of moving all the data while we're still servicing our
> > users - we're on 24/7 here. We found that copying the data to the filer
>is
> > painfully slow; we're suspecting that NT ACLs might be the culprit.
>We've
> > tried robocopy, secure copy and xxcopy to no avail - moving a small part

>of
> > the total data took 15 hours. Anybody out there willing to share their
> > experiences with moving several hundreds of GB across the network? We
>need
> > to keep NT permissions, obviously. On the mailing list I saw references
>to
> > Fastlane and Aelita's SCW - any experience with those or other 3rd party
> > products?
> >
> > Greetings and thanks in advance
> >
> > Bernhard
> >
> > --
> > Bernhard Friedrich
> > ZIM Uniklinikum Heidelberg
> > Unix/NT administration
> >
>
>--
> Brian Long | | |
> Americas IT Hosting Sys Admin | .|||. .|||.
> Phone: (919) 392-7363 | ..:|||||||:...:|||||||:..
> Pager: (888) 651-2015 | C i s c o S y s t e m s
>




_________________________________________________________________
Send and receive Hotmail on your mobile device: http://mobile.msn.com


=========================================================
This electronic message contains information from the mmO2 plc Group
which may be privileged or confidential. The information is intended to be
for the use of the individual(s) or entity named above. If you are not the
intended recipient be aware that any disclosure, copying, distribution or
use of the contents of this information is prohibited. If you have received
this electronic message in error, please notify us by telephone or email
(to the numbers or address above) immediately.
=========================================================