This is the mail archive of the cygwin mailing list for the Cygwin project.


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]
Other format: [Raw text]

1.5.24: rsync slow when env variable cygwin=noNTsec


Hi,

	I use rsync intensively to backup data from server to server over
WAN and LAN link.  The "Backup servers" are always windows 2003 server.  The
source can be both Windows and Linux.  In most of the cases the source has
the daemon running and the backup server run the client as scheduled task.
I also do local to local.  I use the --linkdest= option (NTFS Hardlink) but
the problem occurs even if I don't use the linkdest option.

	I tried many different version of rsync (2.6.9, 3.0.2, 2.6.8) as
well as many different version of cygwin1.dll (1.5.22, 23, 24) and I always
have the same results.

	For instance to sync 51 Gb of data on a 100Mb LAN link with 3GB of
data that has change.  It will take 9 minutes if Cygwin=ntsec and 49 minutes
if cygwin=noNTsec.

	Here is an example of the command I'm using:
RSYNC.EXE -r -t -W --delete-during -v --stats --human-readable
--link-dest="/CYGDRIVE/E/KLB/KLBFIL01/MON/" "/CYGDRIVE/D/SHARE/"
"/CYGDRIVE/E/KLB/KLBFIL01/TUE/" 1>log.txt 2> err.txt

	For Now I run my job with ntsec and do a ACL reset when the sync in
completed but it takes some additional backup times (I have between 50 000
to 1 700 000 files per server to sync)

	To give more information about the environment we have AD 2003,
Windows servers are always 2003, linux server are Red Hat.  The problem is
also present on Windows XP.

	Here is the log file I produce from rSync.  First with noNtSec then
same job with ntSec

11/2/2007 9:00:01 PM: CMD = Omni_Friday.BAT 10.71.101.59::OmniDay
/CYGDRIVE/E/KLB/OMNI/Friday/ -v -r -z -t --stats --delete-after
--human-readable --log-file=Omni_Friday_LOG.TXT
11/2/2007 9:48:58 PM: 10.71.101.59::OmniDay = 0 - Success  
Size = 3.33G bytes/51.64G bytes
Time List/DL = 4.568 seconds/0.000 seconds
Qte files = 991/89911 files.

10/26/2007 9:00:02 PM: CMD = Omni_Friday.BAT 10.71.101.59::OmniDay
/CYGDRIVE/E/KLB/OMNI/Friday/ -v -r -z -t --stats --delete-after
--human-readable --log-file=Omni_Friday_LOG.TXT
10/26/2007 9:09:52 PM: 10.71.101.59::OmniDay = 0 - Success  
Size = 3.30G bytes/51.58G bytes
Time List/DL = 7.748 seconds/0.000 seconds
Qte files = 833/89317 files.

Note that if the destination folder is empty there is no big difference
between ntsec and noNTsec, but if most of the files are there it will take
longer for rsync to start downloading the changed file if cygwin=nontsec.

Thanks for all the help you can bring and have a great day!

Rémy Côté

Attachment: cygcheck.out
Description: Binary data

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]