X-Recipient: archive-cygwin AT delorie DOT com
X-Spam-Check-By: sourceware.org
Message-Id: <DF0BF6FF-18D5-46E4-BB66-F91DDDB337F2@reading.ac.uk>
From: Fred Kemp <c DOT f DOT kemp AT reading DOT ac DOT uk>
To: cygwin AT cygwin DOT com
In-Reply-To: <608FDCB69DC3424E910F4B4475783509@multiplay.co.uk>
Content-Type: text/plain; charset=WINDOWS-1252; format=flowed; delsp=yes
Mime-Version: 1.0 (Apple Message framework v929.2)
Subject: Re: rsync 3.0.4 over ssh hanging on cygwin 1.7
Date: Tue, 18 Nov 2008 17:45:38 +0000
References: <F15A8659-3A0B-4321-AB7D-D1D24CB2C2FA AT reading DOT ac DOT uk> <9BE21462-809A-4E12-A587-B3648BC4F4D9 AT reading DOT ac DOT uk> <608FDCB69DC3424E910F4B4475783509 AT multiplay DOT co DOT uk>
X-Mailer: Apple Mail (2.929.2)
X-IsSubscribed: yes
Mailing-List: contact cygwin-help AT cygwin DOT com; run by ezmlm
Precedence: bulk
List-Id: <cygwin.cygwin.com>
List-Unsubscribe: <mailto:cygwin-unsubscribe-archive-cygwin=delorie DOT com AT cygwin DOT com>
List-Subscribe: <mailto:cygwin-subscribe AT cygwin DOT com>
List-Archive: <http://sourceware.org/ml/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-help AT cygwin DOT com>, <http://sourceware.org/ml/#faqs>
Sender: cygwin-owner AT cygwin DOT com
Mail-Followup-To: cygwin AT cygwin DOT com
Delivered-To: mailing list cygwin AT cygwin DOT com
Content-Transfer-Encoding: 8bit
X-MIME-Autoconverted: from quoted-printable to 8bit by delorie.com id mAIHkh91021641

Hi Steve,

Hmmm, thanks for confirming what I pessimistically suspected but  
optimistically hoped to be corrected on. Unfortunately our data files  
are frequently in the 3-4Gb range so it sounds like SFU is unlikely to  
be an option either.

Would like to persist with cygwin as we use it for some of our  
proteomics tools. I guess I'll have to ditch the security and try  
rsyncd (just as soon as I can get on the client machines and add yet  
another exception to the Windoze firewall) –  unless anyone else has  
any thoughts or suggestions?

Cheers,

Fred.


On Nov 18, 2008, at 5:25 PM, Steven Hartland wrote:

> rsync over ssh and cygwin don't play nice and likely never will.  
> Either
> avoid using rsync or use it in daemon mode avoiding ssh which is where
> the problem really lies ( the interaction between rsync and ssh ).
>
> A good alternative to cygwin for this is SFU but be aware that most
> versions only support 32bit files so less than 2GB.
>
>   Regards
>   Steve
>
> ----- Original Message ----- From: "Fred Kemp"  
> <c DOT f DOT kemp AT reading DOT ac DOT uk>
>
>
>> Good afternoon all,
>> Please excuse my cygwin newbie status if I have missed something   
>> obvious.
>> Having resolved the "overly long file name" issue with rsync in  
>> cygwin  1.5 by upgrading to version 1.7, I have hit a new problem,  
>> namely  rsync hanging midway through transfer. No errors are  
>> reported or  logged, nothing seems to be timing out, it just sits  
>> there  indefinitely. Re-running rsync will maybe do a couple more  
>> files then  hang again, and again, and again... Having read around  
>> tinternet, it  seems I am not completely alone in this problem, but  
>> I have yet to  find a solution that works for me. Briefly:
>> I have set up ssh-keyless authentication between my server (OsX   
>> 10.5.5, rsync 3.0.4, OpenSSH 5.1p1) and a dozen or so PC's running   
>> XPsp2 (cygwin 1.7,  rsync 3.0.4, OpenSSH 5.1p1) and use rsync to   
>> mirror user directories on the PC's to my server, as follows:
>> rsync --verbose --progress --stats --rsh=/usr/bin/ssh --archive \
>> Administrator AT clientPC:"/cygdrive/c/Documents\ and\ Settings/  
>> userdirectory/" /Users/userdirectory/
>> This is in effect identical to the method I use to mirror data  
>> between  two OsX servers, where it can happily handle several  
>> terabytes of data  and millions of files. I have tried rsyncing  
>> individual subdirectories  in a userdirectory and that works fine  
>> but still it hangs when the  whole directory is tried again.  
>> Similarly, one or two of the smaller  user directories (around  
>> 15,000 files and 35Gb data) work fine. Over  around 30,000 files  
>> seems to be where I have the problem...
>> What is really strange is that if I run the rsync from the client  
>> PC  to the server, it works fine, and subsequent rsyncs from the  
>> server  also work fine (presumably since hardly any files have  
>> changed)...
>> At this stage I am somewhat stumped and would appreciate any  
>> pointers  the gurus can give, even as to whether this is believed  
>> to be an  rsync, sshd or underlying cywin issue... Very happy to  
>> provide further  info as required, or to be shot down in flames  
>> should I have done  something stupid! ;-)
>> Thanks in advance,
>> Fred.
>> --
>> Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
>> Problem reports:       http://cygwin.com/problems.html
>> Documentation:         http://cygwin.com/docs.html
>> FAQ:                   http://cygwin.com/faq/
>>
>


--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/