rsync crashing TCP stack

This forum is for all other ARMv5 devices

rsync crashing TCP stack

Postby campigenus » Sun Dec 30, 2012 7:18 am

OK, a bit of background first ...

For the last few months I have used simple rsync commands to sync a local directory to a remote machine:
"rsync -avz --delete /mnt/local /mnt/remote"

/mnt/remote is mounted via:
"sshfs -o allow_other root@remotemachine.no-ip.com:/mnt/shared /mnt/remote"

This has worked wonderfully and all was well. As of a couple days ago the rsync command starts OK and then a few minutes later the machine it's running on drops of the network. It still replies to pings, but that's all. No ssh, no VNC, no SMB access. Nothing. Nothing short of a power cycle brings it back to live.

I don't remember any recent updates to the apps used, and it's really miffing me.

Oh yeah, this morning I added a directory with a few thousand files locally, and I was able to do a "cp -a /mnt/local/NewDirectory /mnt/remote/NewDirectory" so the link to the remote site is OK.

Any ideas?
~~~
"Good behavior is the last refuge of mediocrity."
- Henry S. Haskins
campigenus
 
Posts: 38
Joined: Tue Feb 21, 2012 6:00 am

Re: rsync crashing TCP stack

Postby WarheadsSE » Sun Dec 30, 2012 4:32 pm

Checked any logs for crashes?
Core Developer
Remember: Arch Linux ARM is entirely community donation supported!
WarheadsSE
Developer
 
Posts: 6807
Joined: Mon Oct 18, 2010 2:12 pm

Re: rsync crashing TCP stack

Postby karog » Sun Dec 30, 2012 4:52 pm

Wild guess - maybe the compression is taxing things too much with all the new files? Try without it.
karog
 
Posts: 305
Joined: Thu Jan 05, 2012 7:55 pm

Re: rsync crashing TCP stack

Postby campigenus » Sun Dec 30, 2012 6:13 pm

$this->bbcode_second_pass_quote('WarheadsSE', 'C')hecked any logs for crashes?



Logs are empty. Yup, as in "0" length. :-(
~~~
"Good behavior is the last refuge of mediocrity."
- Henry S. Haskins
campigenus
 
Posts: 38
Joined: Tue Feb 21, 2012 6:00 am

Re: rsync crashing TCP stack

Postby campigenus » Sun Dec 30, 2012 6:14 pm

$this->bbcode_second_pass_quote('karog', 'W')ild guess - maybe the compression is taxing things too much with all the new files? Try without it.


I thought of that. But the same thing happens with directories that were unchanged and worked perfectly till now.
~~~
"Good behavior is the last refuge of mediocrity."
- Henry S. Haskins
campigenus
 
Posts: 38
Joined: Tue Feb 21, 2012 6:00 am

Re: rsync crashing TCP stack

Postby Geoff » Sun Dec 30, 2012 9:34 pm

$this->bbcode_second_pass_quote('campigenus', '/')mnt/remote is mounted via:
"sshfs -o allow_other root@remotemachine.no-ip.com:/mnt/shared /mnt/remote"

If you can install rsync on your remote machine also, then you might have more success by using rsync directly, rather than through sshfs.
Geoff
 
Posts: 231
Joined: Wed Mar 09, 2011 5:14 pm
Top

Re: rsync crashing TCP stack

Postby cyberic » Mon Dec 31, 2012 8:21 am

I happened to me at work when we had LOTS of files to transfer...
rsync seemed to keep a list of files to transfer, and that list ended up to eat all the memory...
could you watch the memory usage after running the command?
Image
cyberic
 
Posts: 71
Joined: Sun Jan 15, 2012 11:26 pm

Re: rsync crashing TCP stack

Postby campigenus » Mon Dec 31, 2012 9:51 am

$this->bbcode_second_pass_quote('Geoff', '')$this->bbcode_second_pass_quote('campigenus', '/')mnt/remote is mounted via:
"sshfs -o allow_other root@remotemachine.no-ip.com:/mnt/shared /mnt/remote"

If you can install rsync on your remote machine also, then you might have more success by using rsync directly, rather than through sshfs.


Unfortunately there is no way to add rsync to the other side, that would have been my first choice.
~~~
"Good behavior is the last refuge of mediocrity."
- Henry S. Haskins
campigenus
 
Posts: 38
Joined: Tue Feb 21, 2012 6:00 am
Top

Re: rsync crashing TCP stack

Postby campigenus » Mon Dec 31, 2012 9:56 am

$this->bbcode_second_pass_quote('cyberic', 'I') happened to me at work when we had LOTS of files to transfer...
rsync seemed to keep a list of files to transfer, and that list ended up to eat all the memory...
could you watch the memory usage after running the command?


I thought of that, so my first step was to increase swap to 1GB. Excessive, I know, but ... just in case. Anyhow, it is doing the same thing with directories that were syncable before, and which had no, or very small, changes.
~~~
"Good behavior is the last refuge of mediocrity."
- Henry S. Haskins
campigenus
 
Posts: 38
Joined: Tue Feb 21, 2012 6:00 am
Top

Re: rsync crashing TCP stack

Postby cyberic » Mon Dec 31, 2012 11:01 am

syncable or not, changed or not, do you have lots of source files and directories?
you could try with a subdirectory
Image
cyberic
 
Posts: 71
Joined: Sun Jan 15, 2012 11:26 pm

Next

Return to Community Supported

Who is online

Users browsing this forum: No registered users and 3 guests