What's the best way to transfer files between pogoplugs

[momentum]

I bought two Pogoplug pro and installed Arch Linux on both of them following the tutorial. Each of them are connected with several external HDs. I want to transfer some large files from the HD on one Pogoplug to the HD on the other Pogoplug. Both Pogoplugs start Samba service and all HDs are formatted with ext3. Right now I could only use my desktop (win7) to do the copy-paste and only got ~12M/s speed. I know this is dumb and there got to be faster and more efficient way to do this job between Linux server.

Could someone give me any advice? Thanks a lot!

[WarheadsSE]

Sure,
- copy directly, instead of from Windows (via samba)
- make sure the copy is over ethernet, not wireless
- use rsync, if possible
- depending on the speed of actual disks, that might be a hamper.

The best I have managed is about 22MB/s sustained, which is 170Mb/s over gigabit ethernet. Throw wireless in its place and it would have capped at ~15MB/s, maybe. The fact that there is not 1 GB of RAM makes a huge difference to what people are accustomed to as ""normal""

[momentum]

WarheadsSE, thanks a lot!

the drive I am talking are all new WD USB3.0(2.0 compatible) drive. I am using ethernet (gigabit, one connected to gigabit router, one connected to gigabit switch then the switch and router are connected of course). I am looking into installing rsync on my pogo, thanks for the suggestion.

btw, could you elaborate a bit about how to copy directly? That's something I am interested too. I know cp, but that only work under the same system, right?

$this->bbcode_second_pass_quote('WarheadsSE', 'S')ure,
- copy directly, instead of from Windows (via samba)
- make sure the copy is over ethernet, not wireless
- use rsync, if possible
- depending on the speed of actual disks, that might be a hamper.

The best I have managed is about 22MB/s sustained, which is 170Mb/s over gigabit ethernet. Throw wireless in its place and it would have capped at ~15MB/s, maybe. The fact that there is not 1 GB of RAM makes a huge difference to what people are accustomed to as ""normal""

[WarheadsSE]

cp command:
Not at all! Mounting a network file system makes it look, just like it is local

mount -t cifs -o username=none,rw //hostname/share /destination/directory

[momentum]

smart! thanks a lot!

$this->bbcode_second_pass_quote('WarheadsSE', 'c')p command:
Not at all! Mounting a network file system makes it look, just like it is local

mount -t cifs -o username=none,rw //hostname/share /destination/directory

[jkgm]

You definitely don't want to try to use Samba when you could use rsync (over ssh). Try this command instead from pogoplug1, and don't forget to man rsync for information on all the flags. Also make sure to include the trailing slashes for paths with rsync.
$this->bbcode_second_pass_code('', 'rsync -WavxP --inplace /local/path/on/pogoplug1/ username@pogoplug2:/remote/path/on/pogoplug2/')
Here's an example that I used for backup. The username for the destination can be omitted if it's the same as the account you're using on the source.
$this->bbcode_second_pass_code('', 'rsync -WavxP --inplace /media/datadrive/ 192.168.1.3:/media/backupdrive/')
Edit: added the -W flag that I forgot before. It significantly improves performance on a LAN.

[momentum]

Interesting. I was about to ask why I still get a slow speed. I use rsync with samba (mount cifs) and I only got about 6M/s. Then I found your post and try this but only got about 4M/s
$this->bbcode_second_pass_code('', 'rsync -P /local/path/on/pogoplug1/ username@pogoplug2:/remote/path/on/pogoplug2/')

at first I only have rsync installed on pogoplug1, but it didn't work. then I installed rsync on pogoplug2, but only got 4M/s. Both methods are slower than what I got under win7 (~13M/s). I don't know what might be the reason that slow down the speed.


$this->bbcode_second_pass_quote('jkgm', 'Y')ou definitely don't want to try to use Samba when you could use rsync (over ssh). Try this command instead from pogoplug1, and don't forget to man rsync for information on all the flags. Also make sure to include the trailing slashes for paths with rsync.
$this->bbcode_second_pass_code('', 'rsync -avxP --inplace /local/path/on/pogoplug1/ username@pogoplug2:/remote/path/on/pogoplug2/')
Here's an example that I used for backup. The username for the destination can be omitted if it's the same as the account you're using on the source.
$this->bbcode_second_pass_code('', 'rsync -avxP --inplace /media/datadrive/ 192.168.1.3:/media/backupdrive/')

[WarheadsSE]

That rsync method uses ssh, which isn't exactly the worlds most performant network transport.

[momentum]

I tried your mount cifs + rsync, but only got about 6MB/s. Am I making mistakes here? I set up samba on pogoplug2, then mount this share on pogoplug1.

Thanks anyway!

$this->bbcode_second_pass_quote('WarheadsSE', 'T')hat rsync method uses ssh, which isn't exactly the worlds most performant network transport.

[WarheadsSE]

Have you tried `cp -ar` ?