archarm64 - issue with big files over network?

This forum is for topics dealing with problems with software specifically in the AArch64 repo.

archarm64 - issue with big files over network?

Postby ufo6000 » Sun Sep 30, 2018 9:11 am

I'm using the rpi3 as NAS, trying to migrate to a new one with aarch64.

Storing files files from my Desktop PC --> NAS is without problem.
Problem is the fetching of big files from my NAS --> Desktop PC.
The transfer starts, small files are ok, but big files can't be transferred:

    * PCmanFM ssh/gvfs - freezes
    * sftp - get stalled / packet_write_wait: Connection to x.x.x.x port 22: Broken pipe
    * rsync over ssh - sync: connection unexpectedly closed (16575569 bytes received so far) [receiver]
    rsync error: error in rsync protocol data stream (code 12) at io.c(226) [receiver=3.1.3]
    * sshfs - rsync: read errors mapping "/d/nas/file.mp4": Input/output error (5)

- md5 checksum is fine on the NAS on a big test file
- smart reports no issues (NAS + Desktop)
- BTRFS filesystem loaded without error
- no infos in demesg

What could be the problem, on fetching big files, but not in storing (md5 verified) ?
How to investigate further ?

Thanks very much
ufo6000
 
Posts: 117
Joined: Fri Jan 22, 2016 7:54 pm

Re: archarm64 - issue with big files over network?

Postby graysky » Sun Sep 30, 2018 9:32 am

1) How is the RPi3 connected, wired or wireless?
2) How is the Desktop PC connected?
3) When you ran armv7h on the same hardware, did large transfers work without issue on an otherwise IDENTICAL setup?
graysky
Developer
 
Posts: 1728
Joined: Sun Jun 26, 2011 6:56 am
Location: /run/user/1000

Re: archarm64 - issue with big files over network?

Postby summers » Sun Sep 30, 2018 9:37 am

Yes something odd going on. My NAS (NSA325) has arch on it, I back up to it regularly using rsync over ssh. I've transferred big files without any problems. NAS has btrfs btw (with compression).

How big files are you transferring - let me know and I'll try a test ..
summers
 
Posts: 984
Joined: Sat Sep 06, 2014 12:56 pm

Re: archarm64 - issue with big files over network?

Postby ufo6000 » Sun Sep 30, 2018 11:06 am

1) rpi3+ wired
2) desktop wired, 1000mbit switch between them
3) I will check... good idea.
4) small md5 files work, 66MB linux-aarch64-4.18.10-1-aarch64.pkg.tar.xz not

My old nas is rpi3 (without+) armv7l - not identical setup - but almost same setup - no problem with big files the last 2 years.
ufo6000
 
Posts: 117
Joined: Fri Jan 22, 2016 7:54 pm

Re: archarm64 - issue with big files over network?

Postby ufo6000 » Sun Sep 30, 2018 11:57 am

$this->bbcode_second_pass_quote('', '
')3) When you ran armv7h on the same hardware, did large transfers work without issue on an otherwise IDENTICAL setup?


my armv7l image won't work on the rpi3+
the eth device is not working - I got no carrier... maybe the os on the sd card is too old ?
ufo6000
 
Posts: 117
Joined: Fri Jan 22, 2016 7:54 pm

Re: archarm64 - issue with big files over network?

Postby graysky » Sun Sep 30, 2018 12:42 pm

It's something in your image... armv7h works fine on 3b+.
graysky
Developer
 
Posts: 1728
Joined: Sun Jun 26, 2011 6:56 am
Location: /run/user/1000

Re: archarm64 - issue with big files over network?

Postby ufo6000 » Tue Oct 02, 2018 6:35 pm

Thanks for the hint,
I retested now with a vanilla installation on a bootable 2.5 hdd on my latest rpi3+:

* ArchLinuxARM-rpi-2-latest.tar.gz
* ArchLinuxARM-rpi-3-latest.tar.gz
from 2018-09-01.

Testing transfer, sftp
Desktop --> pi3+ --> md5 check --> pi3+ --> Desktop

Result:
armv7: no problems
arm64: same problem as initial posted:
Desktop --> pi3+ --> md5 check: OK --> pi3+ --> Desktop: sftp get stalled !!!

$this->bbcode_second_pass_code('', '
[root@alarm test]# cat /proc/net/dev
Inter-| Receive | Transmit
face |bytes packets errs drop fifo frame compressed multicast|bytes packets errs drop fifo colls carrier compressed
eth0: 3589807894 2435972 16 16 0 16 0 0 116826203 1252087 2 2 0 0 0 0
wlan0: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
lo: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
')

Test procedure
$this->bbcode_second_pass_code('', '
# PUT
cd /d/d1/@t/test/
sftp root@alarmpi
cd /mnt/@d/test/
put -r *

# on rpi:
md5sum -c *.md5

# GET
cd /d/d1/@t/test2/
sftp root@alarmpi
cd /mnt/@d/test/
get -r
')

PUT:
$this->bbcode_second_pass_code('', '
/mnt/@d/test/fantastic4.mp4 100% 798MB 17.5MB/s 00:45
')

GET:
$this->bbcode_second_pass_code('', '
Fetching /mnt/@d/test/fantastic4.mp4 to fantastic4.mp4
/mnt/@d/test/fantastic4.mp4 93% 744MB 0.0KB/s - stalled -
')
As you can see, a limited number of data are sent, but then it freezes, even if I restart the sftp.

Changes on the vanilla installation:
- /etc/ssh/sshd_config - to allow root sftp
- /etc/fstab - remove boot partition entry
- armv7: /boot/cmdline.txt - change root device to sda2
- arm64: /boot/boot.txt - change root device to sda2 + run ./mkscr


And now it gets weird:

I found this info:
$this->bbcode_second_pass_quote('', '
')If a 10/100Mb network is connected then the green light will illuminate and then flash when there is network activity. The orange light will remain off.
When there is a Gigabit network attached, the green light stays off but the orange one lights up and flashes.


on my rpi3+
armv7: orange lan led blinks
arm64: no lan led light or blinks
ufo6000
 
Posts: 117
Joined: Fri Jan 22, 2016 7:54 pm

Re: archarm64 - issue with big files over network?

Postby graysky » Tue Oct 02, 2018 7:33 pm

I have found armv7h to be more reliable than aarch64 on RPi3B+ ... I do not know why (kernel version differences)? When i build the linux kernel on an aarch64 image using distccd, I get kernel panics whereas when I build the corresponding kernel package (for armv7h not aarch64) with distccd on the same hardware under armv7h, I get no issues.

You can continue to troubleshoot if you want, but if you'd rather have a stable NAS again, I recommend returning to armv7h. hat is your driving force for using aarch64 on this hardware? What can't you do with armv7h on the hardware?
graysky
Developer
 
Posts: 1728
Joined: Sun Jun 26, 2011 6:56 am
Location: /run/user/1000

Re: archarm64 - issue with big files over network?

Postby ufo6000 » Wed Oct 03, 2018 8:15 am

Last test with archarm64:

Full pacman upgrade:
$this->bbcode_second_pass_code('', '
Linux alarm 4.18.5-1-ARCH #1 SMP Fri Aug 24 18:33:45 MDT 2018 aarch64 GNU/Linux
Linux alarm 4.18.11-1-ARCH #1 SMP Sat Sep 29 11:08:58 MDT 2018 aarch64 GNU/Linux
')

$this->bbcode_second_pass_code('', '
sftp> get -r *
Fetching /mnt/@d/test/fantastic4.md5 to fantastic4.md5
/mnt/@d/test/fantastic4.md5 100% 49 29.1KB/s 00:00
Fetching /mnt/@d/test/fantastic4.mp4 to fantastic4.mp4
/mnt/@d/test/fantastic4.mp4 92% 735MB 0.0KB/s - stalled -
')

:( :( :( :(

Thanks for your evaluation graysky, I will stick with armv7 for now :)
ufo6000
 
Posts: 117
Joined: Fri Jan 22, 2016 7:54 pm

Re: archarm64 - issue with big files over network?

Postby jonandermb » Sun Nov 04, 2018 9:34 am

Piggybacking on this thread. I come from here: viewtopic.php?f=31&t=13223&p=59927#p59927

Sad to see the only solution is to go back to armv7.

Is there a way to open an issue so they try to fix our issue?
jonandermb
 
Posts: 21
Joined: Fri Jan 10, 2014 7:44 pm


Return to ARMv8

Who is online

Users browsing this forum: No registered users and 6 guests