Pogoplug v4 I/O performance issues, how to tweak?

This forum is for Marvell Kirkwood devices such as the GoFlex Home/Net, PogoPlug v1/v2, SheevaPlug, and ZyXEL devices.

Re: Pogoplug v4 I/O performance issues, how to tweak?

Postby tilllt » Sun Jun 08, 2014 9:59 am

Does anyone know if there is work being done on making exFat support more efficient in Linux?
I read there is proprietary, higher performance driver by Paragon, so i guess there must be some room for improvement...
tilllt
 
Posts: 14
Joined: Fri Jun 06, 2014 1:17 am

Re: Pogoplug v4 I/O performance issues, how to tweak?

Postby moonman » Sun Jun 08, 2014 5:50 pm

Samsung released GPLed exfat driver, but we cannot use it because we still need a license from M$ to use the code. You, however can use it on your own: https://gitorious.org/binbang/exfat-lin ... 6fad82621a:
And there's a package in AUR: https://aur.archlinux.org/packages/exfat-dkms-git/
Pogoplug V4 | GoFlex Home | Raspberry Pi 4 4GB | CuBox-i4 Pro | ClearFog | BeagleBone Black | Odroid U2 | Odroid C1 | Odroid XU4
-----------------------------------------------------------------------------------------------------------------------
[armv5] Updated U-Boot | [armv5] NAND Rescue System
moonman
Developer
 
Posts: 3388
Joined: Sat Jan 15, 2011 3:36 am

Re: Pogoplug v4 I/O performance issues, how to tweak?

Postby tilllt » Mon Jun 09, 2014 1:11 pm

Cool, thanks for the hint.
I think beyond the problem of ExFat there must be something wrong with my configuration, i don't even get close to the data rates mentioned by this guy:

http://fortysomethinggeek.blogspot.dk/2 ... eview.html

The fastest i can get is copying from ext3 to ext3 but that maxes out at around 30mb/s...
maybe somebody can repeat a drive to drive copy speed test and tell me if i should look further or if thats the max i can get. The guy from the blog mainly did iperf and dd copy tests (on single drives) so i guess the performance between two drives could be very different. maybe somebody can confirm that?

in "theory" everything looks great", in practice, when accessing a SMB share, copy data from one disk to another, things get really slow, sometimes even though the PPv4 is neither at 100%cpu nor memory...

iperf -c 192.168.1.246 -d
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 128 KByte (default)
------------------------------------------------------------
------------------------------------------------------------
Client connecting to 192.168.1.246, TCP port 5001
TCP window size: 129 KByte (default)
------------------------------------------------------------
[ 5] local 192.168.1.11 port 64305 connected with 192.168.1.246 port 5001
[ 6] local 192.168.1.11 port 5001 connected with 192.168.1.246 port 39089
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 97.8 MBytes 81.9 Mbits/sec
[ 6] 0.0-10.0 sec 101 MBytes 84.5 Mbits/sec
tilllt
 
Posts: 14
Joined: Fri Jun 06, 2014 1:17 am

Re: Pogoplug v4 I/O performance issues, how to tweak?

Postby swass » Tue Aug 12, 2014 3:38 am

swass
 
Posts: 27
Joined: Mon Aug 11, 2014 3:43 pm

Re: Pogoplug v4 I/O performance issues, how to tweak?

Postby moonman » Tue Aug 12, 2014 6:13 am

Great work. I might use a couple of your tweaks :)

A couple of things I found: noatime already implies nodiratime
deadline performed better on a spinning disk? last time I checked (2 years ago?) bfq gave a good performance boost over cfq and deadline. I might re-bench it again. ;)

EDIT: On GoFlex Home with samba around 65 down and 35 up. Though I did modify the config a bit because yours was giving me disconnects all the time: socket options add SO_KEEPALIVE and removed these
$this->bbcode_second_pass_code('', '# max xmit = 65535
# max connections = 8
# deadtime = 15
')

That is default max xmit anyway.

Good stuff :)
Pogoplug V4 | GoFlex Home | Raspberry Pi 4 4GB | CuBox-i4 Pro | ClearFog | BeagleBone Black | Odroid U2 | Odroid C1 | Odroid XU4
-----------------------------------------------------------------------------------------------------------------------
[armv5] Updated U-Boot | [armv5] NAND Rescue System
moonman
Developer
 
Posts: 3388
Joined: Sat Jan 15, 2011 3:36 am

Re: Pogoplug v4 I/O performance issues, how to tweak?

Postby swass » Tue Aug 12, 2014 2:57 pm

Thank you.

I added some additional notes based on your experience to the guide. Based on what I can find, your Seagate GoFlex has the 1200MHz processor which explains the better throughput. It also has more memory. I'm jealous. :)

Good point on the nodiratime -- I threw it in there as implied, but it isn't necessary. The same was true of the max xmit, just to imply that if it was set differently, one might consider changing it.

Typically you'll see deadline used with enterprise server applications, such as Oracle RDBMS when using block storage. Although it doesn't imply that under all cases deadline will be better -- people should always test based on what they use their systems for. Benchmark tools are great, but they are synthetic and don't represent all real-world uses.
swass
 
Posts: 27
Joined: Mon Aug 11, 2014 3:43 pm

Re: Pogoplug v4 I/O performance issues, how to tweak?

Postby WarheadsSE » Tue Aug 12, 2014 3:45 pm

Nicely done. This should, in theory, be applicable for most of the Kirkwoods. I will have to re-visit my NSA325 (1.6Ghz w/ 512M, 2x SATA) And see how that memory and CPU impacts it.
Core Developer
Remember: Arch Linux ARM is entirely community donation supported!
WarheadsSE
Developer
 
Posts: 6807
Joined: Mon Oct 18, 2010 2:12 pm

Re: Pogoplug v4 I/O performance issues, how to tweak?

Postby swass » Tue Aug 12, 2014 4:45 pm

It would be interesting to see your results and whether or not buffered i/o has the same negative impact on i/o performance as with the slower Pogoplug v4. If I can find one cheap enough, I might look into getting one of those devices like yours.
swass
 
Posts: 27
Joined: Mon Aug 11, 2014 3:43 pm

Re: Pogoplug v4 I/O performance issues, how to tweak?

Postby WarheadsSE » Tue Aug 12, 2014 5:38 pm

Here is the NSA325v2 which is as far as I understand it is pin-compatible with the NSA325, thus logically identical inside Linux http://www.amazon.com/High-Performance- ... B00GJYNLKM

Here is the NSA320 which is the "younger" brother, 1.2Ghz, 512M, 2x SATA http://www.amazon.com/NSA320-Performanc ... B004UBU3SY

You might be able to find either of these on eBay or the ilk for less.
Core Developer
Remember: Arch Linux ARM is entirely community donation supported!
WarheadsSE
Developer
 
Posts: 6807
Joined: Mon Oct 18, 2010 2:12 pm

Re: Pogoplug v4 I/O performance issues, how to tweak?

Postby grayman4hire » Tue Aug 12, 2014 6:17 pm

$this->bbcode_second_pass_quote('swass', '[')url]http://linuxengineering.wordpress.com[/url]


Nice post. I'm going to have to test out some of these tweaks, especially the samba section.

BTW, not sure if it makes a difference, but I believe you might have a error in the samba section.
$this->bbcode_second_pass_code('', '
use sendfile = true
')

Should be:
$this->bbcode_second_pass_code('', '
use sendfile = Yes
')
grayman4hire
 
Posts: 350
Joined: Sat Sep 29, 2012 12:03 am
Location: SF, CA

PreviousNext

Return to Marvell Kirkwood

Who is online

Users browsing this forum: No registered users and 15 guests