[SOLVED] cpu stall on kernels 4.1.9-1 and 4.1.10-1

Raspberry Pi 2

[SOLVED] cpu stall on kernels 4.1.9-1 and 4.1.10-1

Postby pinoverclock » Tue Oct 06, 2015 10:06 pm

After kernel upgrade above 4.1.8-1 my system tends to get into unusable states, i noticed this behaviour with kernel versions 4.1.9-1 and 4.1.10-1
I got the the following kernel messages:
$this->bbcode_second_pass_code('', 'Oct 06 22:03:07 aquarius kernel: INFO: rcu_preempt self-detected stall on CPU { 0} (t=2100 jiffies g=46285 c=46284 q=81)
Oct 06 22:03:07 aquarius kernel: Task dump for CPU 0:
Oct 06 22:03:07 aquarius kernel: swapper/0 R running 0 0 0 0x00000002
Oct 06 22:03:07 aquarius kernel: [<80015dd4>] (unwind_backtrace) from [<80012d58>] (show_stack+0x10/0x14)
Oct 06 22:03:07 aquarius kernel: [<80012d58>] (show_stack) from [<8007f648>] (rcu_dump_cpu_stacks+0x94/0xd4)
Oct 06 22:03:07 aquarius kernel: [<8007f648>] (rcu_dump_cpu_stacks) from [<80083adc>] (rcu_check_callbacks+0x5f0/0x9c8)
Oct 06 22:03:07 aquarius kernel: [<80083adc>] (rcu_check_callbacks) from [<80088830>] (update_process_times+0x38/0x64)
Oct 06 22:03:07 aquarius kernel: [<80088830>] (update_process_times) from [<80099424>] (tick_sched_handle.isra.6+0x44/0x50)
Oct 06 22:03:07 aquarius kernel: [<80099424>] (tick_sched_handle.isra.6) from [<80099488>] (tick_sched_timer+0x58/0x9c)
Oct 06 22:03:07 aquarius kernel: [<80099488>] (tick_sched_timer) from [<80089258>] (__run_hrtimer+0x68/0x29c)
Oct 06 22:03:07 aquarius kernel: [<80089258>] (__run_hrtimer) from [<80089d34>] (hrtimer_interrupt+0x12c/0x310)
Oct 06 22:03:07 aquarius kernel: [<80089d34>] (hrtimer_interrupt) from [<80675de4>] (arch_timer_handler_phys+0x28/0x30)
Oct 06 22:03:07 aquarius kernel: [<80675de4>] (arch_timer_handler_phys) from [<8007c1e8>] (handle_percpu_devid_irq+0x8c/0x1b0)
Oct 06 22:03:07 aquarius kernel: [<8007c1e8>] (handle_percpu_devid_irq) from [<80078584>] (__handle_domain_irq+0xa8/0x118)
Oct 06 22:03:07 aquarius kernel: [<80078584>] (__handle_domain_irq) from [<80786d70>] (__irq_svc+0x30/0x144)
Oct 06 22:03:07 aquarius kernel: [<80786d70>] (__irq_svc) from [<80786658>] (_raw_spin_unlock_irqrestore+0x30/0x64)
Oct 06 22:03:07 aquarius kernel: [<80786658>] (_raw_spin_unlock_irqrestore) from [<80087a00>] (try_to_del_timer_sync+0x50/0x64)
Oct 06 22:03:07 aquarius kernel: [<80087a00>] (try_to_del_timer_sync) from [<80087a48>] (del_timer_sync+0x34/0x54)
Oct 06 22:03:07 aquarius kernel: [<80087a48>] (del_timer_sync) from [<806f1568>] (inet_csk_reqsk_queue_drop+0x204/0x290)
Oct 06 22:03:07 aquarius kernel: [<806f1568>] (inet_csk_reqsk_queue_drop) from [<806f16e0>] (reqsk_timer_handler+0xec/0x2f8)
Oct 06 22:03:07 aquarius kernel: [<806f16e0>] (reqsk_timer_handler) from [<800874f8>] (call_timer_fn+0x30/0x1a4)
Oct 06 22:03:07 aquarius kernel: [<800874f8>] (call_timer_fn) from [<80087cdc>] (run_timer_softirq+0x1dc/0x2ec)
Oct 06 22:03:07 aquarius kernel: [<80087cdc>] (run_timer_softirq) from [<80033338>] (__do_softirq+0x124/0x31c)
Oct 06 22:03:07 aquarius kernel: [<80033338>] (__do_softirq) from [<80033820>] (irq_exit+0xc0/0xfc)
Oct 06 22:03:07 aquarius kernel: [<80033820>] (irq_exit) from [<80078588>] (__handle_domain_irq+0xac/0x118)
Oct 06 22:03:07 aquarius kernel: [<80078588>] (__handle_domain_irq) from [<80786d70>] (__irq_svc+0x30/0x144)
Oct 06 22:03:07 aquarius kernel: [<80786d70>] (__irq_svc) from [<8000fe64>] (arch_cpu_idle+0x38/0x3c)
Oct 06 22:03:07 aquarius kernel: [<8000fe64>] (arch_cpu_idle) from [<8006ae64>] (cpu_startup_entry+0x21c/0x2c0)
Oct 06 22:03:07 aquarius kernel: [<8006ae64>] (cpu_startup_entry) from [<80a28c88>] (start_kernel+0x3b8/0x3c4)')
Has anyone noticed the same behaviour?

EDIT: I have just found this http://www.spinics.net/lists/netdev/msg345852.html
Last edited by pinoverclock on Mon Oct 12, 2015 6:14 pm, edited 1 time in total.
pinoverclock
 
Posts: 15
Joined: Mon Dec 31, 2012 2:05 pm

Re: cpu stall warning after kernel upgrade 4.1.9-1 and 4.1.

Postby WarheadsSE » Wed Oct 07, 2015 12:46 pm

Trace that all the way down, and you find this: http://git.kernel.org/cgit/linux/kernel ... 465cd8c6af
Core Developer
Remember: Arch Linux ARM is entirely community donation supported!
WarheadsSE
Developer
 
Posts: 6807
Joined: Mon Oct 18, 2010 2:12 pm

Re: cpu stall warning after kernel upgrade 4.1.9-1 and 4.1.

Postby WarheadsSE » Thu Oct 08, 2015 2:11 pm

The take away here: maineline Linux is aware of the possible regression and are working to address it.
Core Developer
Remember: Arch Linux ARM is entirely community donation supported!
WarheadsSE
Developer
 
Posts: 6807
Joined: Mon Oct 18, 2010 2:12 pm

Re: cpu stall warning after kernel upgrade 4.1.9-1 and 4.1.

Postby pinoverclock » Fri Oct 09, 2015 7:14 am

Thank you very much, until they fix it i will revert back to kernel 4.1.8-1
pinoverclock
 
Posts: 15
Joined: Mon Dec 31, 2012 2:05 pm

Re: cpu stall warning after kernel upgrade 4.1.9-1 and 4.1.

Postby tokenize » Sat Oct 10, 2015 10:00 am

Hello, could you post the pkgs for 4.1.8 as I would also like to revert but haven't got the compiled kernel?

Regards
tokenize
 
Posts: 9
Joined: Wed Jun 10, 2015 6:08 pm

Re: cpu stall warning after kernel upgrade 4.1.9-1 and 4.1.

Postby pinoverclock » Sat Oct 10, 2015 2:10 pm

I've found 4.1.8-1 kernel package and headers here:
http://mirror.nus.edu.sg/archlinux-arm/armv7h/core/linux-raspberrypi-4.1.8-1-armv7h.pkg.tar.xz
http://mirror.nus.edu.sg/archlinux-arm/armv7h/core/linux-raspberrypi-headers-4.1.8-1-armv7h.pkg.tar.xz

And a bunch of old kernel package files at http://fraggod.net/static/mirror/packag ... rm/armv7h/:
linux-raspberrypi-3.18.13-1-armv7h.pkg.tar.xz 11-May-2015 00:48 23406184
linux-raspberrypi-3.18.13-2-armv7h.pkg.tar.xz 19-May-2015 02:23 23428320
linux-raspberrypi-3.18.14-1-armv7h.pkg.tar.xz 26-May-2015 00:37 23426928
linux-raspberrypi-3.18.14-2-armv7h.pkg.tar.xz 28-May-2015 13:23 23427376
linux-raspberrypi-3.18.14-3-armv7h.pkg.tar.xz 08-Jun-2015 04:25 23426016
linux-raspberrypi-4.0.6-2-armv7h.pkg.tar.xz 27-Jun-2015 05:09 23759492
linux-raspberrypi-4.0.7-2-armv7h.pkg.tar.xz 09-Jul-2015 01:16 23760164
linux-raspberrypi-4.0.8-3-armv7h.pkg.tar.xz 16-Jul-2015 01:15 23779052
linux-raspberrypi-4.1.10-1-armv7h.pkg.tar.xz 05-Oct-2015 01:25 24597548
linux-raspberrypi-4.1.8-1-armv7h.pkg.tar.xz 23-Sep-2015 01:52 24590404

Regards
pinoverclock
 
Posts: 15
Joined: Mon Dec 31, 2012 2:05 pm

Re: cpu stall warning after kernel upgrade 4.1.9-1 and 4.1.

Postby tokenize » Sun Oct 11, 2015 11:17 am

Thank you for the post.

Meanwhile there's a new kernel version, let's see if it is fixed.

Regards
tokenize
 
Posts: 9
Joined: Wed Jun 10, 2015 6:08 pm

Re: cpu stall warning after kernel upgrade 4.1.9-1 and 4.1.

Postby pinoverclock » Sun Oct 11, 2015 5:34 pm

Just upgraded to 4.1.10-2 i will let you know how it works for me
pinoverclock
 
Posts: 15
Joined: Mon Dec 31, 2012 2:05 pm

Re: cpu stall warning after kernel upgrade 4.1.9-1 and 4.1.

Postby pinoverclock » Mon Oct 12, 2015 3:39 pm

Almost 24 hours uptime with heavy net load and without unusual kernel messages or unstable states, seems pretty ok to me.

Thank you very much
pinoverclock
 
Posts: 15
Joined: Mon Dec 31, 2012 2:05 pm

Re: cpu stall warning after kernel upgrade 4.1.9-1 and 4.1.

Postby WarheadsSE » Mon Oct 12, 2015 4:17 pm

The foundation committed the previously mentioned change from LKML above:
https://github.com/raspberrypi/linux/co ... 414939060d

4.1.10-2 now includes this fix, thus should fix the issue.
Core Developer
Remember: Arch Linux ARM is entirely community donation supported!
WarheadsSE
Developer
 
Posts: 6807
Joined: Mon Oct 18, 2010 2:12 pm

Next

Return to Broadcom

Who is online

Users browsing this forum: No registered users and 7 guests