[RPI 3b aarch64] Boot process hangs for several minutes

This forum is for topics dealing with problems with software specifically in the AArch64 repo.

Re: [RPI 3b aarch64] Boot process hangs for several minutes

Postby zzzz1111 » Tue Sep 21, 2021 10:33 am

$this->bbcode_second_pass_quote('graysky', 'W')hat is displayed on screen when this bug hits?


$this->bbcode_second_pass_code('', 'Found U-Boot script /boot.scr
708 bytes read in 30 ms (22.5 KiB/s)
## Executing script at 02c00000')
Here is where it gets stuck for a couple of minutes, and then:

$this->bbcode_second_pass_code('', '34003456 bytes read in 179863 ms (184.6 KiB/s)
19899 bytes read in 193 ms (100.6 KiB/s)
7230405 bytes read in 38278 ms (183.6 KiB/s)
Moving Image from 0x80000 to 0x200000, end=2350000
## Flattened Device Tree blob at 02e00000
Booting using the fdt blob at 0x2e00000
Using Device Tree in place at 0000000002e00000, end 0000000002e07dba

Starting kernel ...')

$this->bbcode_second_pass_quote('graysky', 'W')hat is the output of systemd-analyze blame when it finally does boot?


$this->bbcode_second_pass_code('', '2.109s ldconfig.service
2.084s dev-mmcblk0p2.device
1.284s accounts-daemon.service
1.038s polkit.service
693ms NetworkManager.service
682ms systemd-resolved.service
679ms systemd-tmpfiles-setup.service
539ms user@972.service
510ms systemd-journal-flush.service
481ms upower.service
475ms systemd-timesyncd.service
401ms systemd-journal-catalog-update.service
399ms systemd-udev-trigger.service
390ms wpa_supplicant.service
379ms user@1001.service
354ms avahi-daemon.service
349ms bluetooth.service
331ms systemd-networkd.service
283ms modprobe@fuse.service
283ms dev-hugepages.mount
280ms dev-mqueue.mount
277ms sys-kernel-debug.mount
273ms modprobe@drm.service
263ms modprobe@configfs.service
258ms systemd-modules-load.service
257ms kmod-static-nodes.service
256ms systemd-remount-fs.service
254ms lvm2-monitor.service
252ms systemd-logind.service
250ms boot.mount
222ms systemd-udevd.service
196ms systemd-tmpfiles-clean.service
186ms lightdm.service
182ms swapfile.swap
179ms sys-fs-fuse-connections.mount
175ms sys-kernel-config.mount
169ms alsa-restore.service
168ms systemd-rfkill.service
134ms systemd-random-seed.service
131ms systemd-sysctl.service
126ms systemd-sysusers.service
115ms systemd-journald.service
111ms systemd-tmpfiles-setup-dev.service
89ms systemd-update-utmp.service
37ms tmp.mount
37ms systemd-user-sessions.service
35ms user-runtime-dir@972.service
35ms user-runtime-dir@1001.service
23ms systemd-update-done.service')
zzzz1111
 
Posts: 3
Joined: Sat Sep 04, 2021 10:10 am

Re: [RPI 3b aarch64] Boot process hangs for several minutes

Postby beedaddy » Thu Sep 30, 2021 5:55 am

Are there any news about this? I also suffer from this issue. But in my case, it doesn't boot at all. It's stuck at
$this->bbcode_second_pass_code('', 'Found U-Boot script /boot.scr
708 bytes read in 30 ms (22.5 KiB/s)
## Executing script at 02c00000')
I even did a fresh install. Everything is ok, but after `pacman -Syu`it doesn't boot anymore (I waited >1h).
beedaddy
 
Posts: 4
Joined: Wed Jan 24, 2018 7:15 am

Re: [RPI 3b aarch64] Boot process hangs for several minutes

Postby df8oe » Fri Oct 01, 2021 5:13 pm

Same issue here (very long delay). "downgrade" tells me that no downgrade is possible. How can I access raspberrypi-bootloader 20210805-1?

EDIT:
systemd-analyze blame reaches after 1.746s dev-mmcblk0p2.device and then ends.

Best regards
df8oe
 
Posts: 60
Joined: Fri Oct 01, 2021 5:10 pm

Re: [RPI 3b aarch64] Boot process hangs for several minutes

Postby ufo6000 » Fri Oct 01, 2021 6:36 pm

My Pi also takes 4 Minutes until reaching "Booting Linux on physical CPU 0x0000000000" in dmesg.

This matches rough the numbers from zzzz1111,
$this->bbcode_second_pass_code('', '34003456 bytes read in 179863 ms (184.6 KiB/s)
19899 bytes read in 193 ms (100.6 KiB/s)
7230405 bytes read in 38278 ms (183.6 KiB/s)
')
which I translate into:
34003456 bytes --> Image / Linux kernel ARM64 --> 180 seconds
7230405 bytes --> initramfs-linux.img --> 38 seconds

So no boot hang? Seems the reading of these files is taking suddenly much time?
ufo6000
 
Posts: 117
Joined: Fri Jan 22, 2016 7:54 pm

Re: [RPI 3b aarch64] Boot process hangs for several minutes

Postby df8oe » Sat Oct 02, 2021 7:27 am

I can confirm that
- downgrading raspberrypi-bootloader to 20210805-1 fixes the problem (I forgot to correct the archive url in /etc/xdg/downgrade/downgrade.conf)
- systemd-analyze blame gives the same output as at the broken versions

For me it looks like the delay takes place BEFORE systemd begins to rule. So it is before kernel is loaded at all or during kernel loading / reaching systemd wakeup.
Last edited by df8oe on Mon Oct 04, 2021 12:56 pm, edited 1 time in total.
df8oe
 
Posts: 60
Joined: Fri Oct 01, 2021 5:10 pm

Re: [RPI 3b aarch64] Boot process hangs for several minutes

Postby df8oe » Sat Oct 02, 2021 9:46 am

I have checked. It seems that transfer rate from sd-card has dropped incredible at all version after 20210805-1. Normally it is 5...20Mb/s. Now it drops down to ~150Kb/s. That is the delay.
df8oe
 
Posts: 60
Joined: Fri Oct 01, 2021 5:10 pm

Re: [RPI 3b aarch64] Boot process hangs for several minutes

Postby ufo6000 » Sat Oct 02, 2021 6:29 pm

Can we please narrow down exactly when it started, so far I got from this thread this:
raspberrypi-bootloader 20210805-1 --ok--
raspberrypi-bootloader 20210818-2 --maybe ok--
raspberrypi-bootloader 20210823-1 --faulty--
raspberrypi-bootloader 20210901-1 --faulty--
raspberrypi-bootloader-20210914-3 --faulty--

For the bootloader I found these changes:

https://github.com/raspberrypi/firmware ... aster/boot

$this->bbcode_second_pass_code('', '
Commits on Aug 25, 2021 kernel: drm/vc4: hdmi: Remove the DDC probing for status detection
https://github.com/raspberrypi/firmware/commit/24f05a6e0eadcf001159e3618759cfb51761fd0e#diff-4509beb0ab401d71fa4a5cd94a55c9a74f13332776ae4019c5bfc4c2005157ff

Commits on Aug 23, 2021 kernel: Bump to 5.10.60
https://github.com/raspberrypi/firmware/commit/beb94b22c0e7dfc3a62dc941a24f1230edd1eba0#diff-4509beb0ab401d71fa4a5cd94a55c9a74f13332776ae4019c5bfc4c2005157ff

Commits on Aug 19, 2021 kernel: overlays: rpi-poe-plus: Improve the cooling levels
https://github.com/raspberrypi/firmware/commit/25e2b597ebfb2495eab4816a276758dcc6ea21f1#diff-4509beb0ab401d71fa4a5cd94a55c9a74f13332776ae4019c5bfc4c2005157ff

Commits on Aug 18, 2021 firmware: arm_loader: Make most arm clock requests required
https://github.com/raspberrypi/firmware/commit/69cfd9f03a2b4aab6aec021328be9355d1dad1db#diff-4509beb0ab401d71fa4a5cd94a55c9a74f13332776ae4019c5bfc4c2005157ff

Commits on Aug 18, 2021 kernel: Bump to 5.10.59
https://github.com/raspberrypi/firmware/commit/e3234b68ec227d0fa8e3f31c56f1370b1c2af880#diff-4509beb0ab401d71fa4a5cd94a55c9a74f13332776ae4019c5bfc4c2005157ff

Commits on Aug 17, 2021 kernel: xhci: guard accesses to ep_state in xhci_endpoint_reset()
https://github.com/raspberrypi/firmware/commit/970b4ba6c8379fb4f8544155a4e304bbc79177c9#diff-4509beb0ab401d71fa4a5cd94a55c9a74f13332776ae4019c5bfc4c2005157ff

Commits on Aug 12, 2021 kernel: usb: xhci: workaround for bogus SET_DEQ_PENDING endpoint state
https://github.com/raspberrypi/firmware/commit/a2f8526fda785a11ea3f2ddfa6724c8bd3049ef7#diff-4509beb0ab401d71fa4a5cd94a55c9a74f13332776ae4019c5bfc4c2005157ff

Commits on Aug 11, 2021 kernel: Revert mm/shmem: fix shmem_swapin() race with swapoff
https://github.com/raspberrypi/firmware/commit/5bcc8bcdb357e0d3600609077aaf8cf24c60ce1a#diff-4509beb0ab401d71fa4a5cd94a55c9a74f13332776ae4019c5bfc4c2005157ff

Commits on Aug 5, 2021 firmware: video_decode: Use the ISP instead of vc_image_convert
https://github.com/raspberrypi/firmware/commit/a51c6008766ecd928d774dafc5eefe88a4f9bf75#diff-4509beb0ab401d71fa4a5cd94a55c9a74f13332776ae4019c5bfc4c2005157ff
')

There are two big kernel Bump in this timeline which makes it more difficult. So the exact time when the issue started would be helpfull.
ufo6000
 
Posts: 117
Joined: Fri Jan 22, 2016 7:54 pm

Re: [RPI 3b aarch64] Boot process hangs for several minutes

Postby df8oe » Sun Oct 03, 2021 4:00 pm

20210818-2 is the last which do not have the issue
20210823-1 and all newer are affected
df8oe
 
Posts: 60
Joined: Fri Oct 01, 2021 5:10 pm

Re: [RPI 3b aarch64] Boot process hangs for several minutes

Postby starquake » Tue Oct 05, 2021 11:11 am

I had this issue. I updated this morning and it booted quickly.
$this->bbcode_second_pass_code('', '
[2021-10-05T11:38:24+0200] [ALPM] upgraded raspberrypi-bootloader (20210928-2 -> 20210930-1)
[2021-10-05T11:38:25+0200] [ALPM] upgraded raspberrypi-firmware (20210928-2 -> 20211004-1)
')

I think it was related to this: https://github.com/raspberrypi/firmware/issues/1619
starquake
 
Posts: 6
Joined: Mon Jun 02, 2014 10:04 pm

Re: [RPI 3b aarch64] Boot process hangs for several minutes

Postby df8oe » Tue Oct 05, 2021 4:01 pm

@starquake: you are right. I upgraded now and everything is working as expected.

Issue is gone for me!
df8oe
 
Posts: 60
Joined: Fri Oct 01, 2021 5:10 pm

PreviousNext

Return to ARMv8

Who is online

Users browsing this forum: No registered users and 5 guests

cron