Raspberry Pi 5 NVMe PCIe not working with kernel 6.6.x

[Teo_]

I’m trying to use an NVMe with the Raspberry Pi 5 using the PiMoroni "NVMe Base for Raspberry Pi 5".
Using kernels before 6.6 it works but upgrading I can’s see no more the device.

Here some tests
[code]~ » pacman -Q linux; lsblk --output NAME,PTTYPE,PARTLABEL,FSTYPE,FSVER,LABEL,FSSIZE,FSAVAIL,FSUSE%,MOUNTPOINTS astronaut@astroarch
[b]linux-rpi 6.1.70-1[/b]
NAME PTTYPE PARTLABEL FSTYPE FSVER LABEL FSSIZE FSAVAIL FSUSE% MOUNTPOINTS
sda
mmcblk0 dos
├─mmcblk0p1 dos vfat FAT16 255.7M 197.8M 23% /boot
└─mmcblk0p2 dos ext4 1.0 28.3G 15.2G 42% /
nvme0n1 dos
├─nvme0n1p1 dos vfat FAT16
└─nvme0n1p2 dos ext4 1.0

~ » pacman -Q linux; lsblk --output NAME,PTTYPE,PARTLABEL,FSTYPE,FSVER,LABEL,FSSIZE,FSAVAIL,FSUSE%,MOUNTPOINTS astronaut@astroarch
[b]linux-rpi 6.6.10-1[/b]
NAME PTTYPE PARTLABEL FSTYPE FSVER LABEL FSSIZE FSAVAIL FSUSE% MOUNTPOINTS
sda
mmcblk0 dos
├─mmcblk0p1 dos vfat FAT16 255.7M 196.2M 23% /boot
└─mmcblk0p2 dos ext4 1.0 28.3G 15.3G 41% /

~ » pacman -Q linux; lsblk --output NAME,PTTYPE,PARTLABEL,FSTYPE,FSVER,LABEL,FSSIZE,FSAVAIL,FSUSE%,MOUNTPOINTS astronaut@astroarch
[b]linux-rpi-16k 6.6.9-2[/b]
NAME PTTYPE PARTLABEL FSTYPE FSVER LABEL FSSIZE FSAVAIL FSUSE% MOUNTPOINTS
sda
mmcblk0 dos
├─mmcblk0p1 dos vfat FAT16 255.7M 196.3M 23% /boot
└─mmcblk0p2 dos ext4 1.0 28.3G 15.6G 40% /

~ » pacman -Q linux; lsblk --output NAME,PTTYPE,PARTLABEL,FSTYPE,FSVER,LABEL,FSSIZE,FSAVAIL,FSUSE%,MOUNTPOINTS astronaut@astroarch
linux-rpi-16k 6.6.10-1
NAME PTTYPE PARTLABEL FSTYPE FSVER LABEL FSSIZE FSAVAIL FSUSE% MOUNTPOINTS
sda
mmcblk0 dos
├─mmcblk0p1 dos vfat FAT16 255.7M 196.4M 23% /boot
└─mmcblk0p2 dos ext4 1.0 28.3G 15.4G 41% /

~ » pacman -Q linux; lsblk --output NAME,PTTYPE,PARTLABEL,FSTYPE,FSVER,LABEL,FSSIZE,FSAVAIL,FSUSE%,MOUNTPOINTS astronaut@astroarch
[b]linux-rpi-16k 6.6.11-2[/b]
NAME PTTYPE PARTLABEL FSTYPE FSVER LABEL FSSIZE FSAVAIL FSUSE% MOUNTPOINTS
sda
mmcblk0 dos
├─mmcblk0p1 dos vfat FAT16 255.7M 196.4M 23% /boot
└─mmcblk0p2 dos ext4 1.0 28.3G 15.2G 42% /[/code]

Comparing the kernels modules I can see the attached differences

[graysky]

I do not have a PCIe NVMe for testing. The files you provided don't help me to see if we are missing a module in the 6.6.y series. Please do this:

1. Boot to 6.1.x and with your NVMe PCIe device working, run: lsmod > 6.1.txt
2. Boot to 6.6.x and run: lsmod > 6.6.txt

Post those two files.

[Teo_]

Here you are. Thanks.
[url]https://postimg.cc/3dcV9j6C[/url]

[graysky]

From a modules perspective, 6.1 has four that 6.6 does not have:
[code]
fb_sys_fops
syscopyarea
sysfillrect
sysimgblt[/code]

Would you please try booting into 6.6.y and one-by-one running (as root)
modprobe xxx

Please report back. Did all 4 load? Please provide error output if not.

[Teo_]

From linux-rpi 6.6.12-1 I don’t get errors or output:

~ » sudo modprobe fb_sys_fops
---------------------------------------------------------------------------------------------------------------------
~ » sudo modprobe syscopyarea
---------------------------------------------------------------------------------------------------------------------
~ » sudo modprobe sysfillrect
---------------------------------------------------------------------------------------------------------------------
~ » sudo modprobe sysimgblt

[graysky]

I tried the same but also did not get any module inserted... did you see anything?

lsmod | grep sys

[Teo_]

Nothing…

[graysky]

I am not sure those are relevant. I see all 4 when I boot my RPi4B into 6.1.61-3.
[code]% lsmod |grep sys
fb_sys_fops 16384 1 drm_kms_helper
syscopyarea 16384 1 drm_kms_helper
sysfillrect 16384 1 drm_kms_helper
sysimgblt 16384 1 drm_kms_helper
[/code]

The issue might be some other bug with the 6.6.y kernel not a missing module. ArchARM ships RPiOS bcm2712_defconfig as our baseline config. We add a few modules and settings but the basis set is there. Recommend that you open an issue:
make_clickable_callback(MAGIC_URL_FULL, '
', 'https://github.com/raspberrypi/linux/issues/new/choose', '', ' class="postlink"')

[Teo_]

OK, thanks for your help.

[Teo_]

On Raspberry OS with the kernel 6.6.12-v8-16k+ works.make_clickable_callback(MAGIC_URL_FULL, '
', 'https://github.com/raspberrypi/linux/issues/5873#issuecomment-1902165853', '', ' class="postlink"')
Are there other tests I can do?