Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WARNING: CPU: X PID: XXXX at include/linux/rwsem.h:80 follow_pte+0xf8/0x120 on resume #719

Closed
1 of 2 tasks
birdie-github opened this issue Oct 22, 2024 · 22 comments
Closed
1 of 2 tasks
Labels
bug Something isn't working

Comments

@birdie-github
Copy link

birdie-github commented Oct 22, 2024

NVIDIA Open GPU Kernel Modules Version

565.57.01

Please confirm this issue does not happen with the proprietary driver (of the same version). This issue tracker is only for bugs specific to the open kernel driver.

  • I confirm that this does not happen with the proprietary driver package.

Operating System and Version

Fedora 40

Kernel Release

Linux zen 6.11.4-zen3 #1 SMP PREEMPT_DYNAMIC Tue Oct 22 11:16:40 UTC 2024 x86_64 GNU/Linux

Please confirm you are running a stable release kernel (e.g. not a -rc). We do not accept bug reports for unreleased kernels.

  • I am running on a stable kernel release.

Hardware: GPU

NVIDIA GeForce RTX 4070 SUPER

Describe the bug

The issue with resuming is not fixed in beta driver 565.57.01 :-(

There are even MORE dmesg errors than in the previous stable driver.

I'm using XFCE without compositing and these nvidia kernel modules options:

options nvidia NVreg_EnableS0ixPowerManagement=1
options nvidia-drm modeset=1 fbdev=1

To Reproduce

Suspend/resume.

Bug Incidence

Always

nvidia-bug-report.log.gz

kernel-trace.txt

@aritger
Copy link
Collaborator

aritger commented Oct 22, 2024

Can you please attach a full nvidia-bug-report.log.gz?

@birdie-github
Copy link
Author

birdie-github commented Oct 22, 2024

Here it is:

nvidia-bug-report.log.gz

This first appeared in kernel 6.10.

Kernels 6.9 and earlier don't exhibit this issue.

@aritger
Copy link
Collaborator

aritger commented Oct 22, 2024

Thanks for the log. I've filed NVIDIA internal bug 4922186 for this.

Knowing this is specific to >= Linux kernel 6.10 helps; thanks for that isolation.
Any other isolation you can do will help a lot. E.g.,

  • Does this reproduce if forcing use of the closed kernel modules?
  • Does this reproduce without NVreg_EnableS0ixPowerManagement=1?
  • Does this reproduce without fbdev=1?

@birdie-github
Copy link
Author

* Does this reproduce if forcing use of the closed kernel modules?

Yes.

* Does this reproduce without NVreg_EnableS0ixPowerManagement=1?

I'll try, and report later.

* Does this reproduce without fbdev=1?

Yes.

@birdie-github
Copy link
Author

birdie-github commented Oct 22, 2024

Removing NVreg_EnableS0ixPowerManagement=1 fixes the issue.

No more dmesg spam (more than 60KB of messages).

I started using the option because you or @aaronp24 told me it was necessary to properly restore the system state.

Probably I had some issues with either Firefox or Chrome misbehaving on resume. It was a long time ago.

I have 64GB of RAM, most of it completely free, I'm not using SWAP or hibernate.

@aritger
Copy link
Collaborator

aritger commented Oct 22, 2024

Thank you for those experiments. That will help us focus our debugging.

@tekstryder
Copy link

tekstryder commented Oct 22, 2024

I'd been following #662 mistakenly this whole time when it's this issue that's been affecting every kernel since 6.10 release, as mentioned. I should have paid more attention to those stack traces! D'oh!

Does this reproduce if forcing use of the closed kernel modules?

Yes

Does this reproduce without NVreg_EnableS0ixPowerManagement=1?

Yes. I've never had NVreg_EnableS0ixPowerManagement set.

Does this reproduce without fbdev=1?

Yes, and I'm unable to boot with `fbdev=1' anyhow. See related Arch bug

Using the following kernel parameters:
nvidia_drm.modeset=1 nvidia_drm.fbdev=0

  • Arch Linux | Kernel 6.10.14
  • nVidia 560.35.03
  • GeForce GTX 1050 Ti

The attached stacktrace repeats ~20ish times per suspend: nvidia-sleep-stacktrace.txt

/usr/lib/modprobe.d/nvidia-sleep.conf:

options nvidia NVreg_PreserveVideoMemoryAllocations=1
options nvidia NVreg_TemporaryFilePath=/var/tmp

nvidia-bug-report.log

@birdie-github
Copy link
Author

@tekstryder

Please attach your nvidia-bug-report as well.

@tekstryder
Copy link

Please attach your nvidia-bug-report as well.

Edited my post and attached it.

I also just built and booted kernel 6.11.5, and suspended one time to reproduce this issue, so the dmesg is fresh.

nvidia-bug-report.log

@ZulluBalti
Copy link

Happening to me also on the proprietary drivers as well on linux 6.10.10

@birdie-github
Copy link
Author

@aritger

There's also #705 which looks similar.

I wonder if #662 #705 and this one are all somehow related because as far as I can see most people affected by them started to get issues with kernel 6.10 and later.

@aritger
Copy link
Collaborator

aritger commented Oct 23, 2024

If anyone is adventurous, could you retest this configuration with Linux kernel v6.12-rc1 or later? It looks like -rc4 is currently the latest.

We're still investigating, but so far: I don't know if the 'WARNING: CPU: 6 PID: 7530 at include/linux/rwsem.h:80 follow_pte+0xf8/0x120' message is synonymous with the failure, or just coincidental. We've seen that warning and backtrace in other scenarios where suspend/resume still worked.

That particular warning was introduced by this kernel commit:

https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git/commit/mm/memory.c?id=c5541ba378e3d36ea88bf5839d5b23e33e7d1627

There was then some upstream kernel discussion about various drivers that were impacted by it:

https://lore.kernel.org/linux-mm/[email protected]/T/#u
https://lore.kernel.org/all/[email protected]/

This area was refactored more upstream:

https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git/commit/?id=b0a1c0d0edcd75a0f8ec5fd19dbd64b8d097f534
https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git/commit/?id=6da8e9634bb7e3fdad9ae0e4db873a05036c4343
https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git/commit/?id=6da8e9634bb7e3fdad9ae0e4db873a05036c4343

which is included in Linux kernel v6.12-rc1 and later. In our testing, that resolved the warning message, but I don't have confirmation yet whether it impacted NVreg_EnableS0ixPowerManagement=1 configurations.

@ptr1337
Copy link

ptr1337 commented Oct 23, 2024

6.12 will not work right now since its not able to open the display.
This patch on top of the open modules should fix it:
CachyOS@0140472

@aritger
Copy link
Collaborator

aritger commented Oct 23, 2024

I /think/ the latest 565.xx beta should already contain compatibility fixes for 6.12-rc's, but let me know if that is not your experience.

@ptr1337
Copy link

ptr1337 commented Oct 24, 2024

I /think/ the latest 565.xx beta should already contain compatibility fixes for 6.12-rc's, but let me know if that is not your experience.

No, it does not. The module compiles, yes, but it crashes.
Since im currently not at home, here the logs from another person.

The above mentioned patch fixes it.

nvidia-bug-report(1).log

@letmeiiiin
Copy link

Can confirm you need this patch to open the display on 565.57.01 / linux 6.12-rc4.
Thx ptr1337 :)

@cinnamonmatexfce
Copy link

Resume after suspend is working fine here, but I'm also having the same kind of trace.

  • KERNEL: Linux 6.11.3-2-default GNU/Linux

  • DISTRO: openSUSE Tumbleweed

  • PACKAGES:

zypper se -ids /^nvidia/



Loading repository data...
Reading installed packages...

S  | Name                          | Type    | Version                   | Arch   | Repository
---+-------------------------------+---------+---------------------------+--------+-----------
i+ | nvidia-compute-G06            | package | 550.127.05-27.1           | x86_64 | nvidia
i+ | nvidia-compute-G06-32bit      | package | 550.127.05-27.1           | x86_64 | nvidia
i+ | nvidia-compute-utils-G06      | package | 550.127.05-27.1           | x86_64 | nvidia
i+ | nvidia-driver-G06-kmp-default | package | 550.127.05_k6.11.3_2-27.1 | x86_64 | nvidia
i+ | nvidia-drivers-G06            | package | 550.127.05-27.1           | x86_64 | nvidia
i+ | nvidia-gl-G06                 | package | 550.127.05-27.1           | x86_64 | nvidia
i+ | nvidia-gl-G06-32bit           | package | 550.127.05-27.1           | x86_64 | nvidia
i+ | nvidia-utils-G06              | package | 550.127.05-27.1           | x86_64 | nvidia
i+ | nvidia-video-G06              | package | 550.127.05-27.1           | x86_64 | nvidia
i+ | nvidia-video-G06-32bit        | package | 550.127.05-27.1           | x86_64 | nvidia
zypper se -ids /^kernel\-/



Loading repository data...
Reading installed packages...

S  | Name                        | Type    | Version      | Arch   | Repository
---+-----------------------------+---------+--------------+--------+------------------------
i+ | kernel-default              | package | 6.11.3-1.1   | x86_64 | (System Packages)
i+ | kernel-default              | package | 6.11.3-2.1   | x86_64 | openSUSE-Tumbleweed-Oss
i  | kernel-default-devel        | package | 6.11.3-2.1   | x86_64 | openSUSE-Tumbleweed-Oss
i  | kernel-devel                | package | 6.11.3-2.1   | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-all         | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-amdgpu      | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-ath10k      | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-ath11k      | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-ath12k      | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-atheros     | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-bluetooth   | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-bnx2        | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-brcm        | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-chelsio     | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-dpaa2       | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-i915        | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-intel       | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-iwlwifi     | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-liquidio    | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-marvell     | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-media       | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-mediatek    | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-mellanox    | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-mwifiex     | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-network     | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-nfp         | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-nvidia      | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-platform    | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-prestera    | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-qcom        | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-qlogic      | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-radeon      | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-realtek     | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-serial      | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-sound       | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-ti          | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-ueagle      | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-firmware-usb-network | package | 20241018-1.1 | noarch | openSUSE-Tumbleweed-Oss
i  | kernel-macros               | package | 6.11.3-2.1   | noarch | openSUSE-Tumbleweed-Oss
i  | libaio1                     | package | 0.3.113-4.1  | x86_64 | openSUSE-Tumbleweed-Oss
i  | linux-glibc-devel           | package | 6.11-1.1     | x86_64 | openSUSE-Tumbleweed-Oss
  • INITRD:
lsinitrd /boot/initrd-6.11.3-2-default | grep -i nvidia



drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ad102
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ad102/gsp
-rw-r--r--   1 root     root        31456 Sep 13 15:27 usr/lib/firmware/nvidia/ad102/gsp/booter_load-535.113.01.bin.xz
-rw-r--r--   1 root     root        19492 Sep 13 15:27 usr/lib/firmware/nvidia/ad102/gsp/booter_unload-535.113.01.bin.xz
-rw-r--r--   1 root     root        29140 Sep 13 15:27 usr/lib/firmware/nvidia/ad102/gsp/bootloader-535.113.01.bin.xz
lrwxrwxrwx   1 root     root           37 Sep 13 15:27 usr/lib/firmware/nvidia/ad102/gsp/gsp-535.113.01.bin.xz -> ../../ga102/gsp/gsp-535.113.01.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ad103
lrwxrwxrwx   1 root     root           12 Sep 13 15:27 usr/lib/firmware/nvidia/ad103/gsp -> ../ad102/gsp
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ad104
lrwxrwxrwx   1 root     root           12 Sep 13 15:27 usr/lib/firmware/nvidia/ad104/gsp -> ../ad102/gsp
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ad106
lrwxrwxrwx   1 root     root           12 Sep 13 15:27 usr/lib/firmware/nvidia/ad106/gsp -> ../ad102/gsp
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ad107
lrwxrwxrwx   1 root     root           12 Sep 13 15:27 usr/lib/firmware/nvidia/ad107/gsp -> ../ad102/gsp
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga100
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga100/gsp
-rw-r--r--   1 root     root        33612 Sep 13 15:27 usr/lib/firmware/nvidia/ga100/gsp/booter_load-535.113.01.bin.xz
-rw-r--r--   1 root     root        18688 Sep 13 15:27 usr/lib/firmware/nvidia/ga100/gsp/booter_unload-535.113.01.bin.xz
-rw-r--r--   1 root     root          888 Sep 13 15:27 usr/lib/firmware/nvidia/ga100/gsp/bootloader-535.113.01.bin.xz
lrwxrwxrwx   1 root     root           37 Sep 13 15:27 usr/lib/firmware/nvidia/ga100/gsp/gsp-535.113.01.bin.xz -> ../../tu102/gsp/gsp-535.113.01.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga102
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/acr
-rw-r--r--   1 root     root        33916 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/acr/ucode_ahesasc.bin.xz
-rw-r--r--   1 root     root        16060 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/acr/ucode_asb.bin.xz
-rw-r--r--   1 root     root        13792 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/acr/ucode_unload.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/gr
-rw-r--r--   1 root     root        67728 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/gr/NET_img.bin.xz
-rw-r--r--   1 root     root          356 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root         1692 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/gr/fecs_sig.bin.xz
-rw-r--r--   1 root     root          356 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root         1692 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/gr/gpccs_sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/gsp
-rw-r--r--   1 root     root        33592 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/gsp/booter_load-535.113.01.bin.xz
-rw-r--r--   1 root     root        19200 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/gsp/booter_unload-535.113.01.bin.xz
-rw-r--r--   1 root     root        16688 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/gsp/bootloader-535.113.01.bin.xz
-rw-r--r--   1 root     root     25639648 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/gsp/gsp-535.113.01.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/nvdec
-rw-r--r--   1 root     root         7012 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/sec2
-rw-r--r--   1 root     root          188 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/sec2/desc.bin.xz
-rw-r--r--   1 root     root          516 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/sec2/hs_bl_sig.bin.xz
-rw-r--r--   1 root     root        99652 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/sec2/image.bin.xz
-rw-r--r--   1 root     root         1712 Sep 13 15:27 usr/lib/firmware/nvidia/ga102/sec2/sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga103
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/acr
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/acr/ucode_ahesasc.bin.xz -> ../../ga102/acr/ucode_ahesasc.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/acr/ucode_asb.bin.xz -> ../../ga102/acr/ucode_asb.bin.xz
lrwxrwxrwx   1 root     root           35 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/acr/ucode_unload.bin.xz -> ../../ga102/acr/ucode_unload.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/gr
-rw-r--r--   1 root     root        66544 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/gr/NET_img.bin.xz
-rw-r--r--   1 root     root          356 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root         1692 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/gr/fecs_sig.bin.xz
-rw-r--r--   1 root     root          356 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root         1692 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/gr/gpccs_sig.bin.xz
lrwxrwxrwx   1 root     root           12 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/gsp -> ../ga102/gsp
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/nvdec
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/nvdec/scrubber.bin.xz -> ../../ga102/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/sec2
lrwxrwxrwx   1 root     root           28 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/sec2/desc.bin.xz -> ../../ga102/sec2/desc.bin.xz
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/sec2/hs_bl_sig.bin.xz -> ../../ga102/sec2/hs_bl_sig.bin.xz
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/sec2/image.bin.xz -> ../../ga102/sec2/image.bin.xz
lrwxrwxrwx   1 root     root           27 Sep 13 15:27 usr/lib/firmware/nvidia/ga103/sec2/sig.bin.xz -> ../../ga102/sec2/sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga104
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/acr
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/acr/ucode_ahesasc.bin.xz -> ../../ga102/acr/ucode_ahesasc.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/acr/ucode_asb.bin.xz -> ../../ga102/acr/ucode_asb.bin.xz
lrwxrwxrwx   1 root     root           35 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/acr/ucode_unload.bin.xz -> ../../ga102/acr/ucode_unload.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/gr
-rw-r--r--   1 root     root        66408 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/gr/NET_img.bin.xz
-rw-r--r--   1 root     root          356 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root         1692 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/gr/fecs_sig.bin.xz
-rw-r--r--   1 root     root          356 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root         1692 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/gr/gpccs_sig.bin.xz
lrwxrwxrwx   1 root     root           12 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/gsp -> ../ga102/gsp
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/nvdec
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/nvdec/scrubber.bin.xz -> ../../ga102/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/sec2
lrwxrwxrwx   1 root     root           28 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/sec2/desc.bin.xz -> ../../ga102/sec2/desc.bin.xz
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/sec2/hs_bl_sig.bin.xz -> ../../ga102/sec2/hs_bl_sig.bin.xz
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/sec2/image.bin.xz -> ../../ga102/sec2/image.bin.xz
lrwxrwxrwx   1 root     root           27 Sep 13 15:27 usr/lib/firmware/nvidia/ga104/sec2/sig.bin.xz -> ../../ga102/sec2/sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga106
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/acr
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/acr/ucode_ahesasc.bin.xz -> ../../ga102/acr/ucode_ahesasc.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/acr/ucode_asb.bin.xz -> ../../ga102/acr/ucode_asb.bin.xz
lrwxrwxrwx   1 root     root           35 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/acr/ucode_unload.bin.xz -> ../../ga102/acr/ucode_unload.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/gr
-rw-r--r--   1 root     root        66384 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/gr/NET_img.bin.xz
-rw-r--r--   1 root     root          356 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root         1688 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/gr/fecs_sig.bin.xz
-rw-r--r--   1 root     root          356 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root         1696 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/gr/gpccs_sig.bin.xz
lrwxrwxrwx   1 root     root           12 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/gsp -> ../ga102/gsp
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/nvdec
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/nvdec/scrubber.bin.xz -> ../../ga102/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/sec2
lrwxrwxrwx   1 root     root           28 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/sec2/desc.bin.xz -> ../../ga102/sec2/desc.bin.xz
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/sec2/hs_bl_sig.bin.xz -> ../../ga102/sec2/hs_bl_sig.bin.xz
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/sec2/image.bin.xz -> ../../ga102/sec2/image.bin.xz
lrwxrwxrwx   1 root     root           27 Sep 13 15:27 usr/lib/firmware/nvidia/ga106/sec2/sig.bin.xz -> ../../ga102/sec2/sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga107
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/acr
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/acr/ucode_ahesasc.bin.xz -> ../../ga102/acr/ucode_ahesasc.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/acr/ucode_asb.bin.xz -> ../../ga102/acr/ucode_asb.bin.xz
lrwxrwxrwx   1 root     root           35 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/acr/ucode_unload.bin.xz -> ../../ga102/acr/ucode_unload.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/gr
-rw-r--r--   1 root     root        66492 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/gr/NET_img.bin.xz
-rw-r--r--   1 root     root          356 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root         1692 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/gr/fecs_sig.bin.xz
-rw-r--r--   1 root     root          356 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root         1696 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/gr/gpccs_sig.bin.xz
lrwxrwxrwx   1 root     root           12 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/gsp -> ../ga102/gsp
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/nvdec
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/nvdec/scrubber.bin.xz -> ../../ga102/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/sec2
lrwxrwxrwx   1 root     root           28 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/sec2/desc.bin.xz -> ../../ga102/sec2/desc.bin.xz
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/sec2/hs_bl_sig.bin.xz -> ../../ga102/sec2/hs_bl_sig.bin.xz
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/sec2/image.bin.xz -> ../../ga102/sec2/image.bin.xz
lrwxrwxrwx   1 root     root           27 Sep 13 15:27 usr/lib/firmware/nvidia/ga107/sec2/sig.bin.xz -> ../../ga102/sec2/sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gm200
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/acr
-rw-r--r--   1 root     root          348 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/acr/bl.bin.xz
-rw-r--r--   1 root     root         4844 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/acr/ucode_load.bin.xz
-rw-r--r--   1 root     root          556 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/acr/ucode_unload.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/gr
-rw-r--r--   1 root     root          260 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          516 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/gr/fecs_data.bin.xz
-rw-r--r--   1 root     root         8348 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          136 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/gr/fecs_sig.bin.xz
-rw-r--r--   1 root     root          256 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          564 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/gr/gpccs_data.bin.xz
-rw-r--r--   1 root     root         4960 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          136 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/gr/gpccs_sig.bin.xz
-rw-r--r--   1 root     root         1352 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/gr/sw_bundle_init.bin.xz
-rw-r--r--   1 root     root         1076 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/gr/sw_ctx.bin.xz
-rw-r--r--   1 root     root         1804 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/gr/sw_method_init.bin.xz
-rw-r--r--   1 root     root          588 Sep 13 15:27 usr/lib/firmware/nvidia/gm200/gr/sw_nonctx.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gm204
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/acr
lrwxrwxrwx   1 root     root           25 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/acr/bl.bin.xz -> ../../gm200/acr/bl.bin.xz
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/acr/ucode_load.bin.xz -> ../../gm200/acr/ucode_load.bin.xz
lrwxrwxrwx   1 root     root           35 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/acr/ucode_unload.bin.xz -> ../../gm200/acr/ucode_unload.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/gr
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/gr/fecs_bl.bin.xz -> ../../gm200/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          516 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/gr/fecs_data.bin.xz
lrwxrwxrwx   1 root     root           31 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/gr/fecs_inst.bin.xz -> ../../gm200/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          136 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/gr/fecs_sig.bin.xz
lrwxrwxrwx   1 root     root           30 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/gr/gpccs_bl.bin.xz -> ../../gm200/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          564 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/gr/gpccs_data.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/gr/gpccs_inst.bin.xz -> ../../gm200/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          136 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/gr/gpccs_sig.bin.xz
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/gr/sw_bundle_init.bin.xz -> ../../gm200/gr/sw_bundle_init.bin.xz
lrwxrwxrwx   1 root     root           28 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/gr/sw_ctx.bin.xz -> ../../gm200/gr/sw_ctx.bin.xz
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/gr/sw_method_init.bin.xz -> ../../gm200/gr/sw_method_init.bin.xz
lrwxrwxrwx   1 root     root           31 Sep 13 15:27 usr/lib/firmware/nvidia/gm204/gr/sw_nonctx.bin.xz -> ../../gm200/gr/sw_nonctx.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gm206
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/acr
lrwxrwxrwx   1 root     root           25 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/acr/bl.bin.xz -> ../../gm200/acr/bl.bin.xz
-rw-r--r--   1 root     root         4848 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/acr/ucode_load.bin.xz
-rw-r--r--   1 root     root          556 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/acr/ucode_unload.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/gr
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/gr/fecs_bl.bin.xz -> ../../gm200/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          516 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/gr/fecs_data.bin.xz
lrwxrwxrwx   1 root     root           31 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/gr/fecs_inst.bin.xz -> ../../gm200/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          136 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/gr/fecs_sig.bin.xz
lrwxrwxrwx   1 root     root           30 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/gr/gpccs_bl.bin.xz -> ../../gm200/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          564 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/gr/gpccs_data.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/gr/gpccs_inst.bin.xz -> ../../gm200/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          136 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/gr/gpccs_sig.bin.xz
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/gr/sw_bundle_init.bin.xz -> ../../gm200/gr/sw_bundle_init.bin.xz
lrwxrwxrwx   1 root     root           28 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/gr/sw_ctx.bin.xz -> ../../gm200/gr/sw_ctx.bin.xz
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/gr/sw_method_init.bin.xz -> ../../gm200/gr/sw_method_init.bin.xz
lrwxrwxrwx   1 root     root           31 Sep 13 15:27 usr/lib/firmware/nvidia/gm206/gr/sw_nonctx.bin.xz -> ../../gm200/gr/sw_nonctx.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp100
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/acr
-rw-r--r--   1 root     root          364 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/acr/bl.bin.xz
-rw-r--r--   1 root     root         4292 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/acr/ucode_load.bin.xz
-rw-r--r--   1 root     root          632 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/acr/ucode_unload.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/gr
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/gr/fecs_bl.bin.xz -> ../../gm200/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          516 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/gr/fecs_data.bin.xz
-rw-r--r--   1 root     root        10096 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          136 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/gr/fecs_sig.bin.xz
lrwxrwxrwx   1 root     root           30 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/gr/gpccs_bl.bin.xz -> ../../gm200/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          608 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/gr/gpccs_data.bin.xz
-rw-r--r--   1 root     root         5928 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          136 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/gr/gpccs_sig.bin.xz
-rw-r--r--   1 root     root         1360 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/gr/sw_bundle_init.bin.xz
-rw-r--r--   1 root     root         1188 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/gr/sw_ctx.bin.xz
-rw-r--r--   1 root     root         1892 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/gr/sw_method_init.bin.xz
-rw-r--r--   1 root     root          656 Sep 13 15:27 usr/lib/firmware/nvidia/gp100/gr/sw_nonctx.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp102
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/acr
-rw-r--r--   4 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/acr/bl.bin.xz
-rw-r--r--   1 root     root         7136 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/acr/ucode_load.bin.xz
-rw-r--r--   1 root     root         1888 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/acr/ucode_unload.bin.xz
-rw-r--r--   4 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/acr/unload_bl.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/gr
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/gr/fecs_bl.bin.xz -> ../../gm200/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          548 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/gr/fecs_data.bin.xz
-rw-r--r--   1 root     root        10128 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          168 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/gr/fecs_sig.bin.xz
lrwxrwxrwx   1 root     root           30 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/gr/gpccs_bl.bin.xz -> ../../gm200/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          584 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/gr/gpccs_data.bin.xz
-rw-r--r--   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          172 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/gr/gpccs_sig.bin.xz
-rw-r--r--   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/gr/sw_bundle_init.bin.xz
-rw-r--r--   1 root     root         1204 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/gr/sw_ctx.bin.xz
-rw-r--r--   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/gr/sw_method_init.bin.xz
-rw-r--r--   1 root     root          720 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/gr/sw_nonctx.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/nvdec
-rw-r--r--   1 root     root         2056 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/sec2
-rw-r--r--   1 root     root          208 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/sec2/desc-1.bin.xz
-rw-r--r--   1 root     root          216 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/sec2/desc.bin.xz
-rw-r--r--   1 root     root        13588 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/sec2/image-1.bin.xz
-rw-r--r--   1 root     root        13236 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/sec2/image.bin.xz
-rw-r--r--   1 root     root          188 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/sec2/sig-1.bin.xz
-rw-r--r--   1 root     root          188 Sep 13 15:27 usr/lib/firmware/nvidia/gp102/sec2/sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp104
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/acr
lrwxrwxrwx   1 root     root           25 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/acr/bl.bin.xz -> ../../gp102/acr/bl.bin.xz
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/acr/ucode_load.bin.xz -> ../../gp102/acr/ucode_load.bin.xz
lrwxrwxrwx   1 root     root           35 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/acr/ucode_unload.bin.xz -> ../../gp102/acr/ucode_unload.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/acr/unload_bl.bin.xz -> ../../gp102/acr/unload_bl.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/gr
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/gr/fecs_bl.bin.xz -> ../../gm200/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          548 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/gr/fecs_data.bin.xz
-rw-r--r--   1 root     root        11320 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          168 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/gr/fecs_sig.bin.xz
lrwxrwxrwx   1 root     root           30 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/gr/gpccs_bl.bin.xz -> ../../gm200/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          584 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/gr/gpccs_data.bin.xz
-rw-r--r--   2 root     root         6156 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          172 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/gr/gpccs_sig.bin.xz
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/gr/sw_bundle_init.bin.xz -> ../../gp102/gr/sw_bundle_init.bin.xz
lrwxrwxrwx   1 root     root           28 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/gr/sw_ctx.bin.xz -> ../../gp102/gr/sw_ctx.bin.xz
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/gr/sw_method_init.bin.xz -> ../../gp102/gr/sw_method_init.bin.xz
lrwxrwxrwx   1 root     root           31 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/gr/sw_nonctx.bin.xz -> ../../gp102/gr/sw_nonctx.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/nvdec
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/nvdec/scrubber.bin.xz -> ../../gp102/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/sec2
lrwxrwxrwx   1 root     root           30 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/sec2/desc-1.bin.xz -> ../../gp102/sec2/desc-1.bin.xz
lrwxrwxrwx   1 root     root           28 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/sec2/desc.bin.xz -> ../../gp102/sec2/desc.bin.xz
lrwxrwxrwx   1 root     root           31 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/sec2/image-1.bin.xz -> ../../gp102/sec2/image-1.bin.xz
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/sec2/image.bin.xz -> ../../gp102/sec2/image.bin.xz
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/sec2/sig-1.bin.xz -> ../../gp102/sec2/sig-1.bin.xz
lrwxrwxrwx   1 root     root           27 Sep 13 15:27 usr/lib/firmware/nvidia/gp104/sec2/sig.bin.xz -> ../../gp102/sec2/sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp106
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/acr
lrwxrwxrwx   1 root     root           25 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/acr/bl.bin.xz -> ../../gp102/acr/bl.bin.xz
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/acr/ucode_load.bin.xz -> ../../gp102/acr/ucode_load.bin.xz
lrwxrwxrwx   1 root     root           35 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/acr/ucode_unload.bin.xz -> ../../gp102/acr/ucode_unload.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/acr/unload_bl.bin.xz -> ../../gp102/acr/unload_bl.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/gr
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/gr/fecs_bl.bin.xz -> ../../gm200/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          548 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/gr/fecs_data.bin.xz
lrwxrwxrwx   1 root     root           31 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/gr/fecs_inst.bin.xz -> ../../gp102/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          168 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/gr/fecs_sig.bin.xz
lrwxrwxrwx   1 root     root           30 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/gr/gpccs_bl.bin.xz -> ../../gm200/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          588 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/gr/gpccs_data.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/gr/gpccs_inst.bin.xz -> ../../gp102/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          172 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/gr/gpccs_sig.bin.xz
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/gr/sw_bundle_init.bin.xz -> ../../gp102/gr/sw_bundle_init.bin.xz
lrwxrwxrwx   1 root     root           28 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/gr/sw_ctx.bin.xz -> ../../gp102/gr/sw_ctx.bin.xz
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/gr/sw_method_init.bin.xz -> ../../gp102/gr/sw_method_init.bin.xz
lrwxrwxrwx   1 root     root           31 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/gr/sw_nonctx.bin.xz -> ../../gp102/gr/sw_nonctx.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/nvdec
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/nvdec/scrubber.bin.xz -> ../../gp102/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/sec2
lrwxrwxrwx   1 root     root           30 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/sec2/desc-1.bin.xz -> ../../gp102/sec2/desc-1.bin.xz
lrwxrwxrwx   1 root     root           28 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/sec2/desc.bin.xz -> ../../gp102/sec2/desc.bin.xz
lrwxrwxrwx   1 root     root           31 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/sec2/image-1.bin.xz -> ../../gp102/sec2/image-1.bin.xz
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/sec2/image.bin.xz -> ../../gp102/sec2/image.bin.xz
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/sec2/sig-1.bin.xz -> ../../gp102/sec2/sig-1.bin.xz
lrwxrwxrwx   1 root     root           27 Sep 13 15:27 usr/lib/firmware/nvidia/gp106/sec2/sig.bin.xz -> ../../gp102/sec2/sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp107
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/acr
lrwxrwxrwx   1 root     root           25 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/acr/bl.bin.xz -> ../../gp102/acr/bl.bin.xz
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/acr/ucode_load.bin.xz -> ../../gp102/acr/ucode_load.bin.xz
lrwxrwxrwx   1 root     root           35 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/acr/ucode_unload.bin.xz -> ../../gp102/acr/ucode_unload.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/acr/unload_bl.bin.xz -> ../../gp102/acr/unload_bl.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/gr
-rw-r--r--   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          588 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/gr/fecs_data.bin.xz
-rw-r--r--   1 root     root        11564 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          168 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/gr/fecs_sig.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          608 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/gr/gpccs_data.bin.xz
-rw-r--r--   1 root     root         5820 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          172 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/gr/gpccs_sig.bin.xz
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/gr/sw_bundle_init.bin.xz -> ../../gp102/gr/sw_bundle_init.bin.xz
-rw-r--r--   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/gr/sw_ctx.bin.xz
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/gr/sw_method_init.bin.xz -> ../../gp102/gr/sw_method_init.bin.xz
-rw-r--r--   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/gr/sw_nonctx.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/nvdec
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/nvdec/scrubber.bin.xz -> ../../gp102/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/sec2
lrwxrwxrwx   1 root     root           30 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/sec2/desc-1.bin.xz -> ../../gp102/sec2/desc-1.bin.xz
lrwxrwxrwx   1 root     root           28 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/sec2/desc.bin.xz -> ../../gp102/sec2/desc.bin.xz
lrwxrwxrwx   1 root     root           31 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/sec2/image-1.bin.xz -> ../../gp102/sec2/image-1.bin.xz
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/sec2/image.bin.xz -> ../../gp102/sec2/image.bin.xz
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/sec2/sig-1.bin.xz -> ../../gp102/sec2/sig-1.bin.xz
lrwxrwxrwx   1 root     root           27 Sep 13 15:27 usr/lib/firmware/nvidia/gp107/sec2/sig.bin.xz -> ../../gp102/sec2/sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp108
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/acr
lrwxrwxrwx   1 root     root           25 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/acr/bl.bin.xz -> ../../gp102/acr/bl.bin.xz
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/acr/ucode_load.bin.xz -> ../../gp102/acr/ucode_load.bin.xz
lrwxrwxrwx   1 root     root           35 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/acr/ucode_unload.bin.xz -> ../../gp102/acr/ucode_unload.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/acr/unload_bl.bin.xz -> ../../gp102/acr/unload_bl.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/gr
-rw-r--r--   2 root     root          280 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          584 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/gr/fecs_data.bin.xz
-rw-r--r--   1 root     root        10224 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          168 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/gr/fecs_sig.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          608 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/gr/gpccs_data.bin.xz
-rw-r--r--   1 root     root         6116 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          172 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/gr/gpccs_sig.bin.xz
-rw-r--r--   2 root     root         1368 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/gr/sw_bundle_init.bin.xz
-rw-r--r--   2 root     root         1196 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/gr/sw_ctx.bin.xz
-rw-r--r--   2 root     root         1936 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/gr/sw_method_init.bin.xz
-rw-r--r--   2 root     root          712 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/gr/sw_nonctx.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/nvdec
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/nvdec/scrubber.bin.xz -> ../../gp102/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/sec2
lrwxrwxrwx   1 root     root           30 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/sec2/desc.bin.xz -> ../../gp102/sec2/desc-1.bin.xz
lrwxrwxrwx   1 root     root           31 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/sec2/image.bin.xz -> ../../gp102/sec2/image-1.bin.xz
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/gp108/sec2/sig.bin.xz -> ../../gp102/sec2/sig-1.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gv100
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/acr
-rw-r--r--   4 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/acr/bl.bin.xz
-rw-r--r--   1 root     root         8036 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/acr/ucode_load.bin.xz
-rw-r--r--   1 root     root         3112 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/acr/ucode_unload.bin.xz
-rw-r--r--   4 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/acr/unload_bl.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/gr
-rw-r--r--   3 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          708 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/gr/fecs_data.bin.xz
-rw-r--r--   1 root     root        13204 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          168 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/gr/fecs_sig.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          660 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/gr/gpccs_data.bin.xz
-rw-r--r--   1 root     root         5972 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          172 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/gr/gpccs_sig.bin.xz
-rw-r--r--   1 root     root         1436 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/gr/sw_bundle_init.bin.xz
-rw-r--r--   1 root     root         1452 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/gr/sw_ctx.bin.xz
-rw-r--r--   1 root     root         1936 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/gr/sw_method_init.bin.xz
-rw-r--r--   1 root     root          732 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/gr/sw_nonctx.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/nvdec
-rw-r--r--   1 root     root         2436 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/sec2
-rw-r--r--   1 root     root          212 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/sec2/desc.bin.xz
-rw-r--r--   1 root     root        14132 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/sec2/image.bin.xz
-rw-r--r--   1 root     root          188 Sep 13 15:27 usr/lib/firmware/nvidia/gv100/sec2/sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/acr
-rw-r--r--   4 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/acr/bl.bin.xz
-rw-r--r--   1 root     root        15580 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/acr/ucode_ahesasc.bin.xz
-rw-r--r--   1 root     root        10788 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/acr/ucode_asb.bin.xz
-rw-r--r--   1 root     root        10168 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/acr/ucode_unload.bin.xz
-rw-r--r--   4 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/acr/unload_bl.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gr
-rw-r--r--   3 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          732 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gr/fecs_data.bin.xz
-rw-r--r--   1 root     root        15164 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          168 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gr/fecs_sig.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          736 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gr/gpccs_data.bin.xz
-rw-r--r--   1 root     root         6176 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          172 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gr/gpccs_sig.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gr/sw_bundle_init.bin.xz
-rw-r--r--   3 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gr/sw_ctx.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gr/sw_method_init.bin.xz
-rw-r--r--   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gr/sw_nonctx.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gr/sw_veid_bundle_init.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gsp
-rw-r--r--   1 root     root        32956 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gsp/booter_load-535.113.01.bin.xz
-rw-r--r--   1 root     root        18316 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gsp/booter_unload-535.113.01.bin.xz
-rw-r--r--   1 root     root          888 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gsp/bootloader-535.113.01.bin.xz
-rw-r--r--   1 root     root     12589816 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/gsp/gsp-535.113.01.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/nvdec
-rw-r--r--   1 root     root         4080 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/sec2
-rw-r--r--   1 root     root          176 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/sec2/desc.bin.xz
-rw-r--r--   1 root     root        12852 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/sec2/image.bin.xz
-rw-r--r--   1 root     root          192 Sep 13 15:27 usr/lib/firmware/nvidia/tu102/sec2/sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu104
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/acr
lrwxrwxrwx   1 root     root           25 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/acr/bl.bin.xz -> ../../tu102/acr/bl.bin.xz
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/acr/ucode_ahesasc.bin.xz -> ../../tu102/acr/ucode_ahesasc.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/acr/ucode_asb.bin.xz -> ../../tu102/acr/ucode_asb.bin.xz
lrwxrwxrwx   1 root     root           35 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/acr/ucode_unload.bin.xz -> ../../tu102/acr/ucode_unload.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/acr/unload_bl.bin.xz -> ../../tu102/acr/unload_bl.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gr
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gr/fecs_bl.bin.xz -> ../../tu102/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          732 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gr/fecs_data.bin.xz
-rw-r--r--   1 root     root        15164 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          168 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gr/fecs_sig.bin.xz
lrwxrwxrwx   1 root     root           30 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gr/gpccs_bl.bin.xz -> ../../tu102/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          736 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gr/gpccs_data.bin.xz
-rw-r--r--   1 root     root         6176 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          172 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gr/gpccs_sig.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gr/sw_bundle_init.bin.xz
-rw-r--r--   3 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gr/sw_ctx.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gr/sw_method_init.bin.xz
-rw-r--r--   1 root     root          856 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gr/sw_nonctx.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gr/sw_veid_bundle_init.bin.xz
lrwxrwxrwx   1 root     root           12 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/gsp -> ../tu102/gsp
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/nvdec
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/nvdec/scrubber.bin.xz -> ../../tu102/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/sec2
lrwxrwxrwx   1 root     root           28 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/sec2/desc.bin.xz -> ../../tu102/sec2/desc.bin.xz
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/sec2/image.bin.xz -> ../../tu102/sec2/image.bin.xz
lrwxrwxrwx   1 root     root           27 Sep 13 15:27 usr/lib/firmware/nvidia/tu104/sec2/sig.bin.xz -> ../../tu102/sec2/sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu106
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/acr
lrwxrwxrwx   1 root     root           25 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/acr/bl.bin.xz -> ../../tu102/acr/bl.bin.xz
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/acr/ucode_ahesasc.bin.xz -> ../../tu102/acr/ucode_ahesasc.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/acr/ucode_asb.bin.xz -> ../../tu102/acr/ucode_asb.bin.xz
lrwxrwxrwx   1 root     root           35 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/acr/ucode_unload.bin.xz -> ../../tu102/acr/ucode_unload.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/acr/unload_bl.bin.xz -> ../../tu102/acr/unload_bl.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gr
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gr/fecs_bl.bin.xz -> ../../tu102/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          732 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gr/fecs_data.bin.xz
-rw-r--r--   1 root     root        15164 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          168 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gr/fecs_sig.bin.xz
lrwxrwxrwx   1 root     root           30 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gr/gpccs_bl.bin.xz -> ../../tu102/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          736 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gr/gpccs_data.bin.xz
-rw-r--r--   1 root     root         6176 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          172 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gr/gpccs_sig.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gr/sw_bundle_init.bin.xz
-rw-r--r--   3 root     root         1268 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gr/sw_ctx.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gr/sw_method_init.bin.xz
-rw-r--r--   2 root     root          856 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gr/sw_nonctx.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gr/sw_veid_bundle_init.bin.xz
lrwxrwxrwx   1 root     root           12 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/gsp -> ../tu102/gsp
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/nvdec
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/nvdec/scrubber.bin.xz -> ../../tu102/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/sec2
lrwxrwxrwx   1 root     root           28 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/sec2/desc.bin.xz -> ../../tu102/sec2/desc.bin.xz
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/sec2/image.bin.xz -> ../../tu102/sec2/image.bin.xz
lrwxrwxrwx   1 root     root           27 Sep 13 15:27 usr/lib/firmware/nvidia/tu106/sec2/sig.bin.xz -> ../../tu102/sec2/sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu116
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/acr
-rw-r--r--   4 root     root          384 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/acr/bl.bin.xz
-rw-r--r--   1 root     root        15596 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/acr/ucode_ahesasc.bin.xz
-rw-r--r--   1 root     root        10864 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/acr/ucode_asb.bin.xz
-rw-r--r--   1 root     root        10240 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/acr/ucode_unload.bin.xz
-rw-r--r--   4 root     root          384 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/acr/unload_bl.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gr
-rw-r--r--   3 root     root          276 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          732 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gr/fecs_data.bin.xz
-rw-r--r--   1 root     root        15032 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          172 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gr/fecs_sig.bin.xz
-rw-r--r--   5 root     root          276 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          732 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gr/gpccs_data.bin.xz
-rw-r--r--   1 root     root         6176 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          172 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gr/gpccs_sig.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gr/sw_bundle_init.bin.xz
-rw-r--r--   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gr/sw_ctx.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gr/sw_method_init.bin.xz
-rw-r--r--   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gr/sw_nonctx.bin.xz
-rw-r--r--   5 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gr/sw_veid_bundle_init.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gsp
-rw-r--r--   1 root     root        32964 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gsp/booter_load-535.113.01.bin.xz
-rw-r--r--   1 root     root        18308 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gsp/booter_unload-535.113.01.bin.xz
lrwxrwxrwx   1 root     root           44 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gsp/bootloader-535.113.01.bin.xz -> ../../tu102/gsp/bootloader-535.113.01.bin.xz
lrwxrwxrwx   1 root     root           37 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/gsp/gsp-535.113.01.bin.xz -> ../../tu102/gsp/gsp-535.113.01.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/nvdec
-rw-r--r--   1 root     root         3524 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/sec2
-rw-r--r--   1 root     root          176 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/sec2/desc.bin.xz
-rw-r--r--   1 root     root        12848 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/sec2/image.bin.xz
-rw-r--r--   1 root     root          188 Sep 13 15:27 usr/lib/firmware/nvidia/tu116/sec2/sig.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu117
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/acr
lrwxrwxrwx   1 root     root           25 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/acr/bl.bin.xz -> ../../tu116/acr/bl.bin.xz
lrwxrwxrwx   1 root     root           36 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/acr/ucode_ahesasc.bin.xz -> ../../tu116/acr/ucode_ahesasc.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/acr/ucode_asb.bin.xz -> ../../tu116/acr/ucode_asb.bin.xz
lrwxrwxrwx   1 root     root           35 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/acr/ucode_unload.bin.xz -> ../../tu116/acr/ucode_unload.bin.xz
lrwxrwxrwx   1 root     root           32 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/acr/unload_bl.bin.xz -> ../../tu116/acr/unload_bl.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gr
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gr/fecs_bl.bin.xz -> ../../tu116/gr/fecs_bl.bin.xz
-rw-r--r--   1 root     root          732 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gr/fecs_data.bin.xz
-rw-r--r--   1 root     root        15032 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gr/fecs_inst.bin.xz
-rw-r--r--   1 root     root          172 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gr/fecs_sig.bin.xz
lrwxrwxrwx   1 root     root           30 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gr/gpccs_bl.bin.xz -> ../../tu116/gr/gpccs_bl.bin.xz
-rw-r--r--   1 root     root          736 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gr/gpccs_data.bin.xz
-rw-r--r--   1 root     root         6176 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gr/gpccs_inst.bin.xz
-rw-r--r--   1 root     root          172 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gr/gpccs_sig.bin.xz
-rw-r--r--   5 root     root         1548 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gr/sw_bundle_init.bin.xz
-rw-r--r--   2 root     root         1268 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gr/sw_ctx.bin.xz
-rw-r--r--   5 root     root         2156 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gr/sw_method_init.bin.xz
-rw-r--r--   2 root     root          856 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gr/sw_nonctx.bin.xz
-rw-r--r--   5 root     root          144 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gr/sw_veid_bundle_init.bin.xz
lrwxrwxrwx   1 root     root           12 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/gsp -> ../tu116/gsp
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/nvdec
lrwxrwxrwx   1 root     root           33 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/nvdec/scrubber.bin.xz -> ../../tu116/nvdec/scrubber.bin.xz
drwxr-xr-x   2 root     root            0 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/sec2
lrwxrwxrwx   1 root     root           28 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/sec2/desc.bin.xz -> ../../tu116/sec2/desc.bin.xz
lrwxrwxrwx   1 root     root           29 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/sec2/image.bin.xz -> ../../tu116/sec2/image.bin.xz
lrwxrwxrwx   1 root     root           27 Sep 13 15:27 usr/lib/firmware/nvidia/tu117/sec2/sig.bin.xz -> ../../tu116/sec2/sig.bin.xz
-rw-r--r--   1 root     root         1797 Sep 13 15:27 usr/lib/modprobe.d/50-nvidia-default.conf
-rw-r--r--   1 root     root           18 Sep 13 15:27 usr/lib/modprobe.d/nvidia-default.conf
-rw-r--r--   1 root     root        14070 Sep 13 15:27 usr/lib/modules/6.11.3-2-default/kernel/drivers/hid/hid-nvidia-shield.ko.zst
-rw-r--r--   1 root     root         3020 Sep 13 15:27 usr/lib/modules/6.11.3-2-default/kernel/drivers/usb/typec/altmodes/typec_nvidia.ko.zst
-rw-r--r--   1 root     root      2753872 Sep 13 15:27 usr/lib/modules/6.11.3-2-default/updates/nvidia-modeset.ko
-rw-r--r--   1 root     root      6305088 Sep 13 15:27 usr/lib/modules/6.11.3-2-default/updates/nvidia-uvm.k
  • CONFS:
/usr/lib/modprobe.d/50-nvidia-default.conf



# NVreg_PreserveVideoMemoryAllocations needed for GNOME Wayland
options nvidia NVreg_DeviceFileUID=0 NVreg_DeviceFileGID=482 NVreg_DeviceFileMode=0660 NVreg_PreserveVideoMemoryAllocations=1
options nvidia-drm modeset=1 fbdev=1
install nvidia PATH=$PATH:/bin:/usr/bin; if /sbin/modprobe --ignore-install nvidia; then   if /sbin/modprobe nvidia_uvm; then     if [ ! -c /dev/nvidia-uvm ]; then       mknod -m 660 /dev/nvidia-uvm c $(cat /proc/devices | while read major device; do if [ "$device" = "nvidia-uvm" ]; then echo $major; break; fi ; done) 0;        chown :video /dev/nvidia-uvm;     fi;     if [ ! -c /dev/nvidia-uvm-tools ]; then       mknod -m 660 /dev/nvidia-uvm-tools c $(cat /proc/devices | while read major device; do if [ "$device" = "nvidia-uvm" ]; then echo $major; break; fi ; done) 1;       chown :video /dev/nvidia-uvm-tools;     fi;   fi;   if [ ! -c /dev/nvidiactl ]; then     mknod -m 660 /dev/nvidiactl c 195 255;     chown :video /dev/nvidiactl;   fi;   devid=-1;   for dev in $(ls -d /sys/bus/pci/devices/*); do      vendorid=$(cat $dev/vendor);     if [ "$vendorid" = "0x10de" ]; then       class=$(cat $dev/class);       classid=${class%%00};       if [ "$classid" = "0x0300" -o "$classid" = "0x0302" ]; then          devid=$((devid+1));         if [ ! -L /run/udev/static_node-tags/uaccess/nvidia${devid} ]; then            ln -snf /dev/nvidia${devid} /run/udev/static_node-tags/uaccess/nvidia${devid};         fi;         if [ ! -c /dev/nvidia${devid} ]; then            mknod -m 660 /dev/nvidia${devid} c 195 ${devid};            chown :video /dev/nvidia${devid};         fi;       fi;     fi;   done;   /sbin/modprobe nvidia_drm;   if [ ! -c /dev/nvidia-modeset ]; then     mknod -m 660 /dev/nvidia-modeset c 195 254;     chown :video /dev/nvidia-modeset;   fi; fi
/usr/lib/modprobe.d/50-nvidia-default.conf



blacklist nouveau
  • CMDLINE:
cat /proc/cmdline



BOOT_IMAGE=/boot/vmlinuz-6.11.3-2-default root=UUID=fb1706c2-2148-425e-a97d-4d05048a3b4b splash=silent quiet security=
  • INFOS:
cat /proc/driver/nvidia/gpus/0000\:0a\:00.0/information



Model:           NVIDIA GeForce GTX 1660 SUPER
IRQ:             111
GPU UUID:        GPU-e742497b-AAAA-1111-BBBB-2222CCCC3333
Video BIOS:      90.16.4d.00.32
Bus Type:        PCIe
DMA Size:        47 bits
DMA Mask:        0x7fffffffffff
Bus Location:    0000:0a:00.0
Device Minor:    0
GPU Excluded:    No
  • TRACE:
ott 25 09:07:34 SUSNEPO systemd-logind[1328]: The system will suspend now!
ott 25 09:07:34 SUSNEPO NetworkManager[1324]: <info>  [1729840054.6906] manager: sleep: sleep requested (sleeping: no  enabled: yes)
ott 25 09:07:34 SUSNEPO NetworkManager[1324]: <info>  [1729840054.6908] device (wlp6s0): state change: disconnected -> unmanaged (reason 'unmanaged-sleeping', managed-type: 'full')
ott 25 09:07:34 SUSNEPO ModemManager[1238]: <msg> [sleep-monitor-systemd] system is about to suspend
ott 25 09:07:34 SUSNEPO NetworkManager[1324]: <info>  [1729840054.7359] device (wlp6s0): set-hw-addr: reset MAC address to XX:XX:XX:XX:XX:XX (unmanage)
ott 25 09:07:34 SUSNEPO NetworkManager[1324]: <info>  [1729840054.7390] device (p2p-dev-wlp6s0): state change: disconnected -> unmanaged (reason 'unmanaged-sleeping', managed-type: 'full')
ott 25 09:07:34 SUSNEPO NetworkManager[1324]: <info>  [1729840054.7395] manager: NetworkManager state is now ASLEEP
ott 25 09:07:34 SUSNEPO systemd[1]: Reached target Sleep.
ott 25 09:07:34 SUSNEPO systemd[1]: Starting NVIDIA system suspend actions...
ott 25 09:07:34 SUSNEPO systemd[1]: Starting PackageKit Daemon...
ott 25 09:07:34 SUSNEPO PackageKit[26419]: daemon start
ott 25 09:07:34 SUSNEPO suspend[26418]: nvidia-suspend.service
ott 25 09:07:34 SUSNEPO logger[26418]: <13>Oct 25 09:07:34 suspend: nvidia-suspend.service
ott 25 09:07:34 SUSNEPO systemd[1]: Started PackageKit Daemon.
ott 25 09:07:35 SUSNEPO kded6[1804]: org.kde.pulseaudio: No object for name "alsa_output.pci-0000_0c_00.3.iec958-stereo.monitor"
ott 25 09:07:35 SUSNEPO kded6[1804]: org.kde.pulseaudio: No object for name "alsa_output.pci-0000_0c_00.3.iec958-stereo.monitor"
ott 25 09:07:35 SUSNEPO bluetoothd[1179]: Endpoint unregistered: sender=:1.196 path=/MediaEndpoint/A2DPSource/ldac
ott 25 09:07:35 SUSNEPO bluetoothd[1179]: Endpoint unregistered: sender=:1.196 path=/MediaEndpoint/A2DPSink/aac
ott 25 09:07:35 SUSNEPO bluetoothd[1179]: Endpoint unregistered: sender=:1.196 path=/MediaEndpoint/A2DPSource/aac
ott 25 09:07:35 SUSNEPO bluetoothd[1179]: Endpoint unregistered: sender=:1.196 path=/MediaEndpoint/A2DPSink/opus_g
ott 25 09:07:35 SUSNEPO bluetoothd[1179]: Endpoint unregistered: sender=:1.196 path=/MediaEndpoint/A2DPSource/opus_g
ott 25 09:07:35 SUSNEPO bluetoothd[1179]: Endpoint unregistered: sender=:1.196 path=/MediaEndpoint/A2DPSink/sbc
ott 25 09:07:35 SUSNEPO bluetoothd[1179]: Endpoint unregistered: sender=:1.196 path=/MediaEndpoint/A2DPSource/sbc
ott 25 09:07:35 SUSNEPO bluetoothd[1179]: Endpoint unregistered: sender=:1.196 path=/MediaEndpoint/A2DPSource/faststream
ott 25 09:07:35 SUSNEPO bluetoothd[1179]: Endpoint unregistered: sender=:1.196 path=/MediaEndpoint/A2DPSource/faststream_duplex
ott 25 09:07:35 SUSNEPO bluetoothd[1179]: Endpoint unregistered: sender=:1.196 path=/MediaEndpoint/A2DPSink/opus_05
ott 25 09:07:35 SUSNEPO bluetoothd[1179]: Endpoint unregistered: sender=:1.196 path=/MediaEndpoint/A2DPSource/opus_05
ott 25 09:07:35 SUSNEPO bluetoothd[1179]: Endpoint unregistered: sender=:1.196 path=/MediaEndpoint/A2DPSink/opus_05_duplex
ott 25 09:07:35 SUSNEPO bluetoothd[1179]: Endpoint unregistered: sender=:1.196 path=/MediaEndpoint/A2DPSource/opus_05_duplex
ott 25 09:07:35 SUSNEPO kernel: ------------[ cut here ]------------
ott 25 09:07:35 SUSNEPO kernel: WARNING: CPU: 2 PID: 26420 at include/linux/rwsem.h:80 follow_pte+0x1de/0x200
ott 25 09:07:35 SUSNEPO kernel: Modules linked in: binfmt_misc ext4 mbcache jbd2 snd_seq_dummy snd_hrtimer snd_seq snd_seq_device rfcomm af_packet nvidia_drm(POE) nvidia_modeset(POE) nf_tables nvidia_uvm(POE) qrtr iptable_filter cmac algif_hash algif_skcipher af_alg bnep nvidia(POE) snd_hda_codec_realtek snd_hda_codec_generic nls_iso8859_1 nls_cp437 vfat fat snd_hda_scodec_component snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec iwlmvm snd_hda_core mac80211 libarc4 snd_hwdep iwlwifi snd_pcm ee1004 btusb snd_timer btrtl btintel snd eeepc_wmi btbcm btmtk joydev ucsi_ccg typec_ucsi igb typec soundcore roles asus_wmi i2c_piix4 intel_rapl_msr i2c_nvidia_gpu amd_atl cfg80211 bluetooth i2c_algo_bit i2c_ccgx_ucsi i2c_smbus platform_profile drm_ttm_helper intel_rapl_common battery ttm k10temp sparse_keymap dca rfkill video pcspkr edac_mce_amd wmi_bmof acpi_cpufreq gpio_amdpt tiny_power_button gpio_generic dm_mod nvme_fabrics efi_pstore fuse configfs nvme_keyring loop nfnetlink zram dmi_sysfs ip_tables x_tables
ott 25 09:07:35 SUSNEPO kernel:  hid_generic usbhid crct10dif_pclmul crc32_pclmul polyval_clmulni polyval_generic ghash_clmulni_intel ahci sha512_ssse3 sha256_ssse3 libahci sha1_ssse3 libata xhci_pci xhci_pci_renesas sd_mod nvme xhci_hcd scsi_dh_emc scsi_dh_rdac scsi_dh_alua aesni_intel sg mxm_wmi gf128mul scsi_mod nvme_core crypto_simd usbcore ccp cryptd sp5100_tco scsi_common nvme_auth wmi button btrfs blake2b_generic libcrc32c crc32c_intel xor raid6_pq msr i2c_dev efivarfs
ott 25 09:07:35 SUSNEPO kernel: CPU: 2 UID: 0 PID: 26420 Comm: nvidia-sleep.sh Tainted: P        W  OE      6.11.3-2-default #1 openSUSE Tumbleweed 1400000003000000474e550044a7c39aab7c62ed
ott 25 09:07:35 SUSNEPO kernel: Tainted: [P]=PROPRIETARY_MODULE, [W]=WARN, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
ott 25 09:07:35 SUSNEPO kernel: Hardware name: System manufacturer System Product Name/PRIME X370-PRO, BIOS 6203 07/27/2023
ott 25 09:07:35 SUSNEPO kernel: RIP: 0010:follow_pte+0x1de/0x200
ott 25 09:07:35 SUSNEPO kernel: Code: cc cc cc 48 81 e2 00 00 00 c0 48 09 c2 48 f7 d2 48 85 fa 75 20 e8 42 f1 ff ff 48 8b 35 5b ce 3a 01 48 81 e6 00 00 00 c0 eb 8d <0f> 0b 48 3b 1f 0f 83 50 fe ff ff bd ea ff ff ff eb b6 49 8b 3c 24
ott 25 09:07:35 SUSNEPO kernel: RSP: 0018:ffffac6accadf780 EFLAGS: 00010246
ott 25 09:07:35 SUSNEPO kernel: RAX: 0000000000000000 RBX: 00007f6417e11000 RCX: ffffac6accadf7c0
ott 25 09:07:35 SUSNEPO kernel: RDX: ffffac6accadf7b8 RSI: 00007f6417e11000 RDI: ffff9f52c1cf8e60
ott 25 09:07:35 SUSNEPO kernel: RBP: ffffac6accadf800 R08: ffffac6accadf958 R09: 0000000000000000
ott 25 09:07:35 SUSNEPO kernel: R10: 000000000040003b R11: 0000000000000000 R12: ffffac6accadf7c0
ott 25 09:07:35 SUSNEPO kernel: R13: ffffac6accadf7b8 R14: ffff9f52c1880000 R15: 0000000000000000
ott 25 09:07:35 SUSNEPO kernel: FS:  00007fb48df3a600(0000) GS:ffff9f55de900000(0000) knlGS:0000000000000000
ott 25 09:07:35 SUSNEPO kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
ott 25 09:07:35 SUSNEPO kernel: CR2: 00007fb48ddfd650 CR3: 000000036ea36000 CR4: 00000000003506f0
ott 25 09:07:35 SUSNEPO kernel: Call Trace:
ott 25 09:07:35 SUSNEPO kernel:  <TASK>
ott 25 09:07:35 SUSNEPO kernel:  ? follow_pte+0x1de/0x200
ott 25 09:07:35 SUSNEPO kernel:  ? __warn.cold+0x8e/0xe8
ott 25 09:07:35 SUSNEPO kernel:  ? follow_pte+0x1de/0x200
ott 25 09:07:35 SUSNEPO kernel:  ? report_bug+0xff/0x140
ott 25 09:07:35 SUSNEPO kernel:  ? handle_bug+0x3c/0x80
ott 25 09:07:35 SUSNEPO kernel:  ? exc_invalid_op+0x17/0x70
ott 25 09:07:35 SUSNEPO kernel:  ? asm_exc_invalid_op+0x1a/0x20
ott 25 09:07:35 SUSNEPO kernel:  ? follow_pte+0x1de/0x200
ott 25 09:07:35 SUSNEPO kernel:  follow_phys+0x38/0x100
ott 25 09:07:35 SUSNEPO kernel:  ? __mod_memcg_lruvec_state+0xa0/0x150
ott 25 09:07:35 SUSNEPO kernel:  untrack_pfn+0x55/0x120
ott 25 09:07:35 SUSNEPO kernel:  ? __pfx_folio_activate_fn+0x10/0x10
ott 25 09:07:35 SUSNEPO kernel:  unmap_single_vma+0xa6/0xe0
ott 25 09:07:35 SUSNEPO kernel:  zap_page_range_single+0xe9/0x190
ott 25 09:07:35 SUSNEPO kernel:  ? _nv002570kms+0x17b/0x210 [nvidia_modeset 1400000003000000474e5500cb19774dc80307d8]
ott 25 09:07:35 SUSNEPO kernel:  ? kfree+0x2f3/0x360
ott 25 09:07:35 SUSNEPO kernel:  unmap_mapping_range+0x116/0x140
ott 25 09:07:35 SUSNEPO kernel:  nv_revoke_gpu_mappings_locked+0x47/0x70 [nvidia 1400000003000000474e55000a459970204cf790]
ott 25 09:07:35 SUSNEPO kernel:  nv_set_system_power_state+0x1cd/0x470 [nvidia 1400000003000000474e55000a459970204cf790]
ott 25 09:07:35 SUSNEPO kernel:  nv_procfs_write_suspend+0xef/0x170 [nvidia 1400000003000000474e55000a459970204cf790]
ott 25 09:07:35 SUSNEPO kernel:  proc_reg_write+0x5a/0xa0
ott 25 09:07:35 SUSNEPO kernel:  vfs_write+0xf5/0x430
ott 25 09:07:35 SUSNEPO kernel:  ? _copy_to_user+0x24/0x40
ott 25 09:07:35 SUSNEPO kernel:  ? cp_new_stat+0x14d/0x190
ott 25 09:07:35 SUSNEPO kernel:  ksys_write+0x65/0xe0
ott 25 09:07:35 SUSNEPO kernel:  do_syscall_64+0x82/0x160
ott 25 09:07:35 SUSNEPO kernel:  ? __do_sys_newfstat+0x57/0x60
ott 25 09:07:35 SUSNEPO kernel:  ? syscall_exit_to_user_mode+0x10/0x220
ott 25 09:07:35 SUSNEPO kernel:  ? do_syscall_64+0x8e/0x160
ott 25 09:07:35 SUSNEPO kernel:  ? f_dupfd+0x59/0xa0
ott 25 09:07:35 SUSNEPO kernel:  ? get_close_on_exec+0x34/0x40
ott 25 09:07:35 SUSNEPO kernel:  ? do_fcntl+0x2d5/0x700
ott 25 09:07:35 SUSNEPO kernel:  ? __x64_sys_fcntl+0x98/0xd0
ott 25 09:07:35 SUSNEPO kernel:  ? syscall_exit_to_user_mode+0x10/0x220
ott 25 09:07:35 SUSNEPO kernel:  ? do_syscall_64+0x8e/0x160
ott 25 09:07:35 SUSNEPO kernel:  ? ptep_set_access_flags+0x32/0x40
ott 25 09:07:35 SUSNEPO kernel:  ? wp_page_reuse+0x8d/0xa0
ott 25 09:07:35 SUSNEPO kernel:  ? do_wp_page+0x7ad/0xbc0
ott 25 09:07:35 SUSNEPO kernel:  ? do_sys_openat2+0x82/0xc0
ott 25 09:07:35 SUSNEPO kernel:  ? __pte_offset_map+0x1b/0x180
ott 25 09:07:35 SUSNEPO kernel:  ? __handle_mm_fault+0xaed/0x1020
ott 25 09:07:35 SUSNEPO kernel:  ? syscall_exit_to_user_mode+0x10/0x220
ott 25 09:07:35 SUSNEPO kernel:  ? do_syscall_64+0x8e/0x160
ott 25 09:07:35 SUSNEPO kernel:  ? filp_close+0x1d/0x30
ott 25 09:07:35 SUSNEPO kernel:  ? do_dup2+0xad/0x130
ott 25 09:07:35 SUSNEPO kernel:  ? syscall_exit_to_user_mode+0x10/0x220
ott 25 09:07:35 SUSNEPO kernel:  ? do_syscall_64+0x8e/0x160
ott 25 09:07:35 SUSNEPO kernel:  ? exc_page_fault+0x73/0x170
ott 25 09:07:35 SUSNEPO kernel:  entry_SYSCALL_64_after_hwframe+0x76/0x7e
ott 25 09:07:35 SUSNEPO kernel: RIP: 0033:0x7fb48dd0fea4
ott 25 09:07:35 SUSNEPO kernel: Code: 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 90 90 80 3d 05 ab 0f 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 48 83 ec 28 48 89 54 24 18 48
ott 25 09:07:35 SUSNEPO kernel: RSP: 002b:00007ffc7b5e40a8 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
ott 25 09:07:35 SUSNEPO kernel: RAX: ffffffffffffffda RBX: 0000000000000008 RCX: 00007fb48dd0fea4
ott 25 09:07:35 SUSNEPO kernel: RDX: 0000000000000008 RSI: 000056272f36f860 RDI: 0000000000000001
ott 25 09:07:35 SUSNEPO kernel: RBP: 000056272f36f860 R08: 00007fb48ddfcac0 R09: 0000000000000004
ott 25 09:07:35 SUSNEPO kernel: R10: 00007fb48ddfcb30 R11: 0000000000000202 R12: 0000000000000008
ott 25 09:07:35 SUSNEPO kernel: R13: 00007fb48ddfd5c0 R14: 00007fb48ddfaea0 R15: 0000000000000001
ott 25 09:07:35 SUSNEPO kernel:  </TASK>
ott 25 09:07:35 SUSNEPO kernel: ---[ end trace 0000000000000000 ]---
ott 25 09:07:35 SUSNEPO kernel: ------------[ cut here ]------------
ott 25 09:07:35 SUSNEPO kernel: WARNING: CPU: 2 PID: 26420 at include/linux/rwsem.h:80 follow_pte+0x1de/0x200
ott 25 09:07:35 SUSNEPO kernel: Modules linked in: binfmt_misc ext4 mbcache jbd2 snd_seq_dummy snd_hrtimer snd_seq snd_seq_device rfcomm af_packet nvidia_drm(POE) nvidia_modeset(POE) nf_tables nvidia_uvm(POE) qrtr iptable_filter cmac algif_hash algif_skcipher af_alg bnep nvidia(POE) snd_hda_codec_realtek snd_hda_codec_generic nls_iso8859_1 nls_cp437 vfat fat snd_hda_scodec_component snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec iwlmvm snd_hda_core mac80211 libarc4 snd_hwdep iwlwifi snd_pcm ee1004 btusb snd_timer btrtl btintel snd eeepc_wmi btbcm btmtk joydev ucsi_ccg typec_ucsi igb typec soundcore roles asus_wmi i2c_piix4 intel_rapl_msr i2c_nvidia_gpu amd_atl cfg80211 bluetooth i2c_algo_bit i2c_ccgx_ucsi i2c_smbus platform_profile drm_ttm_helper intel_rapl_common battery ttm k10temp sparse_keymap dca rfkill video pcspkr edac_mce_amd wmi_bmof acpi_cpufreq gpio_amdpt tiny_power_button gpio_generic dm_mod nvme_fabrics efi_pstore fuse configfs nvme_keyring loop nfnetlink zram dmi_sysfs ip_tables x_tables
ott 25 09:07:35 SUSNEPO kernel:  hid_generic usbhid crct10dif_pclmul crc32_pclmul polyval_clmulni polyval_generic ghash_clmulni_intel ahci sha512_ssse3 sha256_ssse3 libahci sha1_ssse3 libata xhci_pci xhci_pci_renesas sd_mod nvme xhci_hcd scsi_dh_emc scsi_dh_rdac scsi_dh_alua aesni_intel sg mxm_wmi gf128mul scsi_mod nvme_core crypto_simd usbcore ccp cryptd sp5100_tco scsi_common nvme_auth wmi button btrfs blake2b_generic libcrc32c crc32c_intel xor raid6_pq msr i2c_dev efivarfs
ott 25 09:07:35 SUSNEPO kernel: CPU: 2 UID: 0 PID: 26420 Comm: nvidia-sleep.sh Tainted: P        W  OE      6.11.3-2-default #1 openSUSE Tumbleweed 1400000003000000474e550044a7c39aab7c62ed
ott 25 09:07:35 SUSNEPO kernel: Tainted: [P]=PROPRIETARY_MODULE, [W]=WARN, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
ott 25 09:07:35 SUSNEPO kernel: Hardware name: System manufacturer System Product Name/PRIME X370-PRO, BIOS 6203 07/27/2023
ott 25 09:07:35 SUSNEPO kernel: RIP: 0010:follow_pte+0x1de/0x200
ott 25 09:07:35 SUSNEPO kernel: Code: cc cc cc 48 81 e2 00 00 00 c0 48 09 c2 48 f7 d2 48 85 fa 75 20 e8 42 f1 ff ff 48 8b 35 5b ce 3a 01 48 81 e6 00 00 00 c0 eb 8d <0f> 0b 48 3b 1f 0f 83 50 fe ff ff bd ea ff ff ff eb b6 49 8b 3c 24
ott 25 09:07:35 SUSNEPO kernel: RSP: 0018:ffffac6accadf780 EFLAGS: 00010246
ott 25 09:07:35 SUSNEPO kernel: RAX: 0000000000000000 RBX: 00007efc88e51000 RCX: ffffac6accadf7c0
ott 25 09:07:35 SUSNEPO kernel: RDX: ffffac6accadf7b8 RSI: 00007efc88e51000 RDI: ffff9f53b75a9648
ott 25 09:07:35 SUSNEPO kernel: RBP: ffffac6accadf800 R08: ffffac6accadf958 R09: 0000000000000000
ott 25 09:07:35 SUSNEPO kernel: R10: ffff9f52d3b97890 R11: 0000000000000000 R12: ffffac6accadf7c0
ott 25 09:07:35 SUSNEPO kernel: R13: ffffac6accadf7b8 R14: ffff9f52c1611b80 R15: 0000000000000000
ott 25 09:07:35 SUSNEPO kernel: FS:  00007fb48df3a600(0000) GS:ffff9f55de900000(0000) knlGS:0000000000000000
ott 25 09:07:35 SUSNEPO kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
ott 25 09:07:35 SUSNEPO kernel: CR2: 00007fb48ddfd650 CR3: 000000036ea36000 CR4: 00000000003506f0
ott 25 09:07:35 SUSNEPO kernel: Call Trace:
ott 25 09:07:35 SUSNEPO kernel:  <TASK>
ott 25 09:07:35 SUSNEPO kernel:  ? follow_pte+0x1de/0x200
ott 25 09:07:35 SUSNEPO kernel:  ? __warn.cold+0x8e/0xe8
ott 25 09:07:35 SUSNEPO kernel:  ? follow_pte+0x1de/0x200
ott 25 09:07:35 SUSNEPO kernel:  ? report_bug+0xff/0x140
ott 25 09:07:35 SUSNEPO kernel:  ? handle_bug+0x3c/0x80
ott 25 09:07:35 SUSNEPO kernel:  ? exc_invalid_op+0x17/0x70
ott 25 09:07:35 SUSNEPO kernel:  ? asm_exc_invalid_op+0x1a/0x20
ott 25 09:07:35 SUSNEPO kernel:  ? follow_pte+0x1de/0x200
ott 25 09:07:35 SUSNEPO kernel:  follow_phys+0x38/0x100
ott 25 09:07:35 SUSNEPO kernel:  untrack_pfn+0x55/0x120
ott 25 09:07:35 SUSNEPO kernel:  unmap_single_vma+0xa6/0xe0
ott 25 09:07:35 SUSNEPO kernel:  zap_page_range_single+0xe9/0x190
ott 25 09:07:35 SUSNEPO kernel:  ? _nv002570kms+0x17b/0x210 [nvidia_modeset 1400000003000000474e5500cb19774dc80307d8]
ott 25 09:07:35 SUSNEPO kernel:  ? kfree+0x2f3/0x360
ott 25 09:07:35 SUSNEPO kernel:  unmap_mapping_range+0x116/0x140
ott 25 09:07:35 SUSNEPO kernel:  nv_revoke_gpu_mappings_locked+0x47/0x70 [nvidia 1400000003000000474e55000a459970204cf790]
ott 25 09:07:35 SUSNEPO kernel:  nv_set_system_power_state+0x1cd/0x470 [nvidia 1400000003000000474e55000a459970204cf790]
ott 25 09:07:35 SUSNEPO kernel:  nv_procfs_write_suspend+0xef/0x170 [nvidia 1400000003000000474e55000a459970204cf790]
ott 25 09:07:35 SUSNEPO kernel:  proc_reg_write+0x5a/0xa0
ott 25 09:07:35 SUSNEPO kernel:  vfs_write+0xf5/0x430
ott 25 09:07:35 SUSNEPO kernel:  ? _copy_to_user+0x24/0x40
ott 25 09:07:35 SUSNEPO kernel:  ? cp_new_stat+0x14d/0x190
ott 25 09:07:35 SUSNEPO kernel:  ksys_write+0x65/0xe0
ott 25 09:07:35 SUSNEPO kernel:  do_syscall_64+0x82/0x160
ott 25 09:07:35 SUSNEPO kernel:  ? __do_sys_newfstat+0x57/0x60
ott 25 09:07:35 SUSNEPO kernel:  ? syscall_exit_to_user_mode+0x10/0x220
ott 25 09:07:35 SUSNEPO kernel:  ? do_syscall_64+0x8e/0x160
ott 25 09:07:35 SUSNEPO kernel:  ? f_dupfd+0x59/0xa0
ott 25 09:07:35 SUSNEPO kernel:  ? get_close_on_exec+0x34/0x40
ott 25 09:07:35 SUSNEPO kernel:  ? do_fcntl+0x2d5/0x700
ott 25 09:07:35 SUSNEPO kernel:  ? __x64_sys_fcntl+0x98/0xd0
ott 25 09:07:35 SUSNEPO kernel:  ? syscall_exit_to_user_mode+0x10/0x220
ott 25 09:07:35 SUSNEPO kernel:  ? do_syscall_64+0x8e/0x160
ott 25 09:07:35 SUSNEPO kernel:  ? ptep_set_access_flags+0x32/0x40
ott 25 09:07:35 SUSNEPO kernel:  ? wp_page_reuse+0x8d/0xa0
ott 25 09:07:35 SUSNEPO kernel:  ? do_wp_page+0x7ad/0xbc0
ott 25 09:07:35 SUSNEPO kernel:  ? do_sys_openat2+0x82/0xc0
ott 25 09:07:35 SUSNEPO kernel:  ? __pte_offset_map+0x1b/0x180
ott 25 09:07:35 SUSNEPO kernel:  ? __handle_mm_fault+0xaed/0x1020
ott 25 09:07:35 SUSNEPO kernel:  ? syscall_exit_to_user_mode+0x10/0x220
ott 25 09:07:35 SUSNEPO kernel:  ? do_syscall_64+0x8e/0x160
ott 25 09:07:35 SUSNEPO kernel:  ? filp_close+0x1d/0x30
ott 25 09:07:35 SUSNEPO kernel:  ? do_dup2+0xad/0x130
ott 25 09:07:35 SUSNEPO kernel:  ? syscall_exit_to_user_mode+0x10/0x220
ott 25 09:07:35 SUSNEPO kernel:  ? do_syscall_64+0x8e/0x160
ott 25 09:07:35 SUSNEPO kernel:  ? exc_page_fault+0x73/0x170
ott 25 09:07:35 SUSNEPO kernel:  entry_SYSCALL_64_after_hwframe+0x76/0x7e
ott 25 09:07:35 SUSNEPO kernel: RIP: 0033:0x7fb48dd0fea4
ott 25 09:07:35 SUSNEPO kernel: Code: 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 90 90 80 3d 05 ab 0f 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 48 83 ec 28 48 89 54 24 18 48
ott 25 09:07:35 SUSNEPO kernel: RSP: 002b:00007ffc7b5e40a8 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
ott 25 09:07:35 SUSNEPO kernel: RAX: ffffffffffffffda RBX: 0000000000000008 RCX: 00007fb48dd0fea4
ott 25 09:07:35 SUSNEPO kernel: RDX: 0000000000000008 RSI: 000056272f36f860 RDI: 0000000000000001
ott 25 09:07:35 SUSNEPO kernel: RBP: 000056272f36f860 R08: 00007fb48ddfcac0 R09: 0000000000000004
ott 25 09:07:35 SUSNEPO kernel: R10: 00007fb48ddfcb30 R11: 0000000000000202 R12: 0000000000000008
ott 25 09:07:35 SUSNEPO kernel: R13: 00007fb48ddfd5c0 R14: 00007fb48ddfaea0 R15: 0000000000000001
ott 25 09:07:35 SUSNEPO kernel:  </TASK>
ott 25 09:07:35 SUSNEPO kernel: ---[ end trace 0000000000000000 ]---
ott 25 09:07:35 SUSNEPO systemd[1]: nvidia-suspend.service: Deactivated successfully.
ott 25 09:07:35 SUSNEPO systemd[1]: Finished NVIDIA system suspend actions.
ott 25 09:07:35 SUSNEPO systemd[1]: Starting System Suspend...
ott 25 09:07:35 SUSNEPO systemd-sleep[26493]: User sessions remain unfrozen (add $SYSTEMD_SLEEP_FREEZE_USER_SESSIONS=1 to override),
ott 25 09:07:35 SUSNEPO systemd-sleep[26493]: relying on kernel to perform the freeze.
ott 25 09:07:35 SUSNEPO systemd-sleep[26493]: This is a temporary downstream workaround for https://github.com/systemd/systemd/issues/33083.
ott 25 09:07:35 SUSNEPO systemd-sleep[26496]: INFO: Skip running /usr/lib/systemd/system-sleep/grub2.sleep for suspend
ott 25 09:07:35 SUSNEPO systemd-sleep[26493]: Performing sleep operation 'suspend'...
ott 25 09:07:35 SUSNEPO kernel: PM: suspend entry (deep)
ott 25 09:07:36 SUSNEPO kernel: Filesystems sync: 0.308 seconds

@birdie-github
Copy link
Author

@aritger

On a second resume I again get all these warnings. Looks like NVreg_EnableS0ixPowerManagement is inconsequential for this issue:

------------[ cut here ]------------
WARNING: CPU: 1 PID: 45024 at include/linux/rwsem.h:80 follow_pte+0xf8/0x120
Modules linked in: uinput rfcomm snd_hrtimer nvidia_uvm(O) msr cmac algif_hash algif_skcipher af_alg vboxnetadp(O) vboxnetflt(O) nf_log_syslog nft_limit nft_ct nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nfnetlink_log nft_log vboxdrv(O) bnep nf_tables libcrc32c nct6775 nct6775_core hwmon_vid input_leds hid_generic usbhid hid btusb btintel btbcm bluetooth ntfs3 nvidia_drm(O) nvidia_modeset(O) iwlmvm ptp kvm_amd pps_core snd_hda_codec_realtek mac80211 kvm snd_hda_codec_generic libarc4 snd_hda_scodec_component snd_hda_codec_hdmi crct10dif_pclmul led_class crc32_pclmul crc32c_intel polyval_clmulni polyval_generic ee1004 sha512_ssse3 sha512_generic nvidia(O) sha256_ssse3 wmi_bmof snd_hda_intel snd_intel_dspcfg sha1_ssse3 snd_hda_codec aesni_intel snd_hwdep snd_hda_core gf128mul snd_seq crypto_simd snd_seq_device iwlwifi cryptd snd_pcm efi_pstore pcspkr backlight ccp snd_timer sr_mod drm_ttm_helper sha1_generic snd ttm cdrom cfg80211 r8169 k10temp i2c_piix4 rfkill realtek mdio_devres xhci_pci libphy xhci_hcd
 tpm_crb 8250 8250_base wmi serial_base tpm_tis tpm_tis_core evdev fuse dm_mod nfnetlink efivarfs tpm libaescfb ecdh_generic ecc rng_core ipv6
CPU: 1 UID: 0 PID: 45024 Comm: nvidia-sleep.sh Tainted: G           O       6.11.0-zen3 #2
Tainted: [O]=OOT_MODULE
Hardware name: System manufacturer System Product Name/TUF GAMING X570-PLUS (WI-FI), BIOS 5013 03/22/2024
RIP: 0010:follow_pte+0xf8/0x120
Code: 00 48 01 d6 48 89 c2 e8 76 7e 01 00 48 85 c0 74 24 48 8b 10 f7 c2 01 01 00 00 74 20 48 89 03 31 c0 5b 41 5c 5d c3 cc cc cc cc <0f> 0b 48 3b 07 0f 83 2a ff ff ff b8 ea ff ff ff eb e5 49 8b 3c 24
RSP: 0018:ffffa9e4049df948 EFLAGS: 00010246
RAX: 00007f7446b00000 RBX: ffffa9e4049df968 RCX: ffffa9e4049df970
RDX: 0000000000000000 RSI: 00007f7446b00000 RDI: ffff957bdba33be0
RBP: ffffa9e4049df958 R08: ffff957bda24e3c0 R09: ffffffff8edae1ae
R10: 0000000000400028 R11: 0000000000000000 R12: ffffa9e4049df970
R13: 0000000000000000 R14: ffffa9e4049df9b0 R15: ffffa9e4049df9b8
FS:  00007f0231b9d740(0000) GS:ffff958aaec40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0231d88650 CR3: 00000002111ba000 CR4: 0000000000b50ef0
Call Trace:
 <TASK>
 ? show_regs.part.0+0x1d/0x30
 ? show_regs.cold+0x8/0xd
 ? __warn+0x85/0xbe
 ? follow_pte+0xf8/0x120
 ? report_bug+0x101/0x150
 ? handle_bug+0x42/0x80
 ? exc_invalid_op+0x18/0x70
 ? asm_exc_invalid_op+0x1b/0x20
 ? vfree.part.0+0xce/0x240
 ? follow_pte+0xf8/0x120
 follow_phys+0x2a/0xc0
 untrack_pfn+0x43/0x100
 zap_page_range_single+0x16f/0x180
 ? vfree.part.0+0xce/0x240
 unmap_mapping_range+0xea/0x110
 nv_revoke_gpu_mappings_locked+0x41/0x70 [nvidia]
 nv_set_system_power_state+0x1cb/0x490 [nvidia]
 nv_procfs_write_suspend+0xe2/0x150 [nvidia]
 proc_reg_write+0x5c/0xa0
 vfs_write+0xd1/0x400
 ? __do_sys_newfstat+0x41/0x60
 ksys_write+0x57/0xd0
 __x64_sys_write+0x14/0x20
 x64_sys_call+0x79/0x1d10
 do_syscall_64+0x79/0x150
 ? syscall_exit_to_user_mode+0x11/0x1c0
 ? do_syscall_64+0x85/0x150
 ? filp_flush+0x56/0x70
 ? syscall_exit_to_user_mode+0x11/0x1c0
 ? do_syscall_64+0x85/0x150
 ? pte_offset_map_nolock+0x1b/0x90
 ? __handle_mm_fault+0x11eb/0x2180
 ? f_dupfd+0x58/0x90
 ? do_fcntl+0x28c/0x610
 ? __count_memcg_events+0x57/0xf0
 ? handle_mm_fault+0x154/0x240
 ? irqentry_exit+0x3b/0x50
 ? exc_page_fault+0x326/0x6a0
 entry_SYSCALL_64_after_hwframe+0x6c/0x74
RIP: 0033:0x7f0231cae984
Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d c5 06 0e 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89
RSP: 002b:00007ffdddb3a948 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
RAX: ffffffffffffffda RBX: 0000000000000008 RCX: 00007f0231cae984
RDX: 0000000000000008 RSI: 0000562dd63789b0 RDI: 0000000000000001
RBP: 00007ffdddb3a970 R08: 0000000000000410 R09: 0000000000000001
R10: 0000000000000004 R11: 0000000000000202 R12: 0000000000000008
R13: 0000562dd63789b0 R14: 00007f0231d885c0 R15: 00007f0231d85f00
 </TASK>
---[ end trace 0000000000000000 ]---
------------[ cut here ]------------
WARNING: CPU: 1 PID: 45024 at include/linux/rwsem.h:80 follow_pte+0xf8/0x120
Modules linked in: uinput rfcomm snd_hrtimer nvidia_uvm(O) msr cmac algif_hash algif_skcipher af_alg vboxnetadp(O) vboxnetflt(O) nf_log_syslog nft_limit nft_ct nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nfnetlink_log nft_log vboxdrv(O) bnep nf_tables libcrc32c nct6775 nct6775_core hwmon_vid input_leds hid_generic usbhid hid btusb btintel btbcm bluetooth ntfs3 nvidia_drm(O) nvidia_modeset(O) iwlmvm ptp kvm_amd pps_core snd_hda_codec_realtek mac80211 kvm snd_hda_codec_generic libarc4 snd_hda_scodec_component snd_hda_codec_hdmi crct10dif_pclmul led_class crc32_pclmul crc32c_intel polyval_clmulni polyval_generic ee1004 sha512_ssse3 sha512_generic nvidia(O) sha256_ssse3 wmi_bmof snd_hda_intel snd_intel_dspcfg sha1_ssse3 snd_hda_codec aesni_intel snd_hwdep snd_hda_core gf128mul snd_seq crypto_simd snd_seq_device iwlwifi cryptd snd_pcm efi_pstore pcspkr backlight ccp snd_timer sr_mod drm_ttm_helper sha1_generic snd ttm cdrom cfg80211 r8169 k10temp i2c_piix4 rfkill realtek mdio_devres xhci_pci libphy xhci_hcd
 tpm_crb 8250 8250_base wmi serial_base tpm_tis tpm_tis_core evdev fuse dm_mod nfnetlink efivarfs tpm libaescfb ecdh_generic ecc rng_core ipv6
CPU: 1 UID: 0 PID: 45024 Comm: nvidia-sleep.sh Tainted: G        W  O       6.11.0-zen3 #2
Tainted: [W]=WARN, [O]=OOT_MODULE
Hardware name: System manufacturer System Product Name/TUF GAMING X570-PLUS (WI-FI), BIOS 5013 03/22/2024
RIP: 0010:follow_pte+0xf8/0x120
Code: 00 48 01 d6 48 89 c2 e8 76 7e 01 00 48 85 c0 74 24 48 8b 10 f7 c2 01 01 00 00 74 20 48 89 03 31 c0 5b 41 5c 5d c3 cc cc cc cc <0f> 0b 48 3b 07 0f 83 2a ff ff ff b8 ea ff ff ff eb e5 49 8b 3c 24
RSP: 0018:ffffa9e4049df948 EFLAGS: 00010246
RAX: 00007f7445dc0000 RBX: ffffa9e4049df968 RCX: ffffa9e4049df970
RDX: 0000000000000000 RSI: 00007f7445dc0000 RDI: ffff957bdba33000
RBP: ffffa9e4049df958 R08: ffff957bda24e3c0 R09: 0000000000001000
R10: ffff958aaec644c0 R11: 0000000000000000 R12: ffffa9e4049df970
R13: 0000000000000000 R14: ffffa9e4049df9b0 R15: ffffa9e4049df9b8
FS:  00007f0231b9d740(0000) GS:ffff958aaec40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0231d88650 CR3: 00000002111ba000 CR4: 0000000000b50ef0
Call Trace:
 <TASK>
 ? show_regs.part.0+0x1d/0x30
 ? show_regs.cold+0x8/0xd
 ? __warn+0x85/0xbe
 ? follow_pte+0xf8/0x120
 ? report_bug+0x101/0x150
 ? handle_bug+0x42/0x80
 ? exc_invalid_op+0x18/0x70
 ? asm_exc_invalid_op+0x1b/0x20
 ? follow_pte+0xf8/0x120
 follow_phys+0x2a/0xc0
 untrack_pfn+0x43/0x100
 zap_page_range_single+0x16f/0x180
 ? vfree.part.0+0xce/0x240
 unmap_mapping_range+0xea/0x110
 nv_revoke_gpu_mappings_locked+0x41/0x70 [nvidia]
 nv_set_system_power_state+0x1cb/0x490 [nvidia]
 nv_procfs_write_suspend+0xe2/0x150 [nvidia]
 proc_reg_write+0x5c/0xa0
 vfs_write+0xd1/0x400
 ? __do_sys_newfstat+0x41/0x60
 ksys_write+0x57/0xd0
 __x64_sys_write+0x14/0x20
 x64_sys_call+0x79/0x1d10
 do_syscall_64+0x79/0x150
 ? syscall_exit_to_user_mode+0x11/0x1c0
 ? do_syscall_64+0x85/0x150
 ? filp_flush+0x56/0x70
 ? syscall_exit_to_user_mode+0x11/0x1c0
 ? do_syscall_64+0x85/0x150
 ? pte_offset_map_nolock+0x1b/0x90
 ? __handle_mm_fault+0x11eb/0x2180
 ? f_dupfd+0x58/0x90
 ? do_fcntl+0x28c/0x610
 ? __count_memcg_events+0x57/0xf0
 ? handle_mm_fault+0x154/0x240
 ? irqentry_exit+0x3b/0x50
 ? exc_page_fault+0x326/0x6a0
 entry_SYSCALL_64_after_hwframe+0x6c/0x74
RIP: 0033:0x7f0231cae984
Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d c5 06 0e 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89
RSP: 002b:00007ffdddb3a948 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
RAX: ffffffffffffffda RBX: 0000000000000008 RCX: 00007f0231cae984
RDX: 0000000000000008 RSI: 0000562dd63789b0 RDI: 0000000000000001
RBP: 00007ffdddb3a970 R08: 0000000000000410 R09: 0000000000000001
R10: 0000000000000004 R11: 0000000000000202 R12: 0000000000000008
R13: 0000562dd63789b0 R14: 00007f0231d885c0 R15: 00007f0231d85f00
 </TASK>
---[ end trace 0000000000000000 ]---
------------[ cut here ]------------
WARNING: CPU: 1 PID: 45024 at include/linux/rwsem.h:80 follow_pte+0xf8/0x120
Modules linked in: uinput rfcomm snd_hrtimer nvidia_uvm(O) msr cmac algif_hash algif_skcipher af_alg vboxnetadp(O) vboxnetflt(O) nf_log_syslog nft_limit nft_ct nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nfnetlink_log nft_log vboxdrv(O) bnep nf_tables libcrc32c nct6775 nct6775_core hwmon_vid input_leds hid_generic usbhid hid btusb btintel btbcm bluetooth ntfs3 nvidia_drm(O) nvidia_modeset(O) iwlmvm ptp kvm_amd pps_core snd_hda_codec_realtek mac80211 kvm snd_hda_codec_generic libarc4 snd_hda_scodec_component snd_hda_codec_hdmi crct10dif_pclmul led_class crc32_pclmul crc32c_intel polyval_clmulni polyval_generic ee1004 sha512_ssse3 sha512_generic nvidia(O) sha256_ssse3 wmi_bmof snd_hda_intel snd_intel_dspcfg sha1_ssse3 snd_hda_codec aesni_intel snd_hwdep snd_hda_core gf128mul snd_seq crypto_simd snd_seq_device iwlwifi cryptd snd_pcm efi_pstore pcspkr backlight ccp snd_timer sr_mod drm_ttm_helper sha1_generic snd ttm cdrom cfg80211 r8169 k10temp i2c_piix4 rfkill realtek mdio_devres xhci_pci libphy xhci_hcd
 tpm_crb 8250 8250_base wmi serial_base tpm_tis tpm_tis_core evdev fuse dm_mod nfnetlink efivarfs tpm libaescfb ecdh_generic ecc rng_core ipv6
CPU: 1 UID: 0 PID: 45024 Comm: nvidia-sleep.sh Tainted: G        W  O       6.11.0-zen3 #2
Tainted: [W]=WARN, [O]=OOT_MODULE
Hardware name: System manufacturer System Product Name/TUF GAMING X570-PLUS (WI-FI), BIOS 5013 03/22/2024
RIP: 0010:follow_pte+0xf8/0x120
Code: 00 48 01 d6 48 89 c2 e8 76 7e 01 00 48 85 c0 74 24 48 8b 10 f7 c2 01 01 00 00 74 20 48 89 03 31 c0 5b 41 5c 5d c3 cc cc cc cc <0f> 0b 48 3b 07 0f 83 2a ff ff ff b8 ea ff ff ff eb e5 49 8b 3c 24
RSP: 0018:ffffa9e4049df948 EFLAGS: 00010246
RAX: 00007f74486b0000 RBX: ffffa9e4049df968 RCX: ffffa9e4049df970
RDX: 0000000000000000 RSI: 00007f74486b0000 RDI: ffff957bdba33e40
RBP: ffffa9e4049df958 R08: ffff957bda24e3c0 R09: 0000000000001000
R10: ffff958aaec644c0 R11: 0000000000000000 R12: ffffa9e4049df970
R13: 0000000000000000 R14: ffffa9e4049df9b0 R15: ffffa9e4049df9b8
FS:  00007f0231b9d740(0000) GS:ffff958aaec40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0231d88650 CR3: 00000002111ba000 CR4: 0000000000b50ef0
Call Trace:
 <TASK>
 ? show_regs.part.0+0x1d/0x30
 ? show_regs.cold+0x8/0xd
 ? __warn+0x85/0xbe
 ? follow_pte+0xf8/0x120
 ? report_bug+0x101/0x150
 ? handle_bug+0x42/0x80
 ? exc_invalid_op+0x18/0x70
 ? asm_exc_invalid_op+0x1b/0x20
 ? follow_pte+0xf8/0x120
 follow_phys+0x2a/0xc0
 untrack_pfn+0x43/0x100
 zap_page_range_single+0x16f/0x180
 ? vfree.part.0+0xce/0x240
 unmap_mapping_range+0xea/0x110
 nv_revoke_gpu_mappings_locked+0x41/0x70 [nvidia]
 nv_set_system_power_state+0x1cb/0x490 [nvidia]
 nv_procfs_write_suspend+0xe2/0x150 [nvidia]
 proc_reg_write+0x5c/0xa0
 vfs_write+0xd1/0x400
 ? __do_sys_newfstat+0x41/0x60
 ksys_write+0x57/0xd0
 __x64_sys_write+0x14/0x20
 x64_sys_call+0x79/0x1d10
 do_syscall_64+0x79/0x150
 ? syscall_exit_to_user_mode+0x11/0x1c0
 ? do_syscall_64+0x85/0x150
 ? filp_flush+0x56/0x70
 ? syscall_exit_to_user_mode+0x11/0x1c0
 ? do_syscall_64+0x85/0x150
 ? pte_offset_map_nolock+0x1b/0x90
 ? __handle_mm_fault+0x11eb/0x2180
 ? f_dupfd+0x58/0x90
 ? do_fcntl+0x28c/0x610
 ? __count_memcg_events+0x57/0xf0
 ? handle_mm_fault+0x154/0x240
 ? irqentry_exit+0x3b/0x50
 ? exc_page_fault+0x326/0x6a0
 entry_SYSCALL_64_after_hwframe+0x6c/0x74
RIP: 0033:0x7f0231cae984
Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d c5 06 0e 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89
RSP: 002b:00007ffdddb3a948 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
RAX: ffffffffffffffda RBX: 0000000000000008 RCX: 00007f0231cae984
RDX: 0000000000000008 RSI: 0000562dd63789b0 RDI: 0000000000000001
RBP: 00007ffdddb3a970 R08: 0000000000000410 R09: 0000000000000001
R10: 0000000000000004 R11: 0000000000000202 R12: 0000000000000008
R13: 0000562dd63789b0 R14: 00007f0231d885c0 R15: 00007f0231d85f00
 </TASK>
---[ end trace 0000000000000000 ]---
------------[ cut here ]------------
WARNING: CPU: 1 PID: 45024 at include/linux/rwsem.h:80 follow_pte+0xf8/0x120
Modules linked in: uinput rfcomm snd_hrtimer nvidia_uvm(O) msr cmac algif_hash algif_skcipher af_alg vboxnetadp(O) vboxnetflt(O) nf_log_syslog nft_limit nft_ct nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nfnetlink_log nft_log vboxdrv(O) bnep nf_tables libcrc32c nct6775 nct6775_core hwmon_vid input_leds hid_generic usbhid hid btusb btintel btbcm bluetooth ntfs3 nvidia_drm(O) nvidia_modeset(O) iwlmvm ptp kvm_amd pps_core snd_hda_codec_realtek mac80211 kvm snd_hda_codec_generic libarc4 snd_hda_scodec_component snd_hda_codec_hdmi crct10dif_pclmul led_class crc32_pclmul crc32c_intel polyval_clmulni polyval_generic ee1004 sha512_ssse3 sha512_generic nvidia(O) sha256_ssse3 wmi_bmof snd_hda_intel snd_intel_dspcfg sha1_ssse3 snd_hda_codec aesni_intel snd_hwdep snd_hda_core gf128mul snd_seq crypto_simd snd_seq_device iwlwifi cryptd snd_pcm efi_pstore pcspkr backlight ccp snd_timer sr_mod drm_ttm_helper sha1_generic snd ttm cdrom cfg80211 r8169 k10temp i2c_piix4 rfkill realtek mdio_devres xhci_pci libphy xhci_hcd
 tpm_crb 8250 8250_base wmi serial_base tpm_tis tpm_tis_core evdev fuse dm_mod nfnetlink efivarfs tpm libaescfb ecdh_generic ecc rng_core ipv6
CPU: 1 UID: 0 PID: 45024 Comm: nvidia-sleep.sh Tainted: G        W  O       6.11.0-zen3 #2
Tainted: [W]=WARN, [O]=OOT_MODULE
Hardware name: System manufacturer System Product Name/TUF GAMING X570-PLUS (WI-FI), BIOS 5013 03/22/2024
RIP: 0010:follow_pte+0xf8/0x120
Code: 00 48 01 d6 48 89 c2 e8 76 7e 01 00 48 85 c0 74 24 48 8b 10 f7 c2 01 01 00 00 74 20 48 89 03 31 c0 5b 41 5c 5d c3 cc cc cc cc <0f> 0b 48 3b 07 0f 83 2a ff ff ff b8 ea ff ff ff eb e5 49 8b 3c 24
RSP: 0018:ffffa9e4049df948 EFLAGS: 00010246
RAX: 00007f744766c000 RBX: ffffa9e4049df968 RCX: ffffa9e4049df970
RDX: 0000000000000000 RSI: 00007f744766c000 RDI: ffff957bddbeebe0
RBP: ffffa9e4049df958 R08: ffff957bda24e3c0 R09: 0000000000001000
R10: ffff958aaec644c0 R11: 0000000000000000 R12: ffffa9e4049df970
R13: 0000000000000000 R14: ffffa9e4049df9b0 R15: ffffa9e4049df9b8
FS:  00007f0231b9d740(0000) GS:ffff958aaec40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0231d88650 CR3: 00000002111ba000 CR4: 0000000000b50ef0
Call Trace:
 <TASK>
 ? show_regs.part.0+0x1d/0x30
 ? show_regs.cold+0x8/0xd
 ? __warn+0x85/0xbe
 ? follow_pte+0xf8/0x120
 ? report_bug+0x101/0x150
 ? handle_bug+0x42/0x80
 ? exc_invalid_op+0x18/0x70
 ? asm_exc_invalid_op+0x1b/0x20
 ? follow_pte+0xf8/0x120
 follow_phys+0x2a/0xc0
 untrack_pfn+0x43/0x100
 zap_page_range_single+0x16f/0x180
 ? vfree.part.0+0xce/0x240
 unmap_mapping_range+0xea/0x110
 nv_revoke_gpu_mappings_locked+0x41/0x70 [nvidia]
 nv_set_system_power_state+0x1cb/0x490 [nvidia]
 nv_procfs_write_suspend+0xe2/0x150 [nvidia]
 proc_reg_write+0x5c/0xa0
 vfs_write+0xd1/0x400
 ? __do_sys_newfstat+0x41/0x60
 ksys_write+0x57/0xd0
 __x64_sys_write+0x14/0x20
 x64_sys_call+0x79/0x1d10
 do_syscall_64+0x79/0x150
 ? syscall_exit_to_user_mode+0x11/0x1c0
 ? do_syscall_64+0x85/0x150
 ? filp_flush+0x56/0x70
 ? syscall_exit_to_user_mode+0x11/0x1c0
 ? do_syscall_64+0x85/0x150
 ? pte_offset_map_nolock+0x1b/0x90
 ? __handle_mm_fault+0x11eb/0x2180
 ? f_dupfd+0x58/0x90
 ? do_fcntl+0x28c/0x610
 ? __count_memcg_events+0x57/0xf0
 ? handle_mm_fault+0x154/0x240
 ? irqentry_exit+0x3b/0x50
 ? exc_page_fault+0x326/0x6a0
 entry_SYSCALL_64_after_hwframe+0x6c/0x74
RIP: 0033:0x7f0231cae984
Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d c5 06 0e 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89
RSP: 002b:00007ffdddb3a948 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
RAX: ffffffffffffffda RBX: 0000000000000008 RCX: 00007f0231cae984
RDX: 0000000000000008 RSI: 0000562dd63789b0 RDI: 0000000000000001
RBP: 00007ffdddb3a970 R08: 0000000000000410 R09: 0000000000000001
R10: 0000000000000004 R11: 0000000000000202 R12: 0000000000000008
R13: 0000562dd63789b0 R14: 00007f0231d885c0 R15: 00007f0231d85f00
 </TASK>
---[ end trace 0000000000000000 ]---
------------[ cut here ]------------
WARNING: CPU: 1 PID: 45024 at include/linux/rwsem.h:80 follow_pte+0xf8/0x120
Modules linked in: uinput rfcomm snd_hrtimer nvidia_uvm(O) msr cmac algif_hash algif_skcipher af_alg vboxnetadp(O) vboxnetflt(O) nf_log_syslog nft_limit nft_ct nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nfnetlink_log nft_log vboxdrv(O) bnep nf_tables libcrc32c nct6775 nct6775_core hwmon_vid input_leds hid_generic usbhid hid btusb btintel btbcm bluetooth ntfs3 nvidia_drm(O) nvidia_modeset(O) iwlmvm ptp kvm_amd pps_core snd_hda_codec_realtek mac80211 kvm snd_hda_codec_generic libarc4 snd_hda_scodec_component snd_hda_codec_hdmi crct10dif_pclmul led_class crc32_pclmul crc32c_intel polyval_clmulni polyval_generic ee1004 sha512_ssse3 sha512_generic nvidia(O) sha256_ssse3 wmi_bmof snd_hda_intel snd_intel_dspcfg sha1_ssse3 snd_hda_codec aesni_intel snd_hwdep snd_hda_core gf128mul snd_seq crypto_simd snd_seq_device iwlwifi cryptd snd_pcm efi_pstore pcspkr backlight ccp snd_timer sr_mod drm_ttm_helper sha1_generic snd ttm cdrom cfg80211 r8169 k10temp i2c_piix4 rfkill realtek mdio_devres xhci_pci libphy xhci_hcd
 tpm_crb 8250 8250_base wmi serial_base tpm_tis tpm_tis_core evdev fuse dm_mod nfnetlink efivarfs tpm libaescfb ecdh_generic ecc rng_core ipv6
CPU: 1 UID: 0 PID: 45024 Comm: nvidia-sleep.sh Tainted: G        W  O       6.11.0-zen3 #2
Tainted: [W]=WARN, [O]=OOT_MODULE
Hardware name: System manufacturer System Product Name/TUF GAMING X570-PLUS (WI-FI), BIOS 5013 03/22/2024
RIP: 0010:follow_pte+0xf8/0x120
Code: 00 48 01 d6 48 89 c2 e8 76 7e 01 00 48 85 c0 74 24 48 8b 10 f7 c2 01 01 00 00 74 20 48 89 03 31 c0 5b 41 5c 5d c3 cc cc cc cc <0f> 0b 48 3b 07 0f 83 2a ff ff ff b8 ea ff ff ff eb e5 49 8b 3c 24
RSP: 0018:ffffa9e4049df948 EFLAGS: 00010246
RAX: 00007f74487df000 RBX: ffffa9e4049df968 RCX: ffffa9e4049df970
RDX: 0000000000000000 RSI: 00007f74487df000 RDI: ffff957bddbee4c0
RBP: ffffa9e4049df958 R08: ffff957bda24e3c0 R09: 0000000000001000
R10: ffff958aaec644c0 R11: 0000000000000000 R12: ffffa9e4049df970
R13: 0000000000000000 R14: ffffa9e4049df9b0 R15: ffffa9e4049df9b8
FS:  00007f0231b9d740(0000) GS:ffff958aaec40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0231d88650 CR3: 00000002111ba000 CR4: 0000000000b50ef0
Call Trace:
 <TASK>
 ? show_regs.part.0+0x1d/0x30
 ? show_regs.cold+0x8/0xd
 ? __warn+0x85/0xbe
 ? follow_pte+0xf8/0x120
 ? report_bug+0x101/0x150
 ? handle_bug+0x42/0x80
 ? exc_invalid_op+0x18/0x70
 ? asm_exc_invalid_op+0x1b/0x20
 ? follow_pte+0xf8/0x120
 follow_phys+0x2a/0xc0
 untrack_pfn+0x43/0x100
 zap_page_range_single+0x16f/0x180
 ? vfree.part.0+0xce/0x240
 unmap_mapping_range+0xea/0x110
 nv_revoke_gpu_mappings_locked+0x41/0x70 [nvidia]
 nv_set_system_power_state+0x1cb/0x490 [nvidia]
 nv_procfs_write_suspend+0xe2/0x150 [nvidia]
 proc_reg_write+0x5c/0xa0
 vfs_write+0xd1/0x400
 ? __do_sys_newfstat+0x41/0x60
 ksys_write+0x57/0xd0
 __x64_sys_write+0x14/0x20
 x64_sys_call+0x79/0x1d10
 do_syscall_64+0x79/0x150
 ? syscall_exit_to_user_mode+0x11/0x1c0
 ? do_syscall_64+0x85/0x150
 ? filp_flush+0x56/0x70
 ? syscall_exit_to_user_mode+0x11/0x1c0
 ? do_syscall_64+0x85/0x150
 ? pte_offset_map_nolock+0x1b/0x90
 ? __handle_mm_fault+0x11eb/0x2180
 ? f_dupfd+0x58/0x90
 ? do_fcntl+0x28c/0x610
 ? __count_memcg_events+0x57/0xf0
 ? handle_mm_fault+0x154/0x240
 ? irqentry_exit+0x3b/0x50
 ? exc_page_fault+0x326/0x6a0
 entry_SYSCALL_64_after_hwframe+0x6c/0x74
RIP: 0033:0x7f0231cae984
Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d c5 06 0e 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89
RSP: 002b:00007ffdddb3a948 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
RAX: ffffffffffffffda RBX: 0000000000000008 RCX: 00007f0231cae984
RDX: 0000000000000008 RSI: 0000562dd63789b0 RDI: 0000000000000001
RBP: 00007ffdddb3a970 R08: 0000000000000410 R09: 0000000000000001
R10: 0000000000000004 R11: 0000000000000202 R12: 0000000000000008
R13: 0000562dd63789b0 R14: 00007f0231d885c0 R15: 00007f0231d85f00
 </TASK>
---[ end trace 0000000000000000 ]---
PM: suspend entry (deep)
Filesystems sync: 0.000 seconds
Freezing user space processes
Freezing user space processes completed (elapsed 0.014 seconds)
OOM killer disabled.
Freezing remaining freezable tasks
Freezing remaining freezable tasks completed (elapsed 0.000 seconds)
printk: Suspending console(s) (use no_console_suspend to debug)
serial 00:04: disabled
sd 4:0:0:0: [sda] Synchronizing SCSI cache
ata5.00: Entering standby power mode
sd 5:0:0:0: [sdb] Synchronizing SCSI cache
ata6.00: Entering standby power mode
ACPI: PM: Preparing to enter system sleep state S3
ACPI: PM: Saving platform NVS memory
Disabling non-boot CPUs ...
smpboot: CPU 15 is now offline
smpboot: CPU 14 is now offline
smpboot: CPU 13 is now offline
smpboot: CPU 12 is now offline
smpboot: CPU 11 is now offline
smpboot: CPU 10 is now offline
smpboot: CPU 9 is now offline
smpboot: CPU 8 is now offline
Spectre V2 : Update user space SMT mitigation: STIBP off
smpboot: CPU 7 is now offline
smpboot: CPU 6 is now offline
smpboot: CPU 5 is now offline
smpboot: CPU 4 is now offline
smpboot: CPU 3 is now offline
smpboot: CPU 2 is now offline
smpboot: CPU 1 is now offline
ACPI: PM: Low-level resume complete
ACPI: PM: Restoring platform NVS memory
LVT offset 0 assigned for vector 0x400
Enabling non-boot CPUs ...
smpboot: Booting Node 0 Processor 1 APIC 0x2
ACPI: \_PR_.C002: Found 2 idle states
CPU1 is up
smpboot: Booting Node 0 Processor 2 APIC 0x4
ACPI: \_PR_.C004: Found 2 idle states
CPU2 is up
smpboot: Booting Node 0 Processor 3 APIC 0x6
ACPI: \_PR_.C006: Found 2 idle states
CPU3 is up
smpboot: Booting Node 0 Processor 4 APIC 0x8
ACPI: \_PR_.C008: Found 2 idle states
CPU4 is up
smpboot: Booting Node 0 Processor 5 APIC 0xa
ACPI: \_PR_.C00A: Found 2 idle states
CPU5 is up
smpboot: Booting Node 0 Processor 6 APIC 0xc
ACPI: \_PR_.C00C: Found 2 idle states
CPU6 is up
smpboot: Booting Node 0 Processor 7 APIC 0xe
ACPI: \_PR_.C00E: Found 2 idle states
CPU7 is up
smpboot: Booting Node 0 Processor 8 APIC 0x1
ACPI: \_PR_.C001: Found 2 idle states
Spectre V2 : Update user space SMT mitigation: STIBP always-on
CPU8 is up
smpboot: Booting Node 0 Processor 9 APIC 0x3
ACPI: \_PR_.C003: Found 2 idle states
CPU9 is up
smpboot: Booting Node 0 Processor 10 APIC 0x5
ACPI: \_PR_.C005: Found 2 idle states
CPU10 is up
smpboot: Booting Node 0 Processor 11 APIC 0x7
ACPI: \_PR_.C007: Found 2 idle states
CPU11 is up
smpboot: Booting Node 0 Processor 12 APIC 0x9
ACPI: \_PR_.C009: Found 2 idle states
CPU12 is up
smpboot: Booting Node 0 Processor 13 APIC 0xb
ACPI: \_PR_.C00B: Found 2 idle states
CPU13 is up
smpboot: Booting Node 0 Processor 14 APIC 0xd
ACPI: \_PR_.C00D: Found 2 idle states
CPU14 is up
smpboot: Booting Node 0 Processor 15 APIC 0xf
ACPI: \_PR_.C00F: Found 2 idle states
CPU15 is up
ACPI: PM: Waking up from system sleep state S3

@ethanh20009
Copy link

ethanh20009 commented Oct 31, 2024

Getting the same kernel stack traces on suspend/resume on open kernel driver 565.

Causes intermittent behaviour for me. Sometimes one monitor out of 2 comes back. Sometimes it causes my monitors to swap relative positions (possibly DP-1 identifies as DP-2..)

Confirming all is solved when using an lts kernel (6.6)

Edit: Tried on 6.12 rc and no issues anymore. Suspend all working normally.

@SamoutL
Copy link

SamoutL commented Oct 31, 2024

I still have this issue with linux lts (6.6) kernel and open kernel driver 565.

@tekstryder
Copy link

If anyone is adventurous, could you retest this configuration with Linux kernel v6.12-rc1 or later? It looks like -rc4 is currently the latest.

@aritger I wasn't adventurous enough and waited for stable kernel release.

I can confirm this issue is indeed resolved with the API changes in kernel 6.12.

  • Arch Linux | Kernel 6.12.1
  • nVidia 565.57.01

@aritger
Copy link
Collaborator

aritger commented Nov 25, 2024

Thanks for confirming. I'm sorry it took us a bit to release a 6.12-compatible driver.

My post earlier in this issue still summarizes my understanding:
#719 (comment)

Maybe there are additional issues, but I think the originally reported symptom (the "WARNING: CPU: X PID: XXXX at include/linux/rwsem.h:80 follow_pte+0xf8/0x120 on resume") is fixed by Linux kernel 6.12.

If there are additional suspend/resume problems, let's file separate Issues for them. Thanks.

@aritger aritger closed this as completed Nov 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

9 participants