[ 4253.822380][ T4132] GACT probability NOT on [ 4268.401410][ T12] ------------[ cut here ]------------ [ 4268.402102][ T12] conntrack cleanup blocked for 60s [ 4268.402109][ T12] WARNING: net/netfilter/nf_conntrack_core.c:2511 at nf_conntrack_cleanup_net_list+0x4a0/0x540 [nf_conntrack], CPU#0: kworker/u16:0/12 [ 4268.403128][ T12] Modules linked in: act_gact(+) xt_conntrack nft_chain_nat xt_nat cls_bpf netdevsim xt_mark nft_compat nf_tables sch_ingress act_mirred cls_basic sch_fq_codel xfrm_user openvswitch psample nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nsh geneve vxlan act_csum act_pedit cls_flower sch_prio [ 4268.404571][ T12] CPU: 0 UID: 0 PID: 12 Comm: kworker/u16:0 Not tainted 6.19.0-rc3-virtme #1 PREEMPT(full) [ 4268.405109][ T12] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 4268.405448][ T12] Workqueue: netns cleanup_net [ 4268.405725][ T12] RIP: 0010:nf_conntrack_cleanup_net_list+0x4a0/0x540 [nf_conntrack] [ 4268.406133][ T12] Code: 00 00 00 65 48 2b 05 cf 81 27 c8 0f 85 a0 00 00 00 48 81 c4 c0 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 48 8d 3d d0 21 16 00 <67> 48 0f b9 3a e9 0f ff ff ff 48 c7 c7 bc 6f 81 c0 e8 5a 26 e6 c3 [ 4268.407075][ T12] RSP: 0018:ffffc900000c7988 EFLAGS: 00010297 [ 4268.407425][ T12] RAX: 00000001003c8afe RBX: ffffc900000c7ae8 RCX: ffffffffc06a7b3a [ 4268.407811][ T12] RDX: 00000001003c8afd RSI: 0000000000000004 RDI: ffffffffc080a030 [ 4268.408198][ T12] RBP: ffff888016028620 R08: 0000000000000000 R09: ffffed1002c050c4 [ 4268.408631][ T12] R10: ffff888016028623 R11: ffffffffc069e2ba R12: 0000000000000001 [ 4268.409077][ T12] R13: ffff88800d4da200 R14: dffffc0000000000 R15: ffffc900000c79e8 [ 4268.410050][ T12] FS: 0000000000000000(0000) GS:ffff8880de300000(0000) knlGS:0000000000000000 [ 4268.410531][ T12] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4268.410888][ T12] CR2: 00007f70105804d8 CR3: 0000000079f45002 CR4: 0000000000772ef0 [ 4268.411280][ T12] PKRU: 55555554 [ 4268.411490][ T12] Call Trace: [ 4268.411690][ T12] [ 4268.411830][ T12] ? nf_conntrack_cleanup_net_list+0x137/0x540 [nf_conntrack] [ 4268.412233][ T12] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 4268.412574][ T12] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 4268.412914][ T12] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 4268.413238][ T12] ? _raw_spin_unlock+0x2d/0x50 [ 4268.413508][ T12] ops_undo_list+0x2bf/0x890 [ 4268.413773][ T12] ? netns_install+0x280/0x280 [ 4268.414025][ T12] ? cleanup_net+0x2d6/0x8e0 [ 4268.414284][ T12] cleanup_net+0x3b2/0x8e0 [ 4268.414549][ T12] ? net_passive_dec+0x190/0x190 [ 4268.414804][ T12] ? rcu_is_watching+0x12/0xb0 [ 4268.415060][ T12] ? lock_acquire+0x104/0x140 [ 4268.415319][ T12] process_one_work+0x880/0x1810 [ 4268.415593][ T12] ? pwq_dec_nr_in_flight+0x550/0x550 [ 4268.415855][ T12] ? assign_work+0x168/0x240 [ 4268.416111][ T12] worker_thread+0x591/0xcf0 [ 4268.416381][ T12] ? bh_worker+0x6f0/0x6f0 [ 4268.416635][ T12] kthread+0x37b/0x5f0 [ 4268.416855][ T12] ? kthread_is_per_cpu+0xc0/0xc0 [ 4268.417106][ T12] ? ret_from_fork+0x71/0x540 [ 4268.417378][ T12] ? __lock_release+0x5d/0x160 [ 4268.417634][ T12] ? lock_acquire+0x104/0x140 [ 4268.417888][ T12] ? rcu_is_watching+0x12/0xb0 [ 4268.418160][ T12] ? kthread_is_per_cpu+0xc0/0xc0 [ 4268.418437][ T12] ret_from_fork+0x42f/0x540 [ 4268.418697][ T12] ? arch_exit_to_user_mode_prepare.constprop.0+0x140/0x140 [ 4268.419085][ T12] ? kthread_is_per_cpu+0xc0/0xc0 [ 4268.419339][ T12] ? __switch_to+0x505/0xd50 [ 4268.419615][ T12] ? kthread_is_per_cpu+0xc0/0xc0 [ 4268.419874][ T12] ret_from_fork_asm+0x11/0x20 [ 4268.420155][ T12] [ 4268.420349][ T12] irq event stamp: 28680073 [ 4268.420620][ T12] hardirqs last enabled at (28680083): [] __up_console_sem+0x67/0x70 [ 4268.421082][ T12] hardirqs last disabled at (28680090): [] __up_console_sem+0x4c/0x70 [ 4268.421587][ T12] softirqs last enabled at (28680046): [] handle_softirqs+0x524/0x820 [ 4268.422033][ T12] softirqs last disabled at (28680041): [] __irq_exit_rcu+0x6c/0xe0 [ 4268.422488][ T12] ---[ end trace 0000000000000000 ]--- [ 4425.331475][ T44] INFO: task modprobe:4132 blocked for more than 122 seconds. [ 4425.332180][ T44] Tainted: G W 6.19.0-rc3-virtme #1 [ 4425.332527][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4425.332891][ T44] task:modprobe state:D stack:25192 pid:4132 tgid:4132 ppid:570 task_flags:0x400100 flags:0x00080000 [ 4425.333440][ T44] Call Trace: [ 4425.333616][ T44] [ 4425.333741][ T44] __schedule+0x90a/0x1930 [ 4425.333984][ T44] ? io_schedule_timeout+0x150/0x150 [ 4425.334215][ T44] ? __lock_release+0x5d/0x160 [ 4425.337577][ T44] schedule+0xe2/0x270 [ 4425.337766][ T44] schedule_preempt_disabled+0x18/0x30 [ 4425.337992][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4425.338236][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4425.338486][ T44] ? rcu_is_watching+0x12/0xb0 [ 4425.338727][ T44] ? lock_acquire+0x104/0x140 [ 4425.338960][ T44] down_write+0x1d6/0x200 [ 4425.339132][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4425.339418][ T44] ? console_prepend_message+0x220/0x220 [ 4425.339647][ T44] ? find_held_lock+0x2b/0x80 [ 4425.339874][ T44] register_pernet_subsys+0x1a/0x40 [ 4425.340107][ T44] tcf_register_action+0xa3/0x600 [ 4425.340344][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4425.341400][ T44] do_one_initcall+0xc5/0x3d0 [ 4425.341725][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4425.342039][ T44] ? rcu_is_watching+0x12/0xb0 [ 4425.342294][ T44] ? trace_kmalloc+0x24/0xb0 [ 4425.342686][ T44] ? __kmalloc_cache_noprof+0x2f2/0x720 [ 4425.342946][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4425.343199][ T44] ? kasan_unpoison+0x27/0x50 [ 4425.343461][ T44] do_init_module+0x27a/0x860 [ 4425.343716][ T44] ? free_module+0x3f0/0x3f0 [ 4425.343948][ T44] ? kfree+0x2bb/0x5f0 [ 4425.344125][ T44] ? load_module+0x20c5/0x2dd0 [ 4425.344385][ T44] load_module+0x1f40/0x2dd0 [ 4425.344640][ T44] ? layout_and_allocate.constprop.0+0x650/0x650 [ 4425.344932][ T44] ? kernel_read_file+0x3ed/0x550 [ 4425.345170][ T44] ? kernel_read_file+0x3c8/0x550 [ 4425.345420][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4425.345659][ T44] ? init_module_from_file+0x159/0x180 [ 4425.345896][ T44] init_module_from_file+0x159/0x180 [ 4425.346127][ T44] ? __do_sys_init_module+0x200/0x200 [ 4425.346391][ T44] ? __lock_acquire+0x664/0xca0 [ 4425.346640][ T44] ? idempotent_init_module+0x316/0x610 [ 4425.346869][ T44] ? __lock_release+0x5d/0x160 [ 4425.347104][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4425.347339][ T44] idempotent_init_module+0x331/0x610 [ 4425.347586][ T44] ? init_module_from_file+0x180/0x180 [ 4425.347830][ T44] ? rcu_is_watching+0x12/0xb0 [ 4425.348070][ T44] ? cap_capable+0x17b/0x340 [ 4425.348321][ T44] __x64_sys_finit_module+0xd2/0x160 [ 4425.348562][ T44] ? do_syscall_64+0x85/0xfc0 [ 4425.348813][ T44] do_syscall_64+0xc1/0xfc0 [ 4425.349048][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4425.349789][ T44] RIP: 0033:0x7fcc9c63492d [ 4425.350060][ T44] RSP: 002b:00007ffcd3748948 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4425.350478][ T44] RAX: ffffffffffffffda RBX: 000055afed84fcc0 RCX: 00007fcc9c63492d [ 4425.350838][ T44] RDX: 0000000000000000 RSI: 000055afd1079a2a RDI: 0000000000000000 [ 4425.351199][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffcd3748a80 [ 4425.351572][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055afd1079a2a [ 4425.351938][ T44] R13: 000055afed84fb40 R14: 000055afed8500f0 R15: 000055afed84fd31 [ 4425.352317][ T44] [ 4425.352507][ T44] INFO: task modprobe:4132 is blocked on an rw-semaphore, but the owner is not found. [ 4425.352891][ T44] [ 4425.352891][ T44] Showing all locks held in the system: [ 4425.353234][ T44] 4 locks held by kworker/u16:0/12: [ 4425.353528][ T44] 1 lock held by khungtaskd/44: [ 4425.353759][ T44] #0: ffffffff8757fd80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4425.354189][ T44] 2 locks held by kworker/u18:2/570: [ 4425.354438][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 4425.354920][ T44] #1: ffffc90001117cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 4425.355470][ T44] 1 lock held by modprobe/4132: [ 4425.355704][ T44] #0: ffffffff87c75810 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4425.356155][ T44] [ 4425.356284][ T44] ============================================= [ 4425.356284][ T44] [ 4548.211576][ T44] INFO: task modprobe:4132 blocked for more than 245 seconds. [ 4548.212288][ T44] Tainted: G W 6.19.0-rc3-virtme #1 [ 4548.212643][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4548.213011][ T44] task:modprobe state:D stack:25192 pid:4132 tgid:4132 ppid:570 task_flags:0x400100 flags:0x00080000 [ 4548.213577][ T44] Call Trace: [ 4548.213775][ T44] [ 4548.213932][ T44] __schedule+0x90a/0x1930 [ 4548.214239][ T44] ? io_schedule_timeout+0x150/0x150 [ 4548.214501][ T44] ? __lock_release+0x5d/0x160 [ 4548.214744][ T44] schedule+0xe2/0x270 [ 4548.214929][ T44] schedule_preempt_disabled+0x18/0x30 [ 4548.215164][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4548.215420][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4548.215689][ T44] ? rcu_is_watching+0x12/0xb0 [ 4548.215939][ T44] ? lock_acquire+0x104/0x140 [ 4548.216194][ T44] down_write+0x1d6/0x200 [ 4548.216392][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4548.216701][ T44] ? console_prepend_message+0x220/0x220 [ 4548.216952][ T44] ? find_held_lock+0x2b/0x80 [ 4548.217189][ T44] register_pernet_subsys+0x1a/0x40 [ 4548.217460][ T44] tcf_register_action+0xa3/0x600 [ 4548.217723][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4548.218039][ T44] do_one_initcall+0xc5/0x3d0 [ 4548.218288][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4548.218600][ T44] ? rcu_is_watching+0x12/0xb0 [ 4548.218838][ T44] ? trace_kmalloc+0x24/0xb0 [ 4548.219079][ T44] ? __kmalloc_cache_noprof+0x2f2/0x720 [ 4548.219361][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4548.219622][ T44] ? kasan_unpoison+0x27/0x50 [ 4548.219876][ T44] do_init_module+0x27a/0x860 [ 4548.220146][ T44] ? free_module+0x3f0/0x3f0 [ 4548.220430][ T44] ? kfree+0x2bb/0x5f0 [ 4548.220610][ T44] ? load_module+0x20c5/0x2dd0 [ 4548.220843][ T44] load_module+0x1f40/0x2dd0 [ 4548.221081][ T44] ? layout_and_allocate.constprop.0+0x650/0x650 [ 4548.221501][ T44] ? kernel_read_file+0x3ed/0x550 [ 4548.221758][ T44] ? kernel_read_file+0x3c8/0x550 [ 4548.222015][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4548.222249][ T44] ? init_module_from_file+0x159/0x180 [ 4548.222487][ T44] init_module_from_file+0x159/0x180 [ 4548.222716][ T44] ? __do_sys_init_module+0x200/0x200 [ 4548.222959][ T44] ? __lock_acquire+0x664/0xca0 [ 4548.223223][ T44] ? idempotent_init_module+0x316/0x610 [ 4548.223457][ T44] ? __lock_release+0x5d/0x160 [ 4548.223692][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4548.223922][ T44] idempotent_init_module+0x331/0x610 [ 4548.224145][ T44] ? init_module_from_file+0x180/0x180 [ 4548.224392][ T44] ? rcu_is_watching+0x12/0xb0 [ 4548.224613][ T44] ? cap_capable+0x17b/0x340 [ 4548.224894][ T44] __x64_sys_finit_module+0xd2/0x160 [ 4548.225120][ T44] ? do_syscall_64+0x85/0xfc0 [ 4548.225352][ T44] do_syscall_64+0xc1/0xfc0 [ 4548.225612][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4548.225913][ T44] RIP: 0033:0x7fcc9c63492d [ 4548.226166][ T44] RSP: 002b:00007ffcd3748948 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4548.226546][ T44] RAX: ffffffffffffffda RBX: 000055afed84fcc0 RCX: 00007fcc9c63492d [ 4548.226920][ T44] RDX: 0000000000000000 RSI: 000055afd1079a2a RDI: 0000000000000000 [ 4548.227270][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffcd3748a80 [ 4548.227628][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055afd1079a2a [ 4548.227972][ T44] R13: 000055afed84fb40 R14: 000055afed8500f0 R15: 000055afed84fd31 [ 4548.228356][ T44] [ 4548.228545][ T44] INFO: task modprobe:4132 is blocked on an rw-semaphore, but the owner is not found. [ 4548.228942][ T44] [ 4548.228942][ T44] Showing all locks held in the system: [ 4548.229316][ T44] 4 locks held by kworker/u16:0/12: [ 4548.229669][ T44] 1 lock held by khungtaskd/44: [ 4548.229916][ T44] #0: ffffffff8757fd80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4548.230405][ T44] 2 locks held by kworker/u18:2/570: [ 4548.230622][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 4548.231092][ T44] #1: ffffc90001117cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 4548.231649][ T44] 1 lock held by modprobe/4132: [ 4548.231882][ T44] #0: ffffffff87c75810 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4548.232341][ T44] [ 4548.232456][ T44] ============================================= [ 4548.232456][ T44] [ 4671.091446][ T44] INFO: task modprobe:4132 blocked for more than 368 seconds. [ 4671.091941][ T44] Tainted: G W 6.19.0-rc3-virtme #1 [ 4671.092304][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4671.092772][ T44] task:modprobe state:D stack:25192 pid:4132 tgid:4132 ppid:570 task_flags:0x400100 flags:0x00080000 [ 4671.093262][ T44] Call Trace: [ 4671.093443][ T44] [ 4671.093566][ T44] __schedule+0x90a/0x1930 [ 4671.093802][ T44] ? io_schedule_timeout+0x150/0x150 [ 4671.094035][ T44] ? __lock_release+0x5d/0x160 [ 4671.094265][ T44] schedule+0xe2/0x270 [ 4671.094482][ T44] schedule_preempt_disabled+0x18/0x30 [ 4671.094734][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4671.094977][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4671.095217][ T44] ? rcu_is_watching+0x12/0xb0 [ 4671.095455][ T44] ? lock_acquire+0x104/0x140 [ 4671.095686][ T44] down_write+0x1d6/0x200 [ 4671.095853][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4671.096142][ T44] ? console_prepend_message+0x220/0x220 [ 4671.096382][ T44] ? find_held_lock+0x2b/0x80 [ 4671.096606][ T44] register_pernet_subsys+0x1a/0x40 [ 4671.096839][ T44] tcf_register_action+0xa3/0x600 [ 4671.097079][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4671.097375][ T44] do_one_initcall+0xc5/0x3d0 [ 4671.097602][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4671.097891][ T44] ? rcu_is_watching+0x12/0xb0 [ 4671.098120][ T44] ? trace_kmalloc+0x24/0xb0 [ 4671.098345][ T44] ? __kmalloc_cache_noprof+0x2f2/0x720 [ 4671.098572][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4671.098803][ T44] ? kasan_unpoison+0x27/0x50 [ 4671.099032][ T44] do_init_module+0x27a/0x860 [ 4671.099290][ T44] ? free_module+0x3f0/0x3f0 [ 4671.099550][ T44] ? kfree+0x2bb/0x5f0 [ 4671.099721][ T44] ? load_module+0x20c5/0x2dd0 [ 4671.099953][ T44] load_module+0x1f40/0x2dd0 [ 4671.100192][ T44] ? layout_and_allocate.constprop.0+0x650/0x650 [ 4671.100483][ T44] ? kernel_read_file+0x3ed/0x550 [ 4671.100719][ T44] ? kernel_read_file+0x3c8/0x550 [ 4671.100970][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4671.101215][ T44] ? init_module_from_file+0x159/0x180 [ 4671.101492][ T44] init_module_from_file+0x159/0x180 [ 4671.101719][ T44] ? __do_sys_init_module+0x200/0x200 [ 4671.101972][ T44] ? __lock_acquire+0x664/0xca0 [ 4671.102220][ T44] ? idempotent_init_module+0x316/0x610 [ 4671.102455][ T44] ? __lock_release+0x5d/0x160 [ 4671.102682][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4671.102913][ T44] idempotent_init_module+0x331/0x610 [ 4671.103160][ T44] ? init_module_from_file+0x180/0x180 [ 4671.103398][ T44] ? rcu_is_watching+0x12/0xb0 [ 4671.103619][ T44] ? cap_capable+0x17b/0x340 [ 4671.103850][ T44] __x64_sys_finit_module+0xd2/0x160 [ 4671.104073][ T44] ? do_syscall_64+0x85/0xfc0 [ 4671.104297][ T44] do_syscall_64+0xc1/0xfc0 [ 4671.104531][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4671.104862][ T44] RIP: 0033:0x7fcc9c63492d [ 4671.105098][ T44] RSP: 002b:00007ffcd3748948 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4671.105442][ T44] RAX: ffffffffffffffda RBX: 000055afed84fcc0 RCX: 00007fcc9c63492d [ 4671.105774][ T44] RDX: 0000000000000000 RSI: 000055afd1079a2a RDI: 0000000000000000 [ 4671.106117][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffcd3748a80 [ 4671.106479][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055afd1079a2a [ 4671.106811][ T44] R13: 000055afed84fb40 R14: 000055afed8500f0 R15: 000055afed84fd31 [ 4671.107155][ T44] [ 4671.107323][ T44] INFO: task modprobe:4132 is blocked on an rw-semaphore, but the owner is not found. [ 4671.107713][ T44] [ 4671.107713][ T44] Showing all locks held in the system: [ 4671.108059][ T44] 4 locks held by kworker/u16:0/12: [ 4671.108286][ T44] 1 lock held by khungtaskd/44: [ 4671.108665][ T44] #0: ffffffff8757fd80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4671.109058][ T44] 2 locks held by kworker/u18:2/570: [ 4671.109272][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 4671.109723][ T44] #1: ffffc90001117cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 4671.110218][ T44] 1 lock held by modprobe/4132: [ 4671.110435][ T44] #0: ffffffff87c75810 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4671.110885][ T44] [ 4671.111006][ T44] ============================================= [ 4671.111006][ T44] [ 4793.971443][ T44] INFO: task modprobe:4132 blocked for more than 491 seconds. [ 4793.971839][ T44] Tainted: G W 6.19.0-rc3-virtme #1 [ 4793.972150][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4793.972526][ T44] task:modprobe state:D stack:25192 pid:4132 tgid:4132 ppid:570 task_flags:0x400100 flags:0x00080000 [ 4793.973029][ T44] Call Trace: [ 4793.973200][ T44] [ 4793.973321][ T44] __schedule+0x90a/0x1930 [ 4793.973584][ T44] ? io_schedule_timeout+0x150/0x150 [ 4793.973819][ T44] ? __lock_release+0x5d/0x160 [ 4793.974063][ T44] schedule+0xe2/0x270 [ 4793.974232][ T44] schedule_preempt_disabled+0x18/0x30 [ 4793.974479][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4793.974712][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4793.974946][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.975170][ T44] ? lock_acquire+0x104/0x140 [ 4793.975408][ T44] down_write+0x1d6/0x200 [ 4793.975577][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4793.975850][ T44] ? console_prepend_message+0x220/0x220 [ 4793.976109][ T44] ? find_held_lock+0x2b/0x80 [ 4793.976357][ T44] register_pernet_subsys+0x1a/0x40 [ 4793.976590][ T44] tcf_register_action+0xa3/0x600 [ 4793.976819][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4793.977104][ T44] do_one_initcall+0xc5/0x3d0 [ 4793.977350][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4793.977632][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.977868][ T44] ? trace_kmalloc+0x24/0xb0 [ 4793.978118][ T44] ? __kmalloc_cache_noprof+0x2f2/0x720 [ 4793.978354][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4793.978587][ T44] ? kasan_unpoison+0x27/0x50 [ 4793.978818][ T44] do_init_module+0x27a/0x860 [ 4793.979053][ T44] ? free_module+0x3f0/0x3f0 [ 4793.979277][ T44] ? kfree+0x2bb/0x5f0 [ 4793.979475][ T44] ? load_module+0x20c5/0x2dd0 [ 4793.979703][ T44] load_module+0x1f40/0x2dd0 [ 4793.979935][ T44] ? layout_and_allocate.constprop.0+0x650/0x650 [ 4793.980220][ T44] ? kernel_read_file+0x3ed/0x550 [ 4793.980457][ T44] ? kernel_read_file+0x3c8/0x550 [ 4793.980682][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4793.980939][ T44] ? init_module_from_file+0x159/0x180 [ 4793.981165][ T44] init_module_from_file+0x159/0x180 [ 4793.981443][ T44] ? __do_sys_init_module+0x200/0x200 [ 4793.981671][ T44] ? __lock_acquire+0x664/0xca0 [ 4793.981903][ T44] ? idempotent_init_module+0x316/0x610 [ 4793.982131][ T44] ? __lock_release+0x5d/0x160 [ 4793.982353][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4793.982587][ T44] idempotent_init_module+0x331/0x610 [ 4793.982815][ T44] ? init_module_from_file+0x180/0x180 [ 4793.983047][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.983267][ T44] ? cap_capable+0x17b/0x340 [ 4793.983500][ T44] __x64_sys_finit_module+0xd2/0x160 [ 4793.983722][ T44] ? do_syscall_64+0x85/0xfc0 [ 4793.983944][ T44] do_syscall_64+0xc1/0xfc0 [ 4793.984167][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4793.984447][ T44] RIP: 0033:0x7fcc9c63492d [ 4793.984697][ T44] RSP: 002b:00007ffcd3748948 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4793.985037][ T44] RAX: ffffffffffffffda RBX: 000055afed84fcc0 RCX: 00007fcc9c63492d [ 4793.985376][ T44] RDX: 0000000000000000 RSI: 000055afd1079a2a RDI: 0000000000000000 [ 4793.985712][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffcd3748a80 [ 4793.986066][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055afd1079a2a [ 4793.986408][ T44] R13: 000055afed84fb40 R14: 000055afed8500f0 R15: 000055afed84fd31 [ 4793.986775][ T44] [ 4793.986943][ T44] INFO: task modprobe:4132 is blocked on an rw-semaphore, but the owner is not found. [ 4793.987322][ T44] [ 4793.987322][ T44] Showing all locks held in the system: [ 4793.987822][ T44] 4 locks held by kworker/u16:0/12: [ 4793.988047][ T44] 1 lock held by khungtaskd/44: [ 4793.988258][ T44] #0: ffffffff8757fd80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4793.988665][ T44] 2 locks held by kworker/u18:2/570: [ 4793.988875][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 4793.989324][ T44] #1: ffffc90001117cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 4793.989826][ T44] 1 lock held by modprobe/4132: [ 4793.990040][ T44] #0: ffffffff87c75810 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4793.990483][ T44] [ 4793.990593][ T44] ============================================= [ 4793.990593][ T44] [ 4916.851441][ T44] INFO: task modprobe:4132 blocked for more than 614 seconds. [ 4916.851904][ T44] Tainted: G W 6.19.0-rc3-virtme #1 [ 4916.852208][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4916.852606][ T44] task:modprobe state:D stack:25192 pid:4132 tgid:4132 ppid:570 task_flags:0x400100 flags:0x00080000 [ 4916.853115][ T44] Call Trace: [ 4916.853288][ T44] [ 4916.853419][ T44] __schedule+0x90a/0x1930 [ 4916.853657][ T44] ? io_schedule_timeout+0x150/0x150 [ 4916.853897][ T44] ? __lock_release+0x5d/0x160 [ 4916.854128][ T44] schedule+0xe2/0x270 [ 4916.854301][ T44] schedule_preempt_disabled+0x18/0x30 [ 4916.854552][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4916.854795][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4916.855028][ T44] ? rcu_is_watching+0x12/0xb0 [ 4916.855254][ T44] ? lock_acquire+0x104/0x140 [ 4916.855493][ T44] down_write+0x1d6/0x200 [ 4916.855674][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4916.855949][ T44] ? console_prepend_message+0x220/0x220 [ 4916.856174][ T44] ? find_held_lock+0x2b/0x80 [ 4916.856422][ T44] register_pernet_subsys+0x1a/0x40 [ 4916.856650][ T44] tcf_register_action+0xa3/0x600 [ 4916.856878][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4916.857160][ T44] do_one_initcall+0xc5/0x3d0 [ 4916.857388][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4916.857669][ T44] ? rcu_is_watching+0x12/0xb0 [ 4916.857893][ T44] ? trace_kmalloc+0x24/0xb0 [ 4916.858138][ T44] ? __kmalloc_cache_noprof+0x2f2/0x720 [ 4916.858359][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4916.858597][ T44] ? kasan_unpoison+0x27/0x50 [ 4916.858826][ T44] do_init_module+0x27a/0x860 [ 4916.859057][ T44] ? free_module+0x3f0/0x3f0 [ 4916.859284][ T44] ? kfree+0x2bb/0x5f0 [ 4916.859462][ T44] ? load_module+0x20c5/0x2dd0 [ 4916.859705][ T44] load_module+0x1f40/0x2dd0 [ 4916.859940][ T44] ? layout_and_allocate.constprop.0+0x650/0x650 [ 4916.860221][ T44] ? kernel_read_file+0x3ed/0x550 [ 4916.860453][ T44] ? kernel_read_file+0x3c8/0x550 [ 4916.860678][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4916.860907][ T44] ? init_module_from_file+0x159/0x180 [ 4916.861148][ T44] init_module_from_file+0x159/0x180 [ 4916.861423][ T44] ? __do_sys_init_module+0x200/0x200 [ 4916.861646][ T44] ? __lock_acquire+0x664/0xca0 [ 4916.861880][ T44] ? idempotent_init_module+0x316/0x610 [ 4916.862100][ T44] ? __lock_release+0x5d/0x160 [ 4916.862325][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4916.862560][ T44] idempotent_init_module+0x331/0x610 [ 4916.862782][ T44] ? init_module_from_file+0x180/0x180 [ 4916.863036][ T44] ? rcu_is_watching+0x12/0xb0 [ 4916.863257][ T44] ? cap_capable+0x17b/0x340 [ 4916.863499][ T44] __x64_sys_finit_module+0xd2/0x160 [ 4916.863725][ T44] ? do_syscall_64+0x85/0xfc0 [ 4916.863950][ T44] do_syscall_64+0xc1/0xfc0 [ 4916.864172][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4916.864457][ T44] RIP: 0033:0x7fcc9c63492d [ 4916.864703][ T44] RSP: 002b:00007ffcd3748948 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4916.865044][ T44] RAX: ffffffffffffffda RBX: 000055afed84fcc0 RCX: 00007fcc9c63492d [ 4916.865386][ T44] RDX: 0000000000000000 RSI: 000055afd1079a2a RDI: 0000000000000000 [ 4916.865720][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffcd3748a80 [ 4916.866048][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055afd1079a2a [ 4916.866404][ T44] R13: 000055afed84fb40 R14: 000055afed8500f0 R15: 000055afed84fd31 [ 4916.866771][ T44] [ 4916.866938][ T44] INFO: task modprobe:4132 is blocked on an rw-semaphore, but the owner is not found. [ 4916.867294][ T44] [ 4916.867294][ T44] Showing all locks held in the system: [ 4916.867791][ T44] 4 locks held by kworker/u16:0/12: [ 4916.868037][ T44] 1 lock held by khungtaskd/44: [ 4916.868250][ T44] #0: ffffffff8757fd80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4916.868651][ T44] 2 locks held by kworker/u18:2/570: [ 4916.868861][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 4916.869306][ T44] #1: ffffc90001117cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 4916.869808][ T44] 1 lock held by modprobe/4132: [ 4916.870021][ T44] #0: ffffffff87c75810 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4916.870849][ T44] [ 4916.870981][ T44] ============================================= [ 4916.870981][ T44] [ 5039.731436][ T44] INFO: task modprobe:4132 blocked for more than 737 seconds. [ 5039.731879][ T44] Tainted: G W 6.19.0-rc3-virtme #1 [ 5039.732186][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5039.732569][ T44] task:modprobe state:D stack:25192 pid:4132 tgid:4132 ppid:570 task_flags:0x400100 flags:0x00080000 [ 5039.733081][ T44] Call Trace: [ 5039.733253][ T44] [ 5039.733385][ T44] __schedule+0x90a/0x1930 [ 5039.733627][ T44] ? io_schedule_timeout+0x150/0x150 [ 5039.733857][ T44] ? __lock_release+0x5d/0x160 [ 5039.734088][ T44] schedule+0xe2/0x270 [ 5039.734258][ T44] schedule_preempt_disabled+0x18/0x30 [ 5039.734508][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 5039.734749][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 5039.734980][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.735203][ T44] ? lock_acquire+0x104/0x140 [ 5039.735443][ T44] down_write+0x1d6/0x200 [ 5039.735611][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 5039.735887][ T44] ? console_prepend_message+0x220/0x220 [ 5039.736124][ T44] ? find_held_lock+0x2b/0x80 [ 5039.736378][ T44] register_pernet_subsys+0x1a/0x40 [ 5039.736606][ T44] tcf_register_action+0xa3/0x600 [ 5039.736843][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 5039.737123][ T44] do_one_initcall+0xc5/0x3d0 [ 5039.737347][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 5039.737650][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.737880][ T44] ? trace_kmalloc+0x24/0xb0 [ 5039.738120][ T44] ? __kmalloc_cache_noprof+0x2f2/0x720 [ 5039.738342][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 5039.738574][ T44] ? kasan_unpoison+0x27/0x50 [ 5039.738803][ T44] do_init_module+0x27a/0x860 [ 5039.739032][ T44] ? free_module+0x3f0/0x3f0 [ 5039.739253][ T44] ? kfree+0x2bb/0x5f0 [ 5039.739431][ T44] ? load_module+0x20c5/0x2dd0 [ 5039.739659][ T44] load_module+0x1f40/0x2dd0 [ 5039.739906][ T44] ? layout_and_allocate.constprop.0+0x650/0x650 [ 5039.740205][ T44] ? kernel_read_file+0x3ed/0x550 [ 5039.740439][ T44] ? kernel_read_file+0x3c8/0x550 [ 5039.740662][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 5039.740891][ T44] ? init_module_from_file+0x159/0x180 [ 5039.741116][ T44] init_module_from_file+0x159/0x180 [ 5039.741342][ T44] ? __do_sys_init_module+0x200/0x200 [ 5039.741627][ T44] ? __lock_acquire+0x664/0xca0 [ 5039.741859][ T44] ? idempotent_init_module+0x316/0x610 [ 5039.742080][ T44] ? __lock_release+0x5d/0x160 [ 5039.742301][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 5039.742541][ T44] idempotent_init_module+0x331/0x610 [ 5039.742766][ T44] ? init_module_from_file+0x180/0x180 [ 5039.742999][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.743237][ T44] ? cap_capable+0x17b/0x340 [ 5039.743476][ T44] __x64_sys_finit_module+0xd2/0x160 [ 5039.743700][ T44] ? do_syscall_64+0x85/0xfc0 [ 5039.743921][ T44] do_syscall_64+0xc1/0xfc0 [ 5039.744142][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5039.744426][ T44] RIP: 0033:0x7fcc9c63492d [ 5039.744672][ T44] RSP: 002b:00007ffcd3748948 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 5039.745023][ T44] RAX: ffffffffffffffda RBX: 000055afed84fcc0 RCX: 00007fcc9c63492d [ 5039.745358][ T44] RDX: 0000000000000000 RSI: 000055afd1079a2a RDI: 0000000000000000 [ 5039.745713][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffcd3748a80 [ 5039.746047][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055afd1079a2a [ 5039.746405][ T44] R13: 000055afed84fb40 R14: 000055afed8500f0 R15: 000055afed84fd31 [ 5039.746771][ T44] [ 5039.746936][ T44] INFO: task modprobe:4132 is blocked on an rw-semaphore, but the owner is not found. [ 5039.747297][ T44] [ 5039.747297][ T44] Showing all locks held in the system: [ 5039.747779][ T44] 4 locks held by kworker/u16:0/12: [ 5039.748016][ T44] 1 lock held by khungtaskd/44: [ 5039.748231][ T44] #0: ffffffff8757fd80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 5039.748632][ T44] 2 locks held by kworker/u18:2/570: [ 5039.748844][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 5039.749280][ T44] #1: ffffc90001117cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 5039.749795][ T44] 1 lock held by modprobe/4132: [ 5039.750008][ T44] #0: ffffffff87c75810 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 5039.750442][ T44] [ 5039.750550][ T44] ============================================= [ 5039.750550][ T44] [ 5162.611441][ T44] INFO: task modprobe:4132 blocked for more than 860 seconds. [ 5162.611930][ T44] Tainted: G W 6.19.0-rc3-virtme #1 [ 5162.612238][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5162.612625][ T44] task:modprobe state:D stack:25192 pid:4132 tgid:4132 ppid:570 task_flags:0x400100 flags:0x00080000 [ 5162.613111][ T44] Call Trace: [ 5162.613292][ T44] [ 5162.613426][ T44] __schedule+0x90a/0x1930 [ 5162.613665][ T44] ? io_schedule_timeout+0x150/0x150 [ 5162.613902][ T44] ? __lock_release+0x5d/0x160 [ 5162.614131][ T44] schedule+0xe2/0x270 [ 5162.614299][ T44] schedule_preempt_disabled+0x18/0x30 [ 5162.614543][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 5162.614770][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 5162.615008][ T44] ? rcu_is_watching+0x12/0xb0 [ 5162.615231][ T44] ? lock_acquire+0x104/0x140 [ 5162.615482][ T44] down_write+0x1d6/0x200 [ 5162.615651][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 5162.615925][ T44] ? console_prepend_message+0x220/0x220 [ 5162.616148][ T44] ? find_held_lock+0x2b/0x80 [ 5162.616476][ T44] register_pernet_subsys+0x1a/0x40 [ 5162.616799][ T44] tcf_register_action+0xa3/0x600 [ 5162.617040][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 5162.617323][ T44] do_one_initcall+0xc5/0x3d0 [ 5162.617557][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 5162.617836][ T44] ? rcu_is_watching+0x12/0xb0 [ 5162.618060][ T44] ? trace_kmalloc+0x24/0xb0 [ 5162.618282][ T44] ? __kmalloc_cache_noprof+0x2f2/0x720 [ 5162.618524][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 5162.618765][ T44] ? kasan_unpoison+0x27/0x50 [ 5162.618992][ T44] do_init_module+0x27a/0x860 [ 5162.619220][ T44] ? free_module+0x3f0/0x3f0 [ 5162.619449][ T44] ? kfree+0x2bb/0x5f0 [ 5162.619620][ T44] ? load_module+0x20c5/0x2dd0 [ 5162.619851][ T44] load_module+0x1f40/0x2dd0 [ 5162.620086][ T44] ? layout_and_allocate.constprop.0+0x650/0x650 [ 5162.620415][ T44] ? kernel_read_file+0x3ed/0x550 [ 5162.620642][ T44] ? kernel_read_file+0x3c8/0x550 [ 5162.620868][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 5162.621111][ T44] ? init_module_from_file+0x159/0x180 [ 5162.621355][ T44] init_module_from_file+0x159/0x180 [ 5162.621588][ T44] ? __do_sys_init_module+0x200/0x200 [ 5162.621822][ T44] ? __lock_acquire+0x664/0xca0 [ 5162.622067][ T44] ? idempotent_init_module+0x316/0x610 [ 5162.622287][ T44] ? __lock_release+0x5d/0x160 [ 5162.622520][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 5162.622748][ T44] idempotent_init_module+0x331/0x610 [ 5162.622974][ T44] ? init_module_from_file+0x180/0x180 [ 5162.623207][ T44] ? rcu_is_watching+0x12/0xb0 [ 5162.623441][ T44] ? cap_capable+0x17b/0x340 [ 5162.623683][ T44] __x64_sys_finit_module+0xd2/0x160 [ 5162.623903][ T44] ? do_syscall_64+0x85/0xfc0 [ 5162.624130][ T44] do_syscall_64+0xc1/0xfc0 [ 5162.624357][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5162.624642][ T44] RIP: 0033:0x7fcc9c63492d [ 5162.624876][ T44] RSP: 002b:00007ffcd3748948 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 5162.625260][ T44] RAX: ffffffffffffffda RBX: 000055afed84fcc0 RCX: 00007fcc9c63492d [ 5162.625598][ T44] RDX: 0000000000000000 RSI: 000055afd1079a2a RDI: 0000000000000000 [ 5162.625928][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffcd3748a80 [ 5162.626264][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055afd1079a2a [ 5162.626608][ T44] R13: 000055afed84fb40 R14: 000055afed8500f0 R15: 000055afed84fd31 [ 5162.626966][ T44] [ 5162.627133][ T44] INFO: task modprobe:4132 is blocked on an rw-semaphore, but the owner is not found. [ 5162.627495][ T44] [ 5162.627495][ T44] Showing all locks held in the system: [ 5162.627808][ T44] 4 locks held by kworker/u16:0/12: [ 5162.628033][ T44] 1 lock held by khungtaskd/44: [ 5162.628261][ T44] #0: ffffffff8757fd80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 5162.628819][ T44] 2 locks held by kworker/u18:2/570: [ 5162.629028][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 5162.629470][ T44] #1: ffffc90001117cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 5162.629964][ T44] 1 lock held by modprobe/4132: [ 5162.630172][ T44] #0: ffffffff87c75810 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 5162.630599][ T44] [ 5162.630707][ T44] ============================================= [ 5162.630707][ T44] [ 5285.491431][ T44] INFO: task modprobe:4132 blocked for more than 983 seconds. [ 5285.491895][ T44] Tainted: G W 6.19.0-rc3-virtme #1 [ 5285.492203][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5285.492579][ T44] task:modprobe state:D stack:25192 pid:4132 tgid:4132 ppid:570 task_flags:0x400100 flags:0x00080000 [ 5285.493049][ T44] Call Trace: [ 5285.493212][ T44] [ 5285.493328][ T44] __schedule+0x90a/0x1930 [ 5285.493598][ T44] ? io_schedule_timeout+0x150/0x150 [ 5285.493822][ T44] ? __lock_release+0x5d/0x160 [ 5285.494050][ T44] schedule+0xe2/0x270 [ 5285.494217][ T44] schedule_preempt_disabled+0x18/0x30 [ 5285.494440][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 5285.494664][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 5285.494888][ T44] ? rcu_is_watching+0x12/0xb0 [ 5285.495119][ T44] ? lock_acquire+0x104/0x140 [ 5285.495342][ T44] down_write+0x1d6/0x200 [ 5285.495523][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 5285.495791][ T44] ? console_prepend_message+0x220/0x220 [ 5285.496010][ T44] ? find_held_lock+0x2b/0x80 [ 5285.496228][ T44] register_pernet_subsys+0x1a/0x40 [ 5285.496455][ T44] tcf_register_action+0xa3/0x600 [ 5285.496694][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 5285.496983][ T44] do_one_initcall+0xc5/0x3d0 [ 5285.497200][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 5285.497479][ T44] ? rcu_is_watching+0x12/0xb0 [ 5285.497696][ T44] ? trace_kmalloc+0x24/0xb0 [ 5285.497912][ T44] ? __kmalloc_cache_noprof+0x2f2/0x720 [ 5285.498127][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 5285.498378][ T44] ? kasan_unpoison+0x27/0x50 [ 5285.498598][ T44] do_init_module+0x27a/0x860 [ 5285.498823][ T44] ? free_module+0x3f0/0x3f0 [ 5285.499038][ T44] ? kfree+0x2bb/0x5f0 [ 5285.499201][ T44] ? load_module+0x20c5/0x2dd0 [ 5285.499429][ T44] load_module+0x1f40/0x2dd0 [ 5285.499659][ T44] ? layout_and_allocate.constprop.0+0x650/0x650 [ 5285.499931][ T44] ? kernel_read_file+0x3ed/0x550 [ 5285.500163][ T44] ? kernel_read_file+0x3c8/0x550 [ 5285.500389][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 5285.500614][ T44] ? init_module_from_file+0x159/0x180 [ 5285.500832][ T44] init_module_from_file+0x159/0x180 [ 5285.501048][ T44] ? __do_sys_init_module+0x200/0x200 [ 5285.501270][ T44] ? __lock_acquire+0x664/0xca0 [ 5285.501509][ T44] ? idempotent_init_module+0x316/0x610 [ 5285.501739][ T44] ? __lock_release+0x5d/0x160 [ 5285.501956][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 5285.502174][ T44] idempotent_init_module+0x331/0x610 [ 5285.502398][ T44] ? init_module_from_file+0x180/0x180 [ 5285.502626][ T44] ? rcu_is_watching+0x12/0xb0 [ 5285.502845][ T44] ? cap_capable+0x17b/0x340 [ 5285.503066][ T44] __x64_sys_finit_module+0xd2/0x160 [ 5285.503292][ T44] ? do_syscall_64+0x85/0xfc0 [ 5285.503520][ T44] do_syscall_64+0xc1/0xfc0 [ 5285.503754][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5285.504020][ T44] RIP: 0033:0x7fcc9c63492d [ 5285.504254][ T44] RSP: 002b:00007ffcd3748948 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 5285.504591][ T44] RAX: ffffffffffffffda RBX: 000055afed84fcc0 RCX: 00007fcc9c63492d [ 5285.504924][ T44] RDX: 0000000000000000 RSI: 000055afd1079a2a RDI: 0000000000000000 [ 5285.505248][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffcd3748a80 [ 5285.505589][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055afd1079a2a [ 5285.505914][ T44] R13: 000055afed84fb40 R14: 000055afed8500f0 R15: 000055afed84fd31 [ 5285.506264][ T44] [ 5285.506443][ T44] INFO: task modprobe:4132 is blocked on an rw-semaphore, but the owner is not found. [ 5285.506795][ T44] [ 5285.506795][ T44] Showing all locks held in the system: [ 5285.507110][ T44] 4 locks held by kworker/u16:0/12: [ 5285.507325][ T44] 1 lock held by khungtaskd/44: [ 5285.507691][ T44] #0: ffffffff8757fd80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 5285.508078][ T44] 2 locks held by kworker/u18:2/570: [ 5285.508282][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 5285.508718][ T44] #1: ffffc90001117cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 5285.509212][ T44] 1 lock held by modprobe/4132: [ 5285.509425][ T44] #0: ffffffff87c75810 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 5285.509842][ T44] [ 5285.509957][ T44] ============================================= [ 5285.509957][ T44] [ 5408.371434][ T44] INFO: task modprobe:4132 blocked for more than 1105 seconds. [ 5408.372001][ T44] Tainted: G W 6.19.0-rc3-virtme #1 [ 5408.372551][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5408.373197][ T44] task:modprobe state:D stack:25192 pid:4132 tgid:4132 ppid:570 task_flags:0x400100 flags:0x00080000 [ 5408.374044][ T44] Call Trace: [ 5408.374323][ T44] [ 5408.374537][ T44] __schedule+0x90a/0x1930 [ 5408.374926][ T44] ? io_schedule_timeout+0x150/0x150 [ 5408.375301][ T44] ? __lock_release+0x5d/0x160 [ 5408.375692][ T44] schedule+0xe2/0x270 [ 5408.375996][ T44] schedule_preempt_disabled+0x18/0x30 [ 5408.376376][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 5408.376756][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 5408.377145][ T44] ? rcu_is_watching+0x12/0xb0 [ 5408.377524][ T44] ? lock_acquire+0x104/0x140 [ 5408.377901][ T44] down_write+0x1d6/0x200 [ 5408.378182][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 5408.378666][ T44] ? console_prepend_message+0x220/0x220 [ 5408.379039][ T44] ? find_held_lock+0x2b/0x80 [ 5408.379424][ T44] register_pernet_subsys+0x1a/0x40 [ 5408.379795][ T44] tcf_register_action+0xa3/0x600 [ 5408.380177][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 5408.380653][ T44] do_one_initcall+0xc5/0x3d0 [ 5408.381025][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 5408.381528][ T44] ? rcu_is_watching+0x12/0xb0 [ 5408.381910][ T44] ? trace_kmalloc+0x24/0xb0 [ 5408.382281][ T44] ? __kmalloc_cache_noprof+0x2f2/0x720 [ 5408.382661][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 5408.383034][ T44] ? kasan_unpoison+0x27/0x50 [ 5408.383432][ T44] do_init_module+0x27a/0x860 [ 5408.383820][ T44] ? free_module+0x3f0/0x3f0 [ 5408.384211][ T44] ? kfree+0x2bb/0x5f0 [ 5408.384505][ T44] ? load_module+0x20c5/0x2dd0 [ 5408.384896][ T44] load_module+0x1f40/0x2dd0 [ 5408.385288][ T44] ? layout_and_allocate.constprop.0+0x650/0x650 [ 5408.385761][ T44] ? kernel_read_file+0x3ed/0x550 [ 5408.386136][ T44] ? kernel_read_file+0x3c8/0x550 [ 5408.386524][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 5408.386906][ T44] ? init_module_from_file+0x159/0x180 [ 5408.387296][ T44] init_module_from_file+0x159/0x180 [ 5408.387678][ T44] ? __do_sys_init_module+0x200/0x200 [ 5408.388053][ T44] ? __lock_acquire+0x664/0xca0 [ 5408.388452][ T44] ? idempotent_init_module+0x316/0x610 [ 5408.388822][ T44] ? __lock_release+0x5d/0x160 [ 5408.389194][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 5408.389583][ T44] idempotent_init_module+0x331/0x610 [ 5408.389970][ T44] ? init_module_from_file+0x180/0x180 [ 5408.390360][ T44] ? rcu_is_watching+0x12/0xb0 [ 5408.390744][ T44] ? cap_capable+0x17b/0x340 [ 5408.391122][ T44] __x64_sys_finit_module+0xd2/0x160 [ 5408.391524][ T44] ? do_syscall_64+0x85/0xfc0 [ 5408.391906][ T44] do_syscall_64+0xc1/0xfc0 [ 5408.392280][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5408.392770][ T44] RIP: 0033:0x7fcc9c63492d [ 5408.393152][ T44] RSP: 002b:00007ffcd3748948 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 5408.393730][ T44] RAX: ffffffffffffffda RBX: 000055afed84fcc0 RCX: 00007fcc9c63492d [ 5408.394287][ T44] RDX: 0000000000000000 RSI: 000055afd1079a2a RDI: 0000000000000000 [ 5408.394887][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffcd3748a80 [ 5408.395481][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055afd1079a2a [ 5408.396041][ T44] R13: 000055afed84fb40 R14: 000055afed8500f0 R15: 000055afed84fd31 [ 5408.396652][ T44] [ 5408.396931][ T44] INFO: task modprobe:4132 is blocked on an rw-semaphore, but the owner is not found. [ 5408.397546][ T44] [ 5408.397546][ T44] Showing all locks held in the system: [ 5408.398094][ T44] 4 locks held by kworker/u16:0/12: [ 5408.398637][ T44] 1 lock held by khungtaskd/44: [ 5408.398924][ T44] #0: ffffffff8757fd80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 5408.399561][ T44] 2 locks held by kworker/u18:2/570: [ 5408.399943][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 5408.400687][ T44] #1: ffffc90001117cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 5408.401514][ T44] 1 lock held by modprobe/4132: [ 5408.401869][ T44] #0: ffffffff87c75810 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 5408.402596][ T44] [ 5408.402806][ T44] ============================================= [ 5408.402806][ T44] [ 5531.251431][ T44] INFO: task modprobe:4132 blocked for more than 1228 seconds. [ 5531.251868][ T44] Tainted: G W 6.19.0-rc3-virtme #1 [ 5531.252173][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5531.252542][ T44] task:modprobe state:D stack:25192 pid:4132 tgid:4132 ppid:570 task_flags:0x400100 flags:0x00080000 [ 5531.253058][ T44] Call Trace: [ 5531.253223][ T44] [ 5531.253342][ T44] __schedule+0x90a/0x1930 [ 5531.253601][ T44] ? io_schedule_timeout+0x150/0x150 [ 5531.253827][ T44] ? __lock_release+0x5d/0x160 [ 5531.254054][ T44] schedule+0xe2/0x270 [ 5531.254221][ T44] schedule_preempt_disabled+0x18/0x30 [ 5531.254477][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 5531.254702][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 5531.254931][ T44] ? rcu_is_watching+0x12/0xb0 [ 5531.255152][ T44] ? lock_acquire+0x104/0x140 [ 5531.255385][ T44] down_write+0x1d6/0x200 [ 5531.255552][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 5531.255830][ T44] ? console_prepend_message+0x220/0x220 [ 5531.256064][ T44] ? find_held_lock+0x2b/0x80 [ 5531.256284][ T44] register_pernet_subsys+0x1a/0x40 [ 5531.256517][ T44] tcf_register_action+0xa3/0x600 [ 5531.256740][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 5531.257016][ T44] do_one_initcall+0xc5/0x3d0 [ 5531.257236][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 5531.257520][ T44] ? rcu_is_watching+0x12/0xb0 [ 5531.257764][ T44] ? trace_kmalloc+0x24/0xb0 [ 5531.257985][ T44] ? __kmalloc_cache_noprof+0x2f2/0x720 [ 5531.258204][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 5531.258433][ T44] ? kasan_unpoison+0x27/0x50 [ 5531.258660][ T44] do_init_module+0x27a/0x860 [ 5531.258883][ T44] ? free_module+0x3f0/0x3f0 [ 5531.259103][ T44] ? kfree+0x2bb/0x5f0 [ 5531.259281][ T44] ? load_module+0x20c5/0x2dd0 [ 5531.259529][ T44] load_module+0x1f40/0x2dd0 [ 5531.259760][ T44] ? layout_and_allocate.constprop.0+0x650/0x650 [ 5531.260034][ T44] ? kernel_read_file+0x3ed/0x550 [ 5531.260255][ T44] ? kernel_read_file+0x3c8/0x550 [ 5531.260487][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 5531.260711][ T44] ? init_module_from_file+0x159/0x180 [ 5531.260930][ T44] init_module_from_file+0x159/0x180 [ 5531.261159][ T44] ? __do_sys_init_module+0x200/0x200 [ 5531.261389][ T44] ? __lock_acquire+0x664/0xca0 [ 5531.261621][ T44] ? idempotent_init_module+0x316/0x610 [ 5531.261839][ T44] ? __lock_release+0x5d/0x160 [ 5531.262079][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 5531.262304][ T44] idempotent_init_module+0x331/0x610 [ 5531.262548][ T44] ? init_module_from_file+0x180/0x180 [ 5531.262780][ T44] ? rcu_is_watching+0x12/0xb0 [ 5531.262997][ T44] ? cap_capable+0x17b/0x340 [ 5531.263221][ T44] __x64_sys_finit_module+0xd2/0x160 [ 5531.263457][ T44] ? do_syscall_64+0x85/0xfc0 [ 5531.263682][ T44] do_syscall_64+0xc1/0xfc0 [ 5531.263911][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5531.264183][ T44] RIP: 0033:0x7fcc9c63492d [ 5531.264444][ T44] RSP: 002b:00007ffcd3748948 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 5531.264776][ T44] RAX: ffffffffffffffda RBX: 000055afed84fcc0 RCX: 00007fcc9c63492d [ 5531.265105][ T44] RDX: 0000000000000000 RSI: 000055afd1079a2a RDI: 0000000000000000 [ 5531.265439][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffcd3748a80 [ 5531.265779][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055afd1079a2a [ 5531.266107][ T44] R13: 000055afed84fb40 R14: 000055afed8500f0 R15: 000055afed84fd31 [ 5531.266461][ T44] [ 5531.266628][ T44] INFO: task modprobe:4132 is blocked on an rw-semaphore, but the owner is not found. [ 5531.266975][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings [ 5531.267346][ T44] [ 5531.267346][ T44] Showing all locks held in the system: [ 5531.267823][ T44] 4 locks held by kworker/u16:0/12: [ 5531.268042][ T44] 1 lock held by khungtaskd/44: [ 5531.268251][ T44] #0: ffffffff8757fd80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 5531.268642][ T44] 2 locks held by kworker/u18:2/570: [ 5531.268861][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 5531.269288][ T44] #1: ffffc90001117cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 5531.269777][ T44] 1 lock held by modprobe/4132: [ 5531.269995][ T44] #0: ffffffff87c75810 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 5531.270434][ T44] [ 5531.270543][ T44] ============================================= [ 5531.270543][ T44] WAIT TIMEOUT stderr Ctrl-C stderr Ctrl-C stderr