[ 3713.940272][ T3619] GACT probability NOT on [ 3761.719878][ T12] ------------[ cut here ]------------ [ 3761.720489][ T12] conntrack cleanup blocked for 60s [ 3761.720493][ T12] WARNING: net/netfilter/nf_conntrack_core.c:2511 at 0x0, CPU#0: kworker/u16:0/12 [ 3761.721267][ T12] Modules linked in: act_gact(+) cls_flower sch_ingress xt_conntrack nft_chain_nat xt_nat bonding xfrm_user macsec ip6_gre ip_gre gre cls_u32 sch_htb vxlan openvswitch psample nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nsh ip6t_REJECT nf_reject_ipv6 nft_compat nf_tables [last unloaded: netdevsim] [ 3761.722828][ T12] CPU: 0 UID: 0 PID: 12 Comm: kworker/u16:0 Not tainted 6.18.0-virtme #1 PREEMPT(full) [ 3761.723313][ T12] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 3761.723657][ T12] Workqueue: netns cleanup_net [ 3761.723966][ T12] RIP: 0010:nf_conntrack_cleanup_net_list+0x4a0/0x540 [nf_conntrack] [ 3761.724413][ T12] Code: 00 00 00 65 48 2b 05 ff c1 43 d1 0f 85 a0 00 00 00 48 81 c4 c0 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 48 8d 3d 00 42 e8 ff <67> 48 0f b9 3a e9 0f ff ff ff 48 c7 c7 bc cf 35 c0 e8 0a ff 01 cd [ 3761.725394][ T12] RSP: 0018:ffffc900000c7988 EFLAGS: 00010297 [ 3761.725741][ T12] RAX: 000000010034cfcf RBX: ffffc900000c7ae8 RCX: ffffffffc04cbb0a [ 3761.726170][ T12] RDX: 000000010034cfce RSI: 0000000000000004 RDI: ffffffffc0350030 [ 3761.726586][ T12] RBP: ffff888011251da0 R08: 0000000000000000 R09: ffffed100224a3b4 [ 3761.727012][ T12] R10: ffff888011251da3 R11: ffff888001abd090 R12: 0000000000000001 [ 3761.727425][ T12] R13: ffff88801127fd00 R14: dffffc0000000000 R15: ffffc900000c79e8 [ 3761.727857][ T12] FS: 0000000000000000(0000) GS:ffff8880db718000(0000) knlGS:0000000000000000 [ 3761.728337][ T12] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3761.728684][ T12] CR2: 00007ffdfadbefd8 CR3: 0000000010884006 CR4: 0000000000772ef0 [ 3761.729472][ T12] PKRU: 55555554 [ 3761.729675][ T12] Call Trace: [ 3761.729899][ T12] [ 3761.730045][ T12] ? nf_conntrack_cleanup_net_list+0x137/0x540 [nf_conntrack] [ 3761.730486][ T12] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 3761.730843][ T12] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 3761.731197][ T12] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 3761.731542][ T12] ? _raw_spin_unlock+0x2d/0x50 [ 3761.731837][ T12] ops_undo_list+0x2bf/0x890 [ 3761.732130][ T12] ? netns_install+0x280/0x280 [ 3761.732400][ T12] ? cleanup_net+0x2d6/0x8e0 [ 3761.732680][ T12] cleanup_net+0x3b2/0x8e0 [ 3761.732964][ T12] ? net_passive_dec+0x190/0x190 [ 3761.733240][ T12] ? rcu_is_watching+0x12/0xb0 [ 3761.733517][ T12] ? lock_acquire+0x104/0x140 [ 3761.733796][ T12] process_one_work+0x880/0x1810 [ 3761.734095][ T12] ? pwq_dec_nr_in_flight+0x550/0x550 [ 3761.734380][ T12] ? assign_work+0x168/0x240 [ 3761.734656][ T12] worker_thread+0x591/0xcf0 [ 3761.734943][ T12] ? bh_worker+0x6f0/0x6f0 [ 3761.735218][ T12] kthread+0x37b/0x5f0 [ 3761.735427][ T12] ? kthread_is_per_cpu+0xc0/0xc0 [ 3761.735699][ T12] ? ret_from_fork+0x71/0x540 [ 3761.735978][ T12] ? __lock_release+0x5d/0x160 [ 3761.736250][ T12] ? lock_acquire+0x104/0x140 [ 3761.736521][ T12] ? rcu_is_watching+0x12/0xb0 [ 3761.736798][ T12] ? kthread_is_per_cpu+0xc0/0xc0 [ 3761.737082][ T12] ret_from_fork+0x42f/0x540 [ 3761.737356][ T12] ? arch_exit_to_user_mode_prepare.constprop.0+0x140/0x140 [ 3761.737759][ T12] ? kthread_is_per_cpu+0xc0/0xc0 [ 3761.738038][ T12] ? __switch_to+0x5c8/0xd50 [ 3761.738316][ T12] ? kthread_is_per_cpu+0xc0/0xc0 [ 3761.738590][ T12] ret_from_fork_asm+0x11/0x20 [ 3761.738894][ T12] [ 3761.739102][ T12] irq event stamp: 9828767 [ 3761.739377][ T12] hardirqs last enabled at (9828775): [] __up_console_sem+0x67/0x70 [ 3761.739859][ T12] hardirqs last disabled at (9828784): [] __up_console_sem+0x4c/0x70 [ 3761.740337][ T12] softirqs last enabled at (9828336): [] handle_softirqs+0x524/0x820 [ 3761.740825][ T12] softirqs last disabled at (9828331): [] __irq_exit_rcu+0x6c/0xe0 [ 3761.741300][ T12] ---[ end trace 0000000000000000 ]--- [ 3933.800894][ T44] INFO: task modprobe:3619 blocked for more than 122 seconds. [ 3933.801412][ T44] Tainted: G W 6.18.0-virtme #1 [ 3933.801663][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 3933.802066][ T44] task:modprobe state:D stack:25208 pid:3619 tgid:3619 ppid:1358 task_flags:0x400100 flags:0x00080000 [ 3933.802538][ T44] Call Trace: [ 3933.802739][ T44] [ 3933.802869][ T44] __schedule+0x90a/0x1930 [ 3933.803104][ T44] ? io_schedule_timeout+0x150/0x150 [ 3933.803327][ T44] ? __lock_release+0x5d/0x160 [ 3933.803563][ T44] schedule+0xe2/0x270 [ 3933.803727][ T44] schedule_preempt_disabled+0x18/0x30 [ 3933.803952][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 3933.804172][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 3933.804400][ T44] ? rcu_is_watching+0x12/0xb0 [ 3933.804616][ T44] ? lock_acquire+0x104/0x140 [ 3933.804849][ T44] down_write+0x1d6/0x200 [ 3933.805022][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 3933.805288][ T44] ? console_prepend_message+0x220/0x220 [ 3933.805506][ T44] ? find_held_lock+0x2b/0x80 [ 3933.805728][ T44] register_pernet_subsys+0x1a/0x40 [ 3933.805957][ T44] tcf_register_action+0xa3/0x600 [ 3933.806177][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 3933.806448][ T44] do_one_initcall+0xc5/0x3d0 [ 3933.806675][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 3933.806955][ T44] ? rcu_is_watching+0x12/0xb0 [ 3933.807173][ T44] ? trace_kmalloc+0x24/0xb0 [ 3933.807748][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 3933.807975][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 3933.808196][ T44] ? kasan_unpoison+0x27/0x50 [ 3933.808419][ T44] do_init_module+0x27a/0x860 [ 3933.808652][ T44] ? free_module+0x3f0/0x3f0 [ 3933.808876][ T44] ? kfree+0x2bb/0x5f0 [ 3933.809041][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 3933.809307][ T44] ? load_module+0x20c5/0x2dd0 [ 3933.809530][ T44] load_module+0x1f40/0x2dd0 [ 3933.809756][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 3933.810032][ T44] ? kernel_read_file+0x3ed/0x550 [ 3933.810253][ T44] ? kernel_read_file+0x3c8/0x550 [ 3933.810490][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 3933.810713][ T44] ? init_module_from_file+0x159/0x180 [ 3933.810937][ T44] init_module_from_file+0x159/0x180 [ 3933.811152][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 3933.811371][ T44] ? __lock_acquire+0x664/0xca0 [ 3933.811596][ T44] ? idempotent_init_module+0x316/0x610 [ 3933.811817][ T44] ? __lock_release+0x5d/0x160 [ 3933.812088][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 3933.812307][ T44] idempotent_init_module+0x331/0x610 [ 3933.812526][ T44] ? init_module_from_file+0x180/0x180 [ 3933.812751][ T44] ? rcu_is_watching+0x12/0xb0 [ 3933.812974][ T44] ? cap_capable+0x17b/0x340 [ 3933.813199][ T44] __x64_sys_finit_module+0xca/0x150 [ 3933.813414][ T44] ? do_syscall_64+0x85/0xfc0 [ 3933.813641][ T44] do_syscall_64+0xc1/0xfc0 [ 3933.813866][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3933.814135][ T44] RIP: 0033:0x7fdd7b4f492d [ 3933.814361][ T44] RSP: 002b:00007ffdfadc3078 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 3933.814690][ T44] RAX: ffffffffffffffda RBX: 000055d127cabcc0 RCX: 00007fdd7b4f492d [ 3933.815022][ T44] RDX: 0000000000000000 RSI: 000055d0f342aa2a RDI: 0000000000000000 [ 3933.815352][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffdfadc31b0 [ 3933.815679][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055d0f342aa2a [ 3933.816013][ T44] R13: 000055d127cabb00 R14: 000055d127cac0f0 R15: 000055d127cabd31 [ 3933.816353][ T44] [ 3933.816525][ T44] INFO: task modprobe:3619 is blocked on an rw-semaphore, but the owner is not found. [ 3933.816877][ T44] [ 3933.816877][ T44] Showing all locks held in the system: [ 3933.817184][ T44] 4 locks held by kworker/u16:0/12: [ 3933.817401][ T44] 1 lock held by khungtaskd/44: [ 3933.817603][ T44] #0: ffffffff9057fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 3933.817988][ T44] 2 locks held by kworker/u19:3/1358: [ 3933.818189][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 3933.818603][ T44] #1: ffffc90003737cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 3933.819076][ T44] 1 lock held by modprobe/3619: [ 3933.819278][ T44] #0: ffffffff90c68cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 3933.819697][ T44] [ 3933.819802][ T44] ============================================= [ 3933.819802][ T44] [ 4056.680874][ T44] INFO: task modprobe:3619 blocked for more than 245 seconds. [ 4056.681310][ T44] Tainted: G W 6.18.0-virtme #1 [ 4056.681566][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4056.681938][ T44] task:modprobe state:D stack:25208 pid:3619 tgid:3619 ppid:1358 task_flags:0x400100 flags:0x00080000 [ 4056.682407][ T44] Call Trace: [ 4056.682570][ T44] [ 4056.682711][ T44] __schedule+0x90a/0x1930 [ 4056.682949][ T44] ? io_schedule_timeout+0x150/0x150 [ 4056.683169][ T44] ? __lock_release+0x5d/0x160 [ 4056.683405][ T44] schedule+0xe2/0x270 [ 4056.683573][ T44] schedule_preempt_disabled+0x18/0x30 [ 4056.683787][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4056.684016][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4056.684241][ T44] ? rcu_is_watching+0x12/0xb0 [ 4056.684458][ T44] ? lock_acquire+0x104/0x140 [ 4056.684681][ T44] down_write+0x1d6/0x200 [ 4056.684860][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4056.685129][ T44] ? console_prepend_message+0x220/0x220 [ 4056.685356][ T44] ? find_held_lock+0x2b/0x80 [ 4056.685577][ T44] register_pernet_subsys+0x1a/0x40 [ 4056.685795][ T44] tcf_register_action+0xa3/0x600 [ 4056.686021][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4056.686294][ T44] do_one_initcall+0xc5/0x3d0 [ 4056.686521][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4056.686790][ T44] ? rcu_is_watching+0x12/0xb0 [ 4056.687015][ T44] ? trace_kmalloc+0x24/0xb0 [ 4056.687231][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4056.687445][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4056.687660][ T44] ? kasan_unpoison+0x27/0x50 [ 4056.687889][ T44] do_init_module+0x27a/0x860 [ 4056.688119][ T44] ? free_module+0x3f0/0x3f0 [ 4056.688334][ T44] ? kfree+0x2bb/0x5f0 [ 4056.688496][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4056.688761][ T44] ? load_module+0x20c5/0x2dd0 [ 4056.688991][ T44] load_module+0x1f40/0x2dd0 [ 4056.689217][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4056.689487][ T44] ? kernel_read_file+0x3ed/0x550 [ 4056.689710][ T44] ? kernel_read_file+0x3c8/0x550 [ 4056.689942][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4056.690166][ T44] ? init_module_from_file+0x159/0x180 [ 4056.690381][ T44] init_module_from_file+0x159/0x180 [ 4056.690606][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4056.690835][ T44] ? __lock_acquire+0x664/0xca0 [ 4056.691061][ T44] ? idempotent_init_module+0x316/0x610 [ 4056.691282][ T44] ? __lock_release+0x5d/0x160 [ 4056.691503][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4056.691721][ T44] idempotent_init_module+0x331/0x610 [ 4056.691945][ T44] ? init_module_from_file+0x180/0x180 [ 4056.692172][ T44] ? rcu_is_watching+0x12/0xb0 [ 4056.692389][ T44] ? cap_capable+0x17b/0x340 [ 4056.692613][ T44] __x64_sys_finit_module+0xca/0x150 [ 4056.692839][ T44] ? do_syscall_64+0x85/0xfc0 [ 4056.693058][ T44] do_syscall_64+0xc1/0xfc0 [ 4056.693275][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4056.693542][ T44] RIP: 0033:0x7fdd7b4f492d [ 4056.693772][ T44] RSP: 002b:00007ffdfadc3078 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4056.694105][ T44] RAX: ffffffffffffffda RBX: 000055d127cabcc0 RCX: 00007fdd7b4f492d [ 4056.694434][ T44] RDX: 0000000000000000 RSI: 000055d0f342aa2a RDI: 0000000000000000 [ 4056.694754][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffdfadc31b0 [ 4056.695085][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055d0f342aa2a [ 4056.695407][ T44] R13: 000055d127cabb00 R14: 000055d127cac0f0 R15: 000055d127cabd31 [ 4056.695743][ T44] [ 4056.695917][ T44] INFO: task modprobe:3619 is blocked on an rw-semaphore, but the owner is not found. [ 4056.696256][ T44] [ 4056.696256][ T44] Showing all locks held in the system: [ 4056.696557][ T44] 4 locks held by kworker/u16:0/12: [ 4056.696767][ T44] 1 lock held by khungtaskd/44: [ 4056.696983][ T44] #0: ffffffff9057fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4056.697378][ T44] 2 locks held by kworker/u19:3/1358: [ 4056.697580][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 4056.698000][ T44] #1: ffffc90003737cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 4056.698465][ T44] 1 lock held by modprobe/3619: [ 4056.698670][ T44] #0: ffffffff90c68cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4056.699092][ T44] [ 4056.699194][ T44] ============================================= [ 4056.699194][ T44] [ 4179.560868][ T44] INFO: task modprobe:3619 blocked for more than 368 seconds. [ 4179.561291][ T44] Tainted: G W 6.18.0-virtme #1 [ 4179.561549][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4179.561910][ T44] task:modprobe state:D stack:25208 pid:3619 tgid:3619 ppid:1358 task_flags:0x400100 flags:0x00080000 [ 4179.562379][ T44] Call Trace: [ 4179.562545][ T44] [ 4179.562661][ T44] __schedule+0x90a/0x1930 [ 4179.562897][ T44] ? io_schedule_timeout+0x150/0x150 [ 4179.563125][ T44] ? __lock_release+0x5d/0x160 [ 4179.563351][ T44] schedule+0xe2/0x270 [ 4179.563516][ T44] schedule_preempt_disabled+0x18/0x30 [ 4179.563730][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4179.563961][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4179.564184][ T44] ? rcu_is_watching+0x12/0xb0 [ 4179.564400][ T44] ? lock_acquire+0x104/0x140 [ 4179.564626][ T44] down_write+0x1d6/0x200 [ 4179.564797][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4179.565074][ T44] ? console_prepend_message+0x220/0x220 [ 4179.565292][ T44] ? find_held_lock+0x2b/0x80 [ 4179.565511][ T44] register_pernet_subsys+0x1a/0x40 [ 4179.565729][ T44] tcf_register_action+0xa3/0x600 [ 4179.565959][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4179.566233][ T44] do_one_initcall+0xc5/0x3d0 [ 4179.566465][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4179.566734][ T44] ? rcu_is_watching+0x12/0xb0 [ 4179.566957][ T44] ? trace_kmalloc+0x24/0xb0 [ 4179.567172][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4179.567389][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4179.567606][ T44] ? kasan_unpoison+0x27/0x50 [ 4179.567834][ T44] do_init_module+0x27a/0x860 [ 4179.568062][ T44] ? free_module+0x3f0/0x3f0 [ 4179.568279][ T44] ? kfree+0x2bb/0x5f0 [ 4179.568441][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4179.568710][ T44] ? load_module+0x20c5/0x2dd0 [ 4179.568944][ T44] load_module+0x1f40/0x2dd0 [ 4179.569172][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4179.569442][ T44] ? kernel_read_file+0x3ed/0x550 [ 4179.569719][ T44] ? kernel_read_file+0x3c8/0x550 [ 4179.569945][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4179.570167][ T44] ? init_module_from_file+0x159/0x180 [ 4179.570382][ T44] init_module_from_file+0x159/0x180 [ 4179.570596][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4179.570829][ T44] ? __lock_acquire+0x664/0xca0 [ 4179.571055][ T44] ? idempotent_init_module+0x316/0x610 [ 4179.571274][ T44] ? __lock_release+0x5d/0x160 [ 4179.571492][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4179.571708][ T44] idempotent_init_module+0x331/0x610 [ 4179.571934][ T44] ? init_module_from_file+0x180/0x180 [ 4179.572160][ T44] ? rcu_is_watching+0x12/0xb0 [ 4179.572375][ T44] ? cap_capable+0x17b/0x340 [ 4179.572597][ T44] __x64_sys_finit_module+0xca/0x150 [ 4179.572824][ T44] ? do_syscall_64+0x85/0xfc0 [ 4179.573044][ T44] do_syscall_64+0xc1/0xfc0 [ 4179.573260][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4179.573528][ T44] RIP: 0033:0x7fdd7b4f492d [ 4179.573752][ T44] RSP: 002b:00007ffdfadc3078 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4179.574083][ T44] RAX: ffffffffffffffda RBX: 000055d127cabcc0 RCX: 00007fdd7b4f492d [ 4179.574413][ T44] RDX: 0000000000000000 RSI: 000055d0f342aa2a RDI: 0000000000000000 [ 4179.574733][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffdfadc31b0 [ 4179.575065][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055d0f342aa2a [ 4179.575387][ T44] R13: 000055d127cabb00 R14: 000055d127cac0f0 R15: 000055d127cabd31 [ 4179.575729][ T44] [ 4179.575898][ T44] INFO: task modprobe:3619 is blocked on an rw-semaphore, but the owner is not found. [ 4179.576240][ T44] [ 4179.576240][ T44] Showing all locks held in the system: [ 4179.576539][ T44] 4 locks held by kworker/u16:0/12: [ 4179.576747][ T44] 1 lock held by khungtaskd/44: [ 4179.576958][ T44] #0: ffffffff9057fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4179.577334][ T44] 2 locks held by kworker/u19:3/1358: [ 4179.577533][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 4179.577951][ T44] #1: ffffc90003737cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 4179.578414][ T44] 1 lock held by modprobe/3619: [ 4179.578618][ T44] #0: ffffffff90c68cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4179.579034][ T44] [ 4179.579137][ T44] ============================================= [ 4179.579137][ T44] [ 4302.440913][ T44] INFO: task modprobe:3619 blocked for more than 491 seconds. [ 4302.441478][ T44] Tainted: G W 6.18.0-virtme #1 [ 4302.441776][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4302.442182][ T44] task:modprobe state:D stack:25208 pid:3619 tgid:3619 ppid:1358 task_flags:0x400100 flags:0x00080000 [ 4302.442696][ T44] Call Trace: [ 4302.442884][ T44] [ 4302.443010][ T44] __schedule+0x90a/0x1930 [ 4302.443255][ T44] ? io_schedule_timeout+0x150/0x150 [ 4302.443503][ T44] ? __lock_release+0x5d/0x160 [ 4302.443744][ T44] schedule+0xe2/0x270 [ 4302.443932][ T44] schedule_preempt_disabled+0x18/0x30 [ 4302.444164][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4302.444398][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4302.444640][ T44] ? rcu_is_watching+0x12/0xb0 [ 4302.444883][ T44] ? lock_acquire+0x104/0x140 [ 4302.445122][ T44] down_write+0x1d6/0x200 [ 4302.445306][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4302.445598][ T44] ? console_prepend_message+0x220/0x220 [ 4302.445841][ T44] ? find_held_lock+0x2b/0x80 [ 4302.446080][ T44] register_pernet_subsys+0x1a/0x40 [ 4302.446321][ T44] tcf_register_action+0xa3/0x600 [ 4302.446554][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4302.446855][ T44] do_one_initcall+0xc5/0x3d0 [ 4302.447103][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4302.447393][ T44] ? rcu_is_watching+0x12/0xb0 [ 4302.447622][ T44] ? trace_kmalloc+0x24/0xb0 [ 4302.447879][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4302.448112][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4302.448344][ T44] ? kasan_unpoison+0x27/0x50 [ 4302.448579][ T44] do_init_module+0x27a/0x860 [ 4302.448832][ T44] ? free_module+0x3f0/0x3f0 [ 4302.449064][ T44] ? kfree+0x2bb/0x5f0 [ 4302.449237][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4302.449520][ T44] ? load_module+0x20c5/0x2dd0 [ 4302.449757][ T44] load_module+0x1f40/0x2dd0 [ 4302.450005][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4302.450290][ T44] ? kernel_read_file+0x3ed/0x550 [ 4302.450529][ T44] ? kernel_read_file+0x3c8/0x550 [ 4302.450763][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4302.451026][ T44] ? init_module_from_file+0x159/0x180 [ 4302.451257][ T44] init_module_from_file+0x159/0x180 [ 4302.451488][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4302.451720][ T44] ? __lock_acquire+0x664/0xca0 [ 4302.451973][ T44] ? idempotent_init_module+0x316/0x610 [ 4302.452214][ T44] ? __lock_release+0x5d/0x160 [ 4302.452444][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4302.452676][ T44] idempotent_init_module+0x331/0x610 [ 4302.452919][ T44] ? init_module_from_file+0x180/0x180 [ 4302.453163][ T44] ? rcu_is_watching+0x12/0xb0 [ 4302.453391][ T44] ? cap_capable+0x17b/0x340 [ 4302.453631][ T44] __x64_sys_finit_module+0xca/0x150 [ 4302.453877][ T44] ? do_syscall_64+0x85/0xfc0 [ 4302.454113][ T44] do_syscall_64+0xc1/0xfc0 [ 4302.454352][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4302.454637][ T44] RIP: 0033:0x7fdd7b4f492d [ 4302.454886][ T44] RSP: 002b:00007ffdfadc3078 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4302.455237][ T44] RAX: ffffffffffffffda RBX: 000055d127cabcc0 RCX: 00007fdd7b4f492d [ 4302.455587][ T44] RDX: 0000000000000000 RSI: 000055d0f342aa2a RDI: 0000000000000000 [ 4302.455941][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffdfadc31b0 [ 4302.456286][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055d0f342aa2a [ 4302.456629][ T44] R13: 000055d127cabb00 R14: 000055d127cac0f0 R15: 000055d127cabd31 [ 4302.457004][ T44] [ 4302.457180][ T44] INFO: task modprobe:3619 is blocked on an rw-semaphore, but the owner is not found. [ 4302.457547][ T44] [ 4302.457547][ T44] Showing all locks held in the system: [ 4302.457878][ T44] 4 locks held by kworker/u16:0/12: [ 4302.458109][ T44] 1 lock held by khungtaskd/44: [ 4302.458327][ T44] #0: ffffffff9057fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4302.458735][ T44] 2 locks held by kworker/u19:3/1358: [ 4302.458956][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 4302.459398][ T44] #1: ffffc90003737cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 4302.459905][ T44] 1 lock held by modprobe/3619: [ 4302.460128][ T44] #0: ffffffff90c68cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4302.460566][ T44] [ 4302.460678][ T44] ============================================= [ 4302.460678][ T44] [ 4425.320905][ T44] INFO: task modprobe:3619 blocked for more than 614 seconds. [ 4425.321436][ T44] Tainted: G W 6.18.0-virtme #1 [ 4425.321722][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4425.322115][ T44] task:modprobe state:D stack:25208 pid:3619 tgid:3619 ppid:1358 task_flags:0x400100 flags:0x00080000 [ 4425.322616][ T44] Call Trace: [ 4425.322788][ T44] [ 4425.322925][ T44] __schedule+0x90a/0x1930 [ 4425.323169][ T44] ? io_schedule_timeout+0x150/0x150 [ 4425.323416][ T44] ? __lock_release+0x5d/0x160 [ 4425.323653][ T44] schedule+0xe2/0x270 [ 4425.323835][ T44] schedule_preempt_disabled+0x18/0x30 [ 4425.324062][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4425.324297][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4425.324536][ T44] ? rcu_is_watching+0x12/0xb0 [ 4425.324767][ T44] ? lock_acquire+0x104/0x140 [ 4425.325017][ T44] down_write+0x1d6/0x200 [ 4425.325195][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4425.325483][ T44] ? console_prepend_message+0x220/0x220 [ 4425.325718][ T44] ? find_held_lock+0x2b/0x80 [ 4425.325960][ T44] register_pernet_subsys+0x1a/0x40 [ 4425.326193][ T44] tcf_register_action+0xa3/0x600 [ 4425.326428][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4425.326725][ T44] do_one_initcall+0xc5/0x3d0 [ 4425.326971][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4425.327259][ T44] ? rcu_is_watching+0x12/0xb0 [ 4425.327488][ T44] ? trace_kmalloc+0x24/0xb0 [ 4425.327721][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4425.327956][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4425.328187][ T44] ? kasan_unpoison+0x27/0x50 [ 4425.328427][ T44] do_init_module+0x27a/0x860 [ 4425.328667][ T44] ? free_module+0x3f0/0x3f0 [ 4425.328905][ T44] ? kfree+0x2bb/0x5f0 [ 4425.329079][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4425.329363][ T44] ? load_module+0x20c5/0x2dd0 [ 4425.329605][ T44] load_module+0x1f40/0x2dd0 [ 4425.329856][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4425.330144][ T44] ? kernel_read_file+0x3ed/0x550 [ 4425.330386][ T44] ? kernel_read_file+0x3c8/0x550 [ 4425.330618][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4425.330860][ T44] ? init_module_from_file+0x159/0x180 [ 4425.331113][ T44] init_module_from_file+0x159/0x180 [ 4425.331347][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4425.331581][ T44] ? __lock_acquire+0x664/0xca0 [ 4425.331827][ T44] ? idempotent_init_module+0x316/0x610 [ 4425.332068][ T44] ? __lock_release+0x5d/0x160 [ 4425.332302][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4425.332533][ T44] idempotent_init_module+0x331/0x610 [ 4425.332766][ T44] ? init_module_from_file+0x180/0x180 [ 4425.333017][ T44] ? rcu_is_watching+0x12/0xb0 [ 4425.333253][ T44] ? cap_capable+0x17b/0x340 [ 4425.333491][ T44] __x64_sys_finit_module+0xca/0x150 [ 4425.333728][ T44] ? do_syscall_64+0x85/0xfc0 [ 4425.333970][ T44] do_syscall_64+0xc1/0xfc0 [ 4425.334201][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4425.334487][ T44] RIP: 0033:0x7fdd7b4f492d [ 4425.334726][ T44] RSP: 002b:00007ffdfadc3078 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4425.335081][ T44] RAX: ffffffffffffffda RBX: 000055d127cabcc0 RCX: 00007fdd7b4f492d [ 4425.335434][ T44] RDX: 0000000000000000 RSI: 000055d0f342aa2a RDI: 0000000000000000 [ 4425.335775][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffdfadc31b0 [ 4425.336128][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055d0f342aa2a [ 4425.336470][ T44] R13: 000055d127cabb00 R14: 000055d127cac0f0 R15: 000055d127cabd31 [ 4425.336844][ T44] [ 4425.337025][ T44] INFO: task modprobe:3619 is blocked on an rw-semaphore, but the owner is not found. [ 4425.337392][ T44] [ 4425.337392][ T44] Showing all locks held in the system: [ 4425.337713][ T44] 4 locks held by kworker/u16:0/12: [ 4425.337945][ T44] 1 lock held by khungtaskd/44: [ 4425.338160][ T44] #0: ffffffff9057fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4425.338563][ T44] 2 locks held by kworker/u19:3/1358: [ 4425.338776][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 4425.339219][ T44] #1: ffffc90003737cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 4425.339719][ T44] 1 lock held by modprobe/3619: [ 4425.339953][ T44] #0: ffffffff90c68cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4425.340389][ T44] [ 4425.340499][ T44] ============================================= [ 4425.340499][ T44] [ 4548.200901][ T44] INFO: task modprobe:3619 blocked for more than 737 seconds. [ 4548.201419][ T44] Tainted: G W 6.18.0-virtme #1 [ 4548.201701][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4548.202091][ T44] task:modprobe state:D stack:25208 pid:3619 tgid:3619 ppid:1358 task_flags:0x400100 flags:0x00080000 [ 4548.202597][ T44] Call Trace: [ 4548.202770][ T44] [ 4548.202903][ T44] __schedule+0x90a/0x1930 [ 4548.203150][ T44] ? io_schedule_timeout+0x150/0x150 [ 4548.203399][ T44] ? __lock_release+0x5d/0x160 [ 4548.203636][ T44] schedule+0xe2/0x270 [ 4548.203824][ T44] schedule_preempt_disabled+0x18/0x30 [ 4548.204053][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4548.204286][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4548.204525][ T44] ? rcu_is_watching+0x12/0xb0 [ 4548.204757][ T44] ? lock_acquire+0x104/0x140 [ 4548.205012][ T44] down_write+0x1d6/0x200 [ 4548.205187][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4548.205473][ T44] ? console_prepend_message+0x220/0x220 [ 4548.205709][ T44] ? find_held_lock+0x2b/0x80 [ 4548.205957][ T44] register_pernet_subsys+0x1a/0x40 [ 4548.206193][ T44] tcf_register_action+0xa3/0x600 [ 4548.206424][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4548.206720][ T44] do_one_initcall+0xc5/0x3d0 [ 4548.206960][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4548.207247][ T44] ? rcu_is_watching+0x12/0xb0 [ 4548.207478][ T44] ? trace_kmalloc+0x24/0xb0 [ 4548.207707][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4548.207940][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4548.208169][ T44] ? kasan_unpoison+0x27/0x50 [ 4548.208411][ T44] do_init_module+0x27a/0x860 [ 4548.208649][ T44] ? free_module+0x3f0/0x3f0 [ 4548.208887][ T44] ? kfree+0x2bb/0x5f0 [ 4548.209059][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4548.209343][ T44] ? load_module+0x20c5/0x2dd0 [ 4548.209576][ T44] load_module+0x1f40/0x2dd0 [ 4548.209823][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4548.210116][ T44] ? kernel_read_file+0x3ed/0x550 [ 4548.210347][ T44] ? kernel_read_file+0x3c8/0x550 [ 4548.210578][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4548.210821][ T44] ? init_module_from_file+0x159/0x180 [ 4548.211056][ T44] init_module_from_file+0x159/0x180 [ 4548.211303][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4548.211535][ T44] ? __lock_acquire+0x664/0xca0 [ 4548.211784][ T44] ? idempotent_init_module+0x316/0x610 [ 4548.212020][ T44] ? __lock_release+0x5d/0x160 [ 4548.212254][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4548.212497][ T44] idempotent_init_module+0x331/0x610 [ 4548.212728][ T44] ? init_module_from_file+0x180/0x180 [ 4548.212977][ T44] ? rcu_is_watching+0x12/0xb0 [ 4548.213205][ T44] ? cap_capable+0x17b/0x340 [ 4548.213447][ T44] __x64_sys_finit_module+0xca/0x150 [ 4548.213674][ T44] ? do_syscall_64+0x85/0xfc0 [ 4548.213914][ T44] do_syscall_64+0xc1/0xfc0 [ 4548.214144][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4548.214427][ T44] RIP: 0033:0x7fdd7b4f492d [ 4548.214666][ T44] RSP: 002b:00007ffdfadc3078 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4548.215023][ T44] RAX: ffffffffffffffda RBX: 000055d127cabcc0 RCX: 00007fdd7b4f492d [ 4548.215395][ T44] RDX: 0000000000000000 RSI: 000055d0f342aa2a RDI: 0000000000000000 [ 4548.215741][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffdfadc31b0 [ 4548.216090][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055d0f342aa2a [ 4548.216439][ T44] R13: 000055d127cabb00 R14: 000055d127cac0f0 R15: 000055d127cabd31 [ 4548.216804][ T44] [ 4548.216983][ T44] INFO: task modprobe:3619 is blocked on an rw-semaphore, but the owner is not found. [ 4548.217348][ T44] [ 4548.217348][ T44] Showing all locks held in the system: [ 4548.217668][ T44] 3 locks held by kworker/u16:0/12: [ 4548.217902][ T44] 1 lock held by khungtaskd/44: [ 4548.218117][ T44] #0: ffffffff9057fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4548.218518][ T44] 2 locks held by kworker/u19:3/1358: [ 4548.218732][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 4548.219187][ T44] #1: ffffc90003737cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 4548.219703][ T44] 1 lock held by modprobe/3619: [ 4548.219925][ T44] #0: ffffffff90c68cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4548.220370][ T44] [ 4548.220478][ T44] ============================================= [ 4548.220478][ T44] [ 4671.080902][ T44] INFO: task modprobe:3619 blocked for more than 860 seconds. [ 4671.081515][ T44] Tainted: G W 6.18.0-virtme #1 [ 4671.081907][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4671.082344][ T44] task:modprobe state:D stack:25208 pid:3619 tgid:3619 ppid:1358 task_flags:0x400100 flags:0x00080000 [ 4671.082861][ T44] Call Trace: [ 4671.083037][ T44] [ 4671.083162][ T44] __schedule+0x90a/0x1930 [ 4671.083418][ T44] ? io_schedule_timeout+0x150/0x150 [ 4671.083655][ T44] ? __lock_release+0x5d/0x160 [ 4671.083903][ T44] schedule+0xe2/0x270 [ 4671.084079][ T44] schedule_preempt_disabled+0x18/0x30 [ 4671.084310][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4671.084547][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4671.084786][ T44] ? rcu_is_watching+0x12/0xb0 [ 4671.085042][ T44] ? lock_acquire+0x104/0x140 [ 4671.085279][ T44] down_write+0x1d6/0x200 [ 4671.085456][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4671.085741][ T44] ? console_prepend_message+0x220/0x220 [ 4671.085986][ T44] ? find_held_lock+0x2b/0x80 [ 4671.086225][ T44] register_pernet_subsys+0x1a/0x40 [ 4671.086461][ T44] tcf_register_action+0xa3/0x600 [ 4671.086696][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4671.087003][ T44] do_one_initcall+0xc5/0x3d0 [ 4671.087237][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4671.087523][ T44] ? rcu_is_watching+0x12/0xb0 [ 4671.087754][ T44] ? trace_kmalloc+0x24/0xb0 [ 4671.087995][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4671.088223][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4671.088461][ T44] ? kasan_unpoison+0x27/0x50 [ 4671.088698][ T44] do_init_module+0x27a/0x860 [ 4671.088947][ T44] ? free_module+0x3f0/0x3f0 [ 4671.089176][ T44] ? kfree+0x2bb/0x5f0 [ 4671.089350][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4671.089632][ T44] ? load_module+0x20c5/0x2dd0 [ 4671.089873][ T44] load_module+0x1f40/0x2dd0 [ 4671.090115][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4671.090410][ T44] ? kernel_read_file+0x3ed/0x550 [ 4671.090644][ T44] ? kernel_read_file+0x3c8/0x550 [ 4671.090884][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4671.091119][ T44] ? init_module_from_file+0x159/0x180 [ 4671.091346][ T44] init_module_from_file+0x159/0x180 [ 4671.091583][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4671.091825][ T44] ? __lock_acquire+0x664/0xca0 [ 4671.092078][ T44] ? idempotent_init_module+0x316/0x610 [ 4671.092308][ T44] ? __lock_release+0x5d/0x160 [ 4671.092540][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4671.092774][ T44] idempotent_init_module+0x331/0x610 [ 4671.093017][ T44] ? init_module_from_file+0x180/0x180 [ 4671.093253][ T44] ? rcu_is_watching+0x12/0xb0 [ 4671.093482][ T44] ? cap_capable+0x17b/0x340 [ 4671.093734][ T44] __x64_sys_finit_module+0xca/0x150 [ 4671.093972][ T44] ? do_syscall_64+0x85/0xfc0 [ 4671.094203][ T44] do_syscall_64+0xc1/0xfc0 [ 4671.094435][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4671.094719][ T44] RIP: 0033:0x7fdd7b4f492d [ 4671.094968][ T44] RSP: 002b:00007ffdfadc3078 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4671.095315][ T44] RAX: ffffffffffffffda RBX: 000055d127cabcc0 RCX: 00007fdd7b4f492d [ 4671.095671][ T44] RDX: 0000000000000000 RSI: 000055d0f342aa2a RDI: 0000000000000000 [ 4671.096024][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffdfadc31b0 [ 4671.096371][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055d0f342aa2a [ 4671.096713][ T44] R13: 000055d127cabb00 R14: 000055d127cac0f0 R15: 000055d127cabd31 [ 4671.097087][ T44] [ 4671.097261][ T44] INFO: task modprobe:3619 is blocked on an rw-semaphore, but the owner is not found. [ 4671.097633][ T44] [ 4671.097633][ T44] Showing all locks held in the system: [ 4671.097961][ T44] 4 locks held by kworker/u16:0/12: [ 4671.098204][ T44] 1 lock held by khungtaskd/44: [ 4671.098430][ T44] #0: ffffffff9057fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4671.098841][ T44] 2 locks held by kworker/u19:3/1358: [ 4671.099054][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 4671.099490][ T44] #1: ffffc90003737cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 4671.099997][ T44] 1 lock held by modprobe/3619: [ 4671.100210][ T44] #0: ffffffff90c68cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4671.100644][ T44] [ 4671.100753][ T44] ============================================= [ 4671.100753][ T44] [ 4793.960899][ T44] INFO: task modprobe:3619 blocked for more than 983 seconds. [ 4793.961410][ T44] Tainted: G W 6.18.0-virtme #1 [ 4793.961685][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4793.962079][ T44] task:modprobe state:D stack:25208 pid:3619 tgid:3619 ppid:1358 task_flags:0x400100 flags:0x00080000 [ 4793.962581][ T44] Call Trace: [ 4793.962759][ T44] [ 4793.962895][ T44] __schedule+0x90a/0x1930 [ 4793.963154][ T44] ? io_schedule_timeout+0x150/0x150 [ 4793.963390][ T44] ? __lock_release+0x5d/0x160 [ 4793.963629][ T44] schedule+0xe2/0x270 [ 4793.963801][ T44] schedule_preempt_disabled+0x18/0x30 [ 4793.964043][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4793.964277][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4793.964517][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.964764][ T44] ? lock_acquire+0x104/0x140 [ 4793.965012][ T44] down_write+0x1d6/0x200 [ 4793.965188][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4793.965472][ T44] ? console_prepend_message+0x220/0x220 [ 4793.965706][ T44] ? find_held_lock+0x2b/0x80 [ 4793.965947][ T44] register_pernet_subsys+0x1a/0x40 [ 4793.966182][ T44] tcf_register_action+0xa3/0x600 [ 4793.966422][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4793.966711][ T44] do_one_initcall+0xc5/0x3d0 [ 4793.966950][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4793.967236][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.967465][ T44] ? trace_kmalloc+0x24/0xb0 [ 4793.967694][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4793.967934][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4793.968178][ T44] ? kasan_unpoison+0x27/0x50 [ 4793.968410][ T44] do_init_module+0x27a/0x860 [ 4793.968649][ T44] ? free_module+0x3f0/0x3f0 [ 4793.968894][ T44] ? kfree+0x2bb/0x5f0 [ 4793.969072][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4793.969355][ T44] ? load_module+0x20c5/0x2dd0 [ 4793.969590][ T44] load_module+0x1f40/0x2dd0 [ 4793.969837][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4793.970133][ T44] ? kernel_read_file+0x3ed/0x550 [ 4793.970366][ T44] ? kernel_read_file+0x3c8/0x550 [ 4793.970595][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4793.970839][ T44] ? init_module_from_file+0x159/0x180 [ 4793.971069][ T44] init_module_from_file+0x159/0x180 [ 4793.971300][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4793.971539][ T44] ? __lock_acquire+0x664/0xca0 [ 4793.971799][ T44] ? idempotent_init_module+0x316/0x610 [ 4793.972037][ T44] ? __lock_release+0x5d/0x160 [ 4793.972270][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4793.972504][ T44] idempotent_init_module+0x331/0x610 [ 4793.972747][ T44] ? init_module_from_file+0x180/0x180 [ 4793.972994][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.973224][ T44] ? cap_capable+0x17b/0x340 [ 4793.973470][ T44] __x64_sys_finit_module+0xca/0x150 [ 4793.973699][ T44] ? do_syscall_64+0x85/0xfc0 [ 4793.973941][ T44] do_syscall_64+0xc1/0xfc0 [ 4793.974186][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4793.974472][ T44] RIP: 0033:0x7fdd7b4f492d [ 4793.974712][ T44] RSP: 002b:00007ffdfadc3078 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4793.975081][ T44] RAX: ffffffffffffffda RBX: 000055d127cabcc0 RCX: 00007fdd7b4f492d [ 4793.975429][ T44] RDX: 0000000000000000 RSI: 000055d0f342aa2a RDI: 0000000000000000 [ 4793.975773][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffdfadc31b0 [ 4793.976126][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055d0f342aa2a [ 4793.976468][ T44] R13: 000055d127cabb00 R14: 000055d127cac0f0 R15: 000055d127cabd31 [ 4793.976841][ T44] [ 4793.977014][ T44] INFO: task modprobe:3619 is blocked on an rw-semaphore, but the owner is not found. [ 4793.977379][ T44] [ 4793.977379][ T44] Showing all locks held in the system: [ 4793.977699][ T44] 4 locks held by kworker/u16:0/12: [ 4793.977934][ T44] 1 lock held by khungtaskd/44: [ 4793.978157][ T44] #0: ffffffff9057fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4793.978551][ T44] 2 locks held by kworker/u19:3/1358: [ 4793.978766][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 4793.979216][ T44] #1: ffffc90003737cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 4793.979721][ T44] 1 lock held by modprobe/3619: [ 4793.979941][ T44] #0: ffffffff90c68cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4793.980373][ T44] [ 4793.980480][ T44] ============================================= [ 4793.980480][ T44] [ 4916.840904][ T44] INFO: task modprobe:3619 blocked for more than 1105 seconds. [ 4916.841508][ T44] Tainted: G W 6.18.0-virtme #1 [ 4916.841839][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4916.842208][ T44] task:modprobe state:D stack:25208 pid:3619 tgid:3619 ppid:1358 task_flags:0x400100 flags:0x00080000 [ 4916.842709][ T44] Call Trace: [ 4916.842895][ T44] [ 4916.843033][ T44] __schedule+0x90a/0x1930 [ 4916.843280][ T44] ? io_schedule_timeout+0x150/0x150 [ 4916.843516][ T44] ? __lock_release+0x5d/0x160 [ 4916.843753][ T44] schedule+0xe2/0x270 [ 4916.843942][ T44] schedule_preempt_disabled+0x18/0x30 [ 4916.844172][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4916.844407][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4916.844654][ T44] ? rcu_is_watching+0x12/0xb0 [ 4916.844895][ T44] ? lock_acquire+0x104/0x140 [ 4916.845140][ T44] down_write+0x1d6/0x200 [ 4916.845315][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4916.845598][ T44] ? console_prepend_message+0x220/0x220 [ 4916.845837][ T44] ? find_held_lock+0x2b/0x80 [ 4916.846070][ T44] register_pernet_subsys+0x1a/0x40 [ 4916.846306][ T44] tcf_register_action+0xa3/0x600 [ 4916.846547][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4916.846846][ T44] do_one_initcall+0xc5/0x3d0 [ 4916.847082][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4916.847364][ T44] ? rcu_is_watching+0x12/0xb0 [ 4916.847592][ T44] ? trace_kmalloc+0x24/0xb0 [ 4916.847829][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4916.848056][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4916.848299][ T44] ? kasan_unpoison+0x27/0x50 [ 4916.848532][ T44] do_init_module+0x27a/0x860 [ 4916.848769][ T44] ? free_module+0x3f0/0x3f0 [ 4916.849000][ T44] ? kfree+0x2bb/0x5f0 [ 4916.849173][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 4916.849462][ T44] ? load_module+0x20c5/0x2dd0 [ 4916.849696][ T44] load_module+0x1f40/0x2dd0 [ 4916.849954][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4916.850238][ T44] ? kernel_read_file+0x3ed/0x550 [ 4916.850474][ T44] ? kernel_read_file+0x3c8/0x550 [ 4916.850717][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4916.850961][ T44] ? init_module_from_file+0x159/0x180 [ 4916.851192][ T44] init_module_from_file+0x159/0x180 [ 4916.851423][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4916.851665][ T44] ? __lock_acquire+0x664/0xca0 [ 4916.851919][ T44] ? idempotent_init_module+0x316/0x610 [ 4916.852148][ T44] ? __lock_release+0x5d/0x160 [ 4916.852380][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4916.852614][ T44] idempotent_init_module+0x331/0x610 [ 4916.852855][ T44] ? init_module_from_file+0x180/0x180 [ 4916.853093][ T44] ? rcu_is_watching+0x12/0xb0 [ 4916.853333][ T44] ? cap_capable+0x17b/0x340 [ 4916.853572][ T44] __x64_sys_finit_module+0xca/0x150 [ 4916.853799][ T44] ? do_syscall_64+0x85/0xfc0 [ 4916.854038][ T44] do_syscall_64+0xc1/0xfc0 [ 4916.854268][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4916.854551][ T44] RIP: 0033:0x7fdd7b4f492d [ 4916.854788][ T44] RSP: 002b:00007ffdfadc3078 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4916.855150][ T44] RAX: ffffffffffffffda RBX: 000055d127cabcc0 RCX: 00007fdd7b4f492d [ 4916.855500][ T44] RDX: 0000000000000000 RSI: 000055d0f342aa2a RDI: 0000000000000000 [ 4916.855855][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffdfadc31b0 [ 4916.856200][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055d0f342aa2a [ 4916.856549][ T44] R13: 000055d127cabb00 R14: 000055d127cac0f0 R15: 000055d127cabd31 [ 4916.856916][ T44] [ 4916.857088][ T44] INFO: task modprobe:3619 is blocked on an rw-semaphore, but the owner is not found. [ 4916.857451][ T44] [ 4916.857451][ T44] Showing all locks held in the system: [ 4916.857777][ T44] 4 locks held by kworker/u16:0/12: [ 4916.858020][ T44] 1 lock held by khungtaskd/44: [ 4916.858237][ T44] #0: ffffffff9057fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4916.858635][ T44] 2 locks held by kworker/u19:3/1358: [ 4916.858855][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 4916.859293][ T44] #1: ffffc90003737cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 4916.859804][ T44] 1 lock held by modprobe/3619: [ 4916.860025][ T44] #0: ffffffff90c68cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4916.860458][ T44] [ 4916.860565][ T44] ============================================= [ 4916.860565][ T44] [ 5039.721053][ T44] INFO: task modprobe:3619 blocked for more than 1228 seconds. [ 5039.721671][ T44] Tainted: G W 6.18.0-virtme #1 [ 5039.721981][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5039.722353][ T44] task:modprobe state:D stack:25208 pid:3619 tgid:3619 ppid:1358 task_flags:0x400100 flags:0x00080000 [ 5039.722919][ T44] Call Trace: [ 5039.723094][ T44] [ 5039.723239][ T44] __schedule+0x90a/0x1930 [ 5039.723493][ T44] ? io_schedule_timeout+0x150/0x150 [ 5039.723719][ T44] ? __lock_release+0x5d/0x160 [ 5039.723999][ T44] schedule+0xe2/0x270 [ 5039.724175][ T44] schedule_preempt_disabled+0x18/0x30 [ 5039.724414][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 5039.724648][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 5039.724916][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.725163][ T44] ? lock_acquire+0x104/0x140 [ 5039.725400][ T44] down_write+0x1d6/0x200 [ 5039.725573][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 5039.725865][ T44] ? console_prepend_message+0x220/0x220 [ 5039.726099][ T44] ? find_held_lock+0x2b/0x80 [ 5039.726334][ T44] register_pernet_subsys+0x1a/0x40 [ 5039.726577][ T44] tcf_register_action+0xa3/0x600 [ 5039.726822][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 5039.727109][ T44] do_one_initcall+0xc5/0x3d0 [ 5039.727344][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 5039.727630][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.727869][ T44] ? trace_kmalloc+0x24/0xb0 [ 5039.728097][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 5039.728337][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 5039.728568][ T44] ? kasan_unpoison+0x27/0x50 [ 5039.728800][ T44] do_init_module+0x27a/0x860 [ 5039.729052][ T44] ? free_module+0x3f0/0x3f0 [ 5039.729280][ T44] ? kfree+0x2bb/0x5f0 [ 5039.729453][ T44] ? gact_cleanup_module+0x360/0x360 [act_gact] [ 5039.729736][ T44] ? load_module+0x20c5/0x2dd0 [ 5039.729982][ T44] load_module+0x1f40/0x2dd0 [ 5039.730235][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 5039.730523][ T44] ? kernel_read_file+0x3ed/0x550 [ 5039.730757][ T44] ? kernel_read_file+0x3c8/0x550 [ 5039.730998][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 5039.731233][ T44] ? init_module_from_file+0x159/0x180 [ 5039.731463][ T44] init_module_from_file+0x159/0x180 [ 5039.731694][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 5039.731960][ T44] ? __lock_acquire+0x664/0xca0 [ 5039.732203][ T44] ? idempotent_init_module+0x316/0x610 [ 5039.732433][ T44] ? __lock_release+0x5d/0x160 [ 5039.732669][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 5039.732911][ T44] idempotent_init_module+0x331/0x610 [ 5039.733145][ T44] ? init_module_from_file+0x180/0x180 [ 5039.733385][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.733629][ T44] ? cap_capable+0x17b/0x340 [ 5039.733873][ T44] __x64_sys_finit_module+0xca/0x150 [ 5039.734102][ T44] ? do_syscall_64+0x85/0xfc0 [ 5039.734335][ T44] do_syscall_64+0xc1/0xfc0 [ 5039.734565][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5039.734857][ T44] RIP: 0033:0x7fdd7b4f492d [ 5039.735095][ T44] RSP: 002b:00007ffdfadc3078 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 5039.735451][ T44] RAX: ffffffffffffffda RBX: 000055d127cabcc0 RCX: 00007fdd7b4f492d [ 5039.735796][ T44] RDX: 0000000000000000 RSI: 000055d0f342aa2a RDI: 0000000000000000 [ 5039.736146][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffdfadc31b0 [ 5039.736493][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055d0f342aa2a [ 5039.736864][ T44] R13: 000055d127cabb00 R14: 000055d127cac0f0 R15: 000055d127cabd31 [ 5039.737224][ T44] [ 5039.737397][ T44] INFO: task modprobe:3619 is blocked on an rw-semaphore, but the owner is not found. [ 5039.737759][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings [ 5039.738134][ T44] [ 5039.738134][ T44] Showing all locks held in the system: [ 5039.738465][ T44] 4 locks held by kworker/u16:0/12: [ 5039.738696][ T44] 1 lock held by khungtaskd/44: [ 5039.738920][ T44] #0: ffffffff9057fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 5039.739319][ T44] 2 locks held by kworker/u19:3/1358: [ 5039.739533][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0x1034/0x1810 [ 5039.739988][ T44] #1: ffffc90003737cb8 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0x802/0x1810 [ 5039.740484][ T44] 1 lock held by modprobe/3619: [ 5039.740698][ T44] #0: ffffffff90c68cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 5039.741139][ T44] [ 5039.741248][ T44] ============================================= [ 5039.741248][ T44] WAIT TIMEOUT stderr Ctrl-C stderr Ctrl-C stderr