[ 4137.740257][T32175] pktgen: Packet Generator for packet performance testing. Version: 2.75
[ 4302.401517][ T44] INFO: task modprobe:32175 blocked for more than 122 seconds.
[ 4302.402546][ T44] Not tainted 6.18.0-rc1-virtme #1
[ 4302.402766][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4302.403152][ T44] task:modprobe state:D stack:25352 pid:32175 tgid:32175 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4302.403740][ T44] Call Trace:
[ 4302.403913][ T44]
[ 4302.404037][ T44] __schedule+0x880/0x1b10
[ 4302.404276][ T44] ? io_schedule_timeout+0x150/0x150
[ 4302.404538][ T44] ? schedule+0x1ee/0x270
[ 4302.404704][ T44] ? __lock_release+0x5d/0x170
[ 4302.404931][ T44] schedule+0xe2/0x270
[ 4302.405099][ T44] schedule_preempt_disabled+0x18/0x30
[ 4302.405328][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 4302.405564][ T44] ? __lock_acquire+0x449/0x7e0
[ 4302.405785][ T44] ? down_read+0x4a0/0x4a0
[ 4302.406016][ T44] ? rcu_is_watching+0x12/0xb0
[ 4302.406237][ T44] ? lock_acquire+0x104/0x160
[ 4302.406464][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4302.406696][ T44] down_write+0x1d6/0x200
[ 4302.406863][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 4302.407140][ T44] ? find_held_lock+0x2b/0x80
[ 4302.407364][ T44] ? __create_object+0x5e/0xb0
[ 4302.407597][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4302.407870][ T44] register_pernet_subsys+0x1a/0x40
[ 4302.408088][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4302.408312][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4302.408595][ T44] do_one_initcall+0x8c/0x1d0
[ 4302.409157][ T44] ? trace_initcall_start+0x130/0x130
[ 4302.409379][ T44] ? rcu_is_watching+0x12/0xb0
[ 4302.409621][ T44] ? trace_kmalloc+0x26/0xd0
[ 4302.409841][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4302.410060][ T44] ? debug_objects_oom+0x160/0x160
[ 4302.410293][ T44] ? kasan_unpoison+0x27/0x50
[ 4302.410544][ T44] ? __asan_register_globals+0x5d/0x70
[ 4302.410776][ T44] do_init_module+0x27a/0x860
[ 4302.411004][ T44] ? free_module+0x2f0/0x2f0
[ 4302.411223][ T44] ? kfree+0x21d/0x540
[ 4302.411387][ T44] ? load_module+0x20c5/0x2dd0
[ 4302.411623][ T44] load_module+0x1f40/0x2dd0
[ 4302.411859][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4302.412132][ T44] ? kernel_read_file+0x3ed/0x550
[ 4302.412369][ T44] ? kernel_read_file+0x3c8/0x550
[ 4302.412610][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4302.412840][ T44] ? init_module_from_file+0xe9/0x150
[ 4302.413057][ T44] init_module_from_file+0xe9/0x150
[ 4302.413277][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4302.413518][ T44] ? idempotent_init_module+0x316/0x610
[ 4302.413736][ T44] ? __lock_release+0x5d/0x170
[ 4302.413959][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4302.414191][ T44] idempotent_init_module+0x331/0x610
[ 4302.414422][ T44] ? init_module_from_file+0x150/0x150
[ 4302.414655][ T44] ? cap_capable+0x94/0x230
[ 4302.414884][ T44] __x64_sys_finit_module+0xca/0x150
[ 4302.415102][ T44] ? do_syscall_64+0x85/0xfd0
[ 4302.415329][ T44] do_syscall_64+0xc1/0xfd0
[ 4302.415563][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4302.415845][ T44] RIP: 0033:0x7f114e11f92d
[ 4302.416079][ T44] RSP: 002b:00007ffc2508d258 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4302.416421][ T44] RAX: ffffffffffffffda RBX: 000055d922aa4ac0 RCX: 00007f114e11f92d
[ 4302.416756][ T44] RDX: 0000000000000000 RSI: 000055d8ff660a2a RDI: 0000000000000005
[ 4302.417087][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2508d390
[ 4302.417446][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055d8ff660a2a
[ 4302.417780][ T44] R13: 000055d922aa4b60 R14: 000055d922aa4da0 R15: 0000000000000000
[ 4302.418125][ T44]
[ 4302.418324][ T44] INFO: task modprobe:32175 blocked on an rw-semaphore likely owned by task kworker/u16:1:70
[ 4302.418813][ T44] task:kworker/u16:1 state:R running task stack:26320 pid:70 tgid:70 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4302.419363][ T44] Workqueue: netns cleanup_net
[ 4302.419598][ T44] Call Trace:
[ 4302.419767][ T44]
[ 4302.419881][ T44] ? __mutex_lock+0x19f/0x1190
[ 4302.420111][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4302.420348][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4302.420643][ T44] ? ww_mutex_lock+0x160/0x160
[ 4302.420882][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4302.421163][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4302.421448][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4302.421784][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4302.422125][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4302.422472][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4302.422755][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4302.423038][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4302.423259][ T44] ? ops_undo_list+0x2bf/0x890
[ 4302.423504][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4302.423725][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4302.423952][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4302.424171][ T44] ? net_passive_dec+0x190/0x190
[ 4302.424394][ T44] ? rcu_is_watching+0x12/0xb0
[ 4302.424627][ T44] ? process_one_work+0xe35/0x1650
[ 4302.424861][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4302.425088][ T44] ? assign_work+0x168/0x240
[ 4302.425319][ T44] ? worker_thread+0x591/0xcf0
[ 4302.425552][ T44] ? rescuer_thread+0xd10/0xd10
[ 4302.425776][ T44] ? kthread+0x37b/0x5f0
[ 4302.425944][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4302.426164][ T44] ? ret_from_fork+0x1b/0x270
[ 4302.426384][ T44] ? __lock_release+0x5d/0x170
[ 4302.426614][ T44] ? rcu_is_watching+0x12/0xb0
[ 4302.426833][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4302.427061][ T44] ? ret_from_fork+0x1db/0x270
[ 4302.427278][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4302.427505][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4302.427741][ T44]
[ 4302.427928][ T44]
[ 4302.427928][ T44] Showing all locks held in the system:
[ 4302.428255][ T44] 1 lock held by khungtaskd/44:
[ 4302.428537][ T44] #0: ffffffffa3f88240 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4302.428930][ T44] 4 locks held by kworker/u16:1/70:
[ 4302.429165][ T44] 1 lock held by modprobe/32175:
[ 4302.429378][ T44] #0: ffffffffa467f890 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4302.429814][ T44]
[ 4302.429928][ T44] =============================================
[ 4302.429928][ T44]
[ 4425.281512][ T44] INFO: task modprobe:32175 blocked for more than 245 seconds.
[ 4425.281984][ T44] Not tainted 6.18.0-rc1-virtme #1
[ 4425.282190][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4425.282576][ T44] task:modprobe state:D stack:25352 pid:32175 tgid:32175 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4425.283076][ T44] Call Trace:
[ 4425.283244][ T44]
[ 4425.283362][ T44] __schedule+0x880/0x1b10
[ 4425.283638][ T44] ? io_schedule_timeout+0x150/0x150
[ 4425.283873][ T44] ? schedule+0x1ee/0x270
[ 4425.284040][ T44] ? __lock_release+0x5d/0x170
[ 4425.284267][ T44] schedule+0xe2/0x270
[ 4425.284454][ T44] schedule_preempt_disabled+0x18/0x30
[ 4425.284671][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 4425.284893][ T44] ? __lock_acquire+0x449/0x7e0
[ 4425.285109][ T44] ? down_read+0x4a0/0x4a0
[ 4425.285336][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.285564][ T44] ? lock_acquire+0x104/0x160
[ 4425.285780][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4425.286008][ T44] down_write+0x1d6/0x200
[ 4425.286183][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 4425.286459][ T44] ? find_held_lock+0x2b/0x80
[ 4425.286681][ T44] ? __create_object+0x5e/0xb0
[ 4425.286907][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4425.287177][ T44] register_pernet_subsys+0x1a/0x40
[ 4425.287396][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4425.287649][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4425.287922][ T44] do_one_initcall+0x8c/0x1d0
[ 4425.288145][ T44] ? trace_initcall_start+0x130/0x130
[ 4425.288364][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.288589][ T44] ? trace_kmalloc+0x26/0xd0
[ 4425.288806][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4425.289023][ T44] ? debug_objects_oom+0x160/0x160
[ 4425.289245][ T44] ? kasan_unpoison+0x27/0x50
[ 4425.289491][ T44] ? __asan_register_globals+0x5d/0x70
[ 4425.289713][ T44] do_init_module+0x27a/0x860
[ 4425.289939][ T44] ? free_module+0x2f0/0x2f0
[ 4425.290154][ T44] ? kfree+0x21d/0x540
[ 4425.290320][ T44] ? load_module+0x20c5/0x2dd0
[ 4425.290552][ T44] load_module+0x1f40/0x2dd0
[ 4425.290782][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4425.291053][ T44] ? kernel_read_file+0x3ed/0x550
[ 4425.291284][ T44] ? kernel_read_file+0x3c8/0x550
[ 4425.291530][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4425.291757][ T44] ? init_module_from_file+0xe9/0x150
[ 4425.291976][ T44] init_module_from_file+0xe9/0x150
[ 4425.292195][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4425.292436][ T44] ? idempotent_init_module+0x316/0x610
[ 4425.292659][ T44] ? __lock_release+0x5d/0x170
[ 4425.292880][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4425.293100][ T44] idempotent_init_module+0x331/0x610
[ 4425.293321][ T44] ? init_module_from_file+0x150/0x150
[ 4425.293559][ T44] ? cap_capable+0x94/0x230
[ 4425.293788][ T44] __x64_sys_finit_module+0xca/0x150
[ 4425.294003][ T44] ? do_syscall_64+0x85/0xfd0
[ 4425.294237][ T44] do_syscall_64+0xc1/0xfd0
[ 4425.294466][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4425.294738][ T44] RIP: 0033:0x7f114e11f92d
[ 4425.294966][ T44] RSP: 002b:00007ffc2508d258 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4425.295295][ T44] RAX: ffffffffffffffda RBX: 000055d922aa4ac0 RCX: 00007f114e11f92d
[ 4425.295646][ T44] RDX: 0000000000000000 RSI: 000055d8ff660a2a RDI: 0000000000000005
[ 4425.295978][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2508d390
[ 4425.296305][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055d8ff660a2a
[ 4425.296637][ T44] R13: 000055d922aa4b60 R14: 000055d922aa4da0 R15: 0000000000000000
[ 4425.296978][ T44]
[ 4425.297158][ T44] INFO: task modprobe:32175 blocked on an rw-semaphore likely owned by task kworker/u16:1:70
[ 4425.297713][ T44] task:kworker/u16:1 state:R running task stack:26320 pid:70 tgid:70 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4425.298254][ T44] Workqueue: netns cleanup_net
[ 4425.298489][ T44] Call Trace:
[ 4425.298655][ T44]
[ 4425.298772][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 4425.299000][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 4425.299217][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.299474][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.299693][ T44] ? trace_contention_end+0xd8/0x140
[ 4425.299912][ T44] ? __mutex_lock+0x19f/0x1190
[ 4425.300131][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4425.300355][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4425.300661][ T44] ? ww_mutex_lock+0x160/0x160
[ 4425.300896][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4425.301175][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4425.301461][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4425.301797][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4425.302137][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4425.302480][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4425.302765][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4425.303043][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4425.303266][ T44] ? ops_undo_list+0x2bf/0x890
[ 4425.303513][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4425.303739][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4425.303966][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4425.304184][ T44] ? net_passive_dec+0x190/0x190
[ 4425.304414][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.304636][ T44] ? process_one_work+0xe35/0x1650
[ 4425.304867][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4425.305092][ T44] ? assign_work+0x168/0x240
[ 4425.305314][ T44] ? worker_thread+0x591/0xcf0
[ 4425.305552][ T44] ? rescuer_thread+0xd10/0xd10
[ 4425.305770][ T44] ? kthread+0x37b/0x5f0
[ 4425.305940][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4425.306155][ T44] ? ret_from_fork+0x1b/0x270
[ 4425.306372][ T44] ? __lock_release+0x5d/0x170
[ 4425.306600][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.306817][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4425.307038][ T44] ? ret_from_fork+0x1db/0x270
[ 4425.307259][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4425.307499][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4425.307733][ T44]
[ 4425.307925][ T44]
[ 4425.307925][ T44] Showing all locks held in the system:
[ 4425.308242][ T44] 1 lock held by khungtaskd/44:
[ 4425.308740][ T44] #0: ffffffffa3f88240 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4425.309123][ T44] 4 locks held by kworker/u16:1/70:
[ 4425.309354][ T44] 1 lock held by modprobe/32175:
[ 4425.309577][ T44] #0: ffffffffa467f890 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4425.309999][ T44]
[ 4425.310105][ T44] =============================================
[ 4425.310105][ T44]
[ 4548.161478][ T44] INFO: task modprobe:32175 blocked for more than 368 seconds.
[ 4548.161943][ T44] Not tainted 6.18.0-rc1-virtme #1
[ 4548.162163][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4548.162573][ T44] task:modprobe state:D stack:25352 pid:32175 tgid:32175 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4548.163056][ T44] Call Trace:
[ 4548.163222][ T44]
[ 4548.163340][ T44] __schedule+0x880/0x1b10
[ 4548.163614][ T44] ? io_schedule_timeout+0x150/0x150
[ 4548.163849][ T44] ? schedule+0x1ee/0x270
[ 4548.164012][ T44] ? __lock_release+0x5d/0x170
[ 4548.164247][ T44] schedule+0xe2/0x270
[ 4548.164424][ T44] schedule_preempt_disabled+0x18/0x30
[ 4548.164650][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 4548.164871][ T44] ? __lock_acquire+0x449/0x7e0
[ 4548.165087][ T44] ? down_read+0x4a0/0x4a0
[ 4548.165313][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.165556][ T44] ? lock_acquire+0x104/0x160
[ 4548.165780][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4548.166006][ T44] down_write+0x1d6/0x200
[ 4548.166170][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 4548.166448][ T44] ? find_held_lock+0x2b/0x80
[ 4548.166701][ T44] ? __create_object+0x5e/0xb0
[ 4548.166924][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4548.167194][ T44] register_pernet_subsys+0x1a/0x40
[ 4548.167427][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4548.167657][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4548.167925][ T44] do_one_initcall+0x8c/0x1d0
[ 4548.168143][ T44] ? trace_initcall_start+0x130/0x130
[ 4548.168362][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.168610][ T44] ? trace_kmalloc+0x26/0xd0
[ 4548.168827][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4548.169043][ T44] ? debug_objects_oom+0x160/0x160
[ 4548.169269][ T44] ? kasan_unpoison+0x27/0x50
[ 4548.169512][ T44] ? __asan_register_globals+0x5d/0x70
[ 4548.169733][ T44] do_init_module+0x27a/0x860
[ 4548.169959][ T44] ? free_module+0x2f0/0x2f0
[ 4548.170175][ T44] ? kfree+0x21d/0x540
[ 4548.170338][ T44] ? load_module+0x20c5/0x2dd0
[ 4548.170574][ T44] load_module+0x1f40/0x2dd0
[ 4548.170810][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4548.171081][ T44] ? kernel_read_file+0x3ed/0x550
[ 4548.171303][ T44] ? kernel_read_file+0x3c8/0x550
[ 4548.171539][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4548.171764][ T44] ? init_module_from_file+0xe9/0x150
[ 4548.171981][ T44] init_module_from_file+0xe9/0x150
[ 4548.172197][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4548.172448][ T44] ? idempotent_init_module+0x316/0x610
[ 4548.172667][ T44] ? __lock_release+0x5d/0x170
[ 4548.172887][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4548.173106][ T44] idempotent_init_module+0x331/0x610
[ 4548.173325][ T44] ? init_module_from_file+0x150/0x150
[ 4548.173570][ T44] ? cap_capable+0x94/0x230
[ 4548.173794][ T44] __x64_sys_finit_module+0xca/0x150
[ 4548.174015][ T44] ? do_syscall_64+0x85/0xfd0
[ 4548.174234][ T44] do_syscall_64+0xc1/0xfd0
[ 4548.174462][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4548.174757][ T44] RIP: 0033:0x7f114e11f92d
[ 4548.174983][ T44] RSP: 002b:00007ffc2508d258 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4548.175312][ T44] RAX: ffffffffffffffda RBX: 000055d922aa4ac0 RCX: 00007f114e11f92d
[ 4548.175662][ T44] RDX: 0000000000000000 RSI: 000055d8ff660a2a RDI: 0000000000000005
[ 4548.175988][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2508d390
[ 4548.176313][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055d8ff660a2a
[ 4548.176655][ T44] R13: 000055d922aa4b60 R14: 000055d922aa4da0 R15: 0000000000000000
[ 4548.177006][ T44]
[ 4548.177185][ T44] INFO: task modprobe:32175 blocked on an rw-semaphore likely owned by task kworker/u16:1:70
[ 4548.177663][ T44] task:kworker/u16:1 state:R running task stack:26320 pid:70 tgid:70 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4548.178198][ T44] Workqueue: netns cleanup_net
[ 4548.178426][ T44] Call Trace:
[ 4548.178636][ T44]
[ 4548.178747][ T44] ? __mutex_lock+0x19f/0x1190
[ 4548.178969][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4548.179189][ T44] ? __schedule+0x153/0x1b10
[ 4548.179418][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4548.179711][ T44] ? ww_mutex_lock+0x160/0x160
[ 4548.179948][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4548.180246][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4548.180540][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4548.180880][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4548.181213][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4548.181561][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4548.181852][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4548.182132][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4548.182353][ T44] ? ops_undo_list+0x2bf/0x890
[ 4548.182594][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4548.182813][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4548.183038][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4548.183258][ T44] ? net_passive_dec+0x190/0x190
[ 4548.183497][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.183722][ T44] ? process_one_work+0xe35/0x1650
[ 4548.183950][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4548.184175][ T44] ? assign_work+0x168/0x240
[ 4548.184394][ T44] ? worker_thread+0x591/0xcf0
[ 4548.184636][ T44] ? rescuer_thread+0xd10/0xd10
[ 4548.184857][ T44] ? kthread+0x37b/0x5f0
[ 4548.185024][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.185244][ T44] ? ret_from_fork+0x1b/0x270
[ 4548.185469][ T44] ? __lock_release+0x5d/0x170
[ 4548.185694][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.185910][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.186134][ T44] ? ret_from_fork+0x1db/0x270
[ 4548.186349][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.186583][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4548.186818][ T44]
[ 4548.186996][ T44]
[ 4548.186996][ T44] Showing all locks held in the system:
[ 4548.187322][ T44] 1 lock held by khungtaskd/44:
[ 4548.187681][ T44] #0: ffffffffa3f88240 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4548.188059][ T44] 4 locks held by kworker/u16:1/70:
[ 4548.188279][ T44] 1 lock held by modprobe/32175:
[ 4548.188508][ T44] #0: ffffffffa467f890 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4548.188947][ T44]
[ 4548.189052][ T44] =============================================
[ 4548.189052][ T44]
[ 4671.041476][ T44] INFO: task modprobe:32175 blocked for more than 491 seconds.
[ 4671.041941][ T44] Not tainted 6.18.0-rc1-virtme #1
[ 4671.042155][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4671.042566][ T44] task:modprobe state:D stack:25352 pid:32175 tgid:32175 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4671.043052][ T44] Call Trace:
[ 4671.043215][ T44]
[ 4671.043333][ T44] __schedule+0x880/0x1b10
[ 4671.043611][ T44] ? io_schedule_timeout+0x150/0x150
[ 4671.043844][ T44] ? schedule+0x1ee/0x270
[ 4671.044018][ T44] ? __lock_release+0x5d/0x170
[ 4671.044242][ T44] schedule+0xe2/0x270
[ 4671.044423][ T44] schedule_preempt_disabled+0x18/0x30
[ 4671.044649][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 4671.044871][ T44] ? __lock_acquire+0x449/0x7e0
[ 4671.045088][ T44] ? down_read+0x4a0/0x4a0
[ 4671.045315][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.045553][ T44] ? lock_acquire+0x104/0x160
[ 4671.045776][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4671.046003][ T44] down_write+0x1d6/0x200
[ 4671.046168][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 4671.046446][ T44] ? find_held_lock+0x2b/0x80
[ 4671.046668][ T44] ? __create_object+0x5e/0xb0
[ 4671.046890][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4671.047164][ T44] register_pernet_subsys+0x1a/0x40
[ 4671.047388][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4671.047665][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4671.047946][ T44] do_one_initcall+0x8c/0x1d0
[ 4671.048164][ T44] ? trace_initcall_start+0x130/0x130
[ 4671.048380][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.048616][ T44] ? trace_kmalloc+0x26/0xd0
[ 4671.048834][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4671.049056][ T44] ? debug_objects_oom+0x160/0x160
[ 4671.049276][ T44] ? kasan_unpoison+0x27/0x50
[ 4671.049513][ T44] ? __asan_register_globals+0x5d/0x70
[ 4671.049734][ T44] do_init_module+0x27a/0x860
[ 4671.049961][ T44] ? free_module+0x2f0/0x2f0
[ 4671.050178][ T44] ? kfree+0x21d/0x540
[ 4671.050341][ T44] ? load_module+0x20c5/0x2dd0
[ 4671.050577][ T44] load_module+0x1f40/0x2dd0
[ 4671.050812][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4671.051083][ T44] ? kernel_read_file+0x3ed/0x550
[ 4671.051304][ T44] ? kernel_read_file+0x3c8/0x550
[ 4671.051553][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4671.051780][ T44] ? init_module_from_file+0xe9/0x150
[ 4671.051999][ T44] init_module_from_file+0xe9/0x150
[ 4671.052216][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4671.052463][ T44] ? idempotent_init_module+0x316/0x610
[ 4671.052686][ T44] ? __lock_release+0x5d/0x170
[ 4671.052908][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4671.053127][ T44] idempotent_init_module+0x331/0x610
[ 4671.053348][ T44] ? init_module_from_file+0x150/0x150
[ 4671.053591][ T44] ? cap_capable+0x94/0x230
[ 4671.053818][ T44] __x64_sys_finit_module+0xca/0x150
[ 4671.054041][ T44] ? do_syscall_64+0x85/0xfd0
[ 4671.054263][ T44] do_syscall_64+0xc1/0xfd0
[ 4671.054492][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4671.054764][ T44] RIP: 0033:0x7f114e11f92d
[ 4671.054993][ T44] RSP: 002b:00007ffc2508d258 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4671.055322][ T44] RAX: ffffffffffffffda RBX: 000055d922aa4ac0 RCX: 00007f114e11f92d
[ 4671.055684][ T44] RDX: 0000000000000000 RSI: 000055d8ff660a2a RDI: 0000000000000005
[ 4671.056011][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2508d390
[ 4671.056336][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055d8ff660a2a
[ 4671.056673][ T44] R13: 000055d922aa4b60 R14: 000055d922aa4da0 R15: 0000000000000000
[ 4671.057029][ T44]
[ 4671.057208][ T44] INFO: task modprobe:32175 blocked on an rw-semaphore likely owned by task kworker/u16:1:70
[ 4671.057688][ T44] task:kworker/u16:1 state:R running task stack:26320 pid:70 tgid:70 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4671.058233][ T44] Workqueue: netns cleanup_net
[ 4671.058470][ T44] Call Trace:
[ 4671.058641][ T44]
[ 4671.058757][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 4671.058981][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 4671.059198][ T44] ? find_held_lock+0x2b/0x80
[ 4671.059443][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.059670][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.059887][ T44] ? trace_contention_end+0xd8/0x140
[ 4671.060108][ T44] ? __mutex_lock+0x19f/0x1190
[ 4671.060337][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4671.060570][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4671.060861][ T44] ? ww_mutex_lock+0x160/0x160
[ 4671.061096][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4671.061375][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4671.061667][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4671.062008][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4671.062344][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4671.062695][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4671.062979][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4671.063256][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4671.063511][ T44] ? ops_undo_list+0x2bf/0x890
[ 4671.063739][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4671.063956][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4671.064182][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4671.064409][ T44] ? net_passive_dec+0x190/0x190
[ 4671.064639][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.064859][ T44] ? process_one_work+0xe35/0x1650
[ 4671.065095][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4671.065320][ T44] ? assign_work+0x168/0x240
[ 4671.065556][ T44] ? worker_thread+0x591/0xcf0
[ 4671.065785][ T44] ? rescuer_thread+0xd10/0xd10
[ 4671.066003][ T44] ? kthread+0x37b/0x5f0
[ 4671.066170][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.066385][ T44] ? ret_from_fork+0x1b/0x270
[ 4671.066615][ T44] ? __lock_release+0x5d/0x170
[ 4671.066840][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.067058][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.067275][ T44] ? ret_from_fork+0x1db/0x270
[ 4671.067518][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.067752][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4671.067984][ T44]
[ 4671.068177][ T44]
[ 4671.068177][ T44] Showing all locks held in the system:
[ 4671.068769][ T44] 1 lock held by khungtaskd/44:
[ 4671.069000][ T44] #0: ffffffffa3f88240 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4671.069376][ T44] 4 locks held by kworker/u16:1/70:
[ 4671.069613][ T44] 1 lock held by modprobe/32175:
[ 4671.069820][ T44] #0: ffffffffa467f890 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4671.070245][ T44]
[ 4671.070349][ T44] =============================================
[ 4671.070349][ T44]
[ 4793.921486][ T44] INFO: task modprobe:32175 blocked for more than 614 seconds.
[ 4793.921938][ T44] Not tainted 6.18.0-rc1-virtme #1
[ 4793.922146][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4793.922536][ T44] task:modprobe state:D stack:25352 pid:32175 tgid:32175 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4793.923025][ T44] Call Trace:
[ 4793.923191][ T44]
[ 4793.923309][ T44] __schedule+0x880/0x1b10
[ 4793.923589][ T44] ? io_schedule_timeout+0x150/0x150
[ 4793.923835][ T44] ? schedule+0x1ee/0x270
[ 4793.923997][ T44] ? __lock_release+0x5d/0x170
[ 4793.924222][ T44] schedule+0xe2/0x270
[ 4793.924390][ T44] schedule_preempt_disabled+0x18/0x30
[ 4793.924620][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 4793.924842][ T44] ? __lock_acquire+0x449/0x7e0
[ 4793.925064][ T44] ? down_read+0x4a0/0x4a0
[ 4793.925290][ T44] ? rcu_is_watching+0x12/0xb0
[ 4793.925524][ T44] ? lock_acquire+0x104/0x160
[ 4793.925742][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4793.925966][ T44] down_write+0x1d6/0x200
[ 4793.926132][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 4793.926408][ T44] ? find_held_lock+0x2b/0x80
[ 4793.926629][ T44] ? __create_object+0x5e/0xb0
[ 4793.926860][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4793.927139][ T44] register_pernet_subsys+0x1a/0x40
[ 4793.927358][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4793.927605][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4793.927875][ T44] do_one_initcall+0x8c/0x1d0
[ 4793.928094][ T44] ? trace_initcall_start+0x130/0x130
[ 4793.928310][ T44] ? rcu_is_watching+0x12/0xb0
[ 4793.928534][ T44] ? trace_kmalloc+0x26/0xd0
[ 4793.928759][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4793.928976][ T44] ? debug_objects_oom+0x160/0x160
[ 4793.929195][ T44] ? kasan_unpoison+0x27/0x50
[ 4793.929420][ T44] ? __asan_register_globals+0x5d/0x70
[ 4793.929641][ T44] do_init_module+0x27a/0x860
[ 4793.929866][ T44] ? free_module+0x2f0/0x2f0
[ 4793.930081][ T44] ? kfree+0x21d/0x540
[ 4793.930243][ T44] ? load_module+0x20c5/0x2dd0
[ 4793.930476][ T44] load_module+0x1f40/0x2dd0
[ 4793.930704][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4793.930973][ T44] ? kernel_read_file+0x3ed/0x550
[ 4793.931194][ T44] ? kernel_read_file+0x3c8/0x550
[ 4793.931435][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4793.931661][ T44] ? init_module_from_file+0xe9/0x150
[ 4793.931949][ T44] init_module_from_file+0xe9/0x150
[ 4793.932327][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4793.932701][ T44] ? idempotent_init_module+0x316/0x610
[ 4793.932921][ T44] ? __lock_release+0x5d/0x170
[ 4793.933143][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4793.933363][ T44] idempotent_init_module+0x331/0x610
[ 4793.933590][ T44] ? init_module_from_file+0x150/0x150
[ 4793.933828][ T44] ? cap_capable+0x94/0x230
[ 4793.934055][ T44] __x64_sys_finit_module+0xca/0x150
[ 4793.934271][ T44] ? do_syscall_64+0x85/0xfd0
[ 4793.934501][ T44] do_syscall_64+0xc1/0xfd0
[ 4793.934721][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4793.934994][ T44] RIP: 0033:0x7f114e11f92d
[ 4793.935222][ T44] RSP: 002b:00007ffc2508d258 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4793.935585][ T44] RAX: ffffffffffffffda RBX: 000055d922aa4ac0 RCX: 00007f114e11f92d
[ 4793.935913][ T44] RDX: 0000000000000000 RSI: 000055d8ff660a2a RDI: 0000000000000005
[ 4793.936237][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2508d390
[ 4793.936569][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055d8ff660a2a
[ 4793.936910][ T44] R13: 000055d922aa4b60 R14: 000055d922aa4da0 R15: 0000000000000000
[ 4793.937253][ T44]
[ 4793.937435][ T44] INFO: task modprobe:32175 blocked on an rw-semaphore likely owned by task kworker/u16:1:70
[ 4793.937898][ T44] task:kworker/u16:1 state:R running task stack:26320 pid:70 tgid:70 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4793.938445][ T44] Workqueue: netns cleanup_net
[ 4793.938669][ T44] Call Trace:
[ 4793.938833][ T44]
[ 4793.938943][ T44] ? __mutex_lock+0x19f/0x1190
[ 4793.939164][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4793.939384][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4793.939694][ T44] ? ww_mutex_lock+0x160/0x160
[ 4793.939929][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4793.940212][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4793.940497][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4793.940833][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4793.941163][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4793.941503][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4793.941795][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4793.942071][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4793.942290][ T44] ? ops_undo_list+0x2bf/0x890
[ 4793.942520][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4793.942736][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4793.942962][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4793.943180][ T44] ? net_passive_dec+0x190/0x190
[ 4793.943425][ T44] ? rcu_is_watching+0x12/0xb0
[ 4793.943648][ T44] ? process_one_work+0xe35/0x1650
[ 4793.943875][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4793.944099][ T44] ? assign_work+0x168/0x240
[ 4793.944319][ T44] ? worker_thread+0x591/0xcf0
[ 4793.944551][ T44] ? rescuer_thread+0xd10/0xd10
[ 4793.944769][ T44] ? kthread+0x37b/0x5f0
[ 4793.944944][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4793.945159][ T44] ? ret_from_fork+0x1b/0x270
[ 4793.945375][ T44] ? __lock_release+0x5d/0x170
[ 4793.945600][ T44] ? rcu_is_watching+0x12/0xb0
[ 4793.945817][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4793.946034][ T44] ? ret_from_fork+0x1db/0x270
[ 4793.946249][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4793.946473][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4793.946705][ T44]
[ 4793.946911][ T44]
[ 4793.946911][ T44] Showing all locks held in the system:
[ 4793.947227][ T44] 1 lock held by khungtaskd/44:
[ 4793.947717][ T44] #0: ffffffffa3f88240 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4793.948094][ T44] 4 locks held by kworker/u16:1/70:
[ 4793.948311][ T44] 1 lock held by modprobe/32175:
[ 4793.948521][ T44] #0: ffffffffa467f890 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4793.948950][ T44]
[ 4793.949056][ T44] =============================================
[ 4793.949056][ T44]
[ 4916.801492][ T44] INFO: task modprobe:32175 blocked for more than 737 seconds.
[ 4916.801923][ T44] Not tainted 6.18.0-rc1-virtme #1
[ 4916.802153][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4916.802576][ T44] task:modprobe state:D stack:25352 pid:32175 tgid:32175 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4916.803104][ T44] Call Trace:
[ 4916.803281][ T44]
[ 4916.803420][ T44] __schedule+0x880/0x1b10
[ 4916.803699][ T44] ? io_schedule_timeout+0x150/0x150
[ 4916.803948][ T44] ? schedule+0x1ee/0x270
[ 4916.804123][ T44] ? __lock_release+0x5d/0x170
[ 4916.804364][ T44] schedule+0xe2/0x270
[ 4916.804583][ T44] schedule_preempt_disabled+0x18/0x30
[ 4916.804832][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 4916.805067][ T44] ? __lock_acquire+0x449/0x7e0
[ 4916.805299][ T44] ? down_read+0x4a0/0x4a0
[ 4916.805561][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.805796][ T44] ? lock_acquire+0x104/0x160
[ 4916.806036][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4916.806280][ T44] down_write+0x1d6/0x200
[ 4916.806474][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 4916.806771][ T44] ? find_held_lock+0x2b/0x80
[ 4916.807003][ T44] ? __create_object+0x5e/0xb0
[ 4916.807238][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4916.807557][ T44] register_pernet_subsys+0x1a/0x40
[ 4916.807795][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4916.808033][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4916.808320][ T44] do_one_initcall+0x8c/0x1d0
[ 4916.808579][ T44] ? trace_initcall_start+0x130/0x130
[ 4916.808812][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.809047][ T44] ? trace_kmalloc+0x26/0xd0
[ 4916.809284][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4916.809535][ T44] ? debug_objects_oom+0x160/0x160
[ 4916.809771][ T44] ? kasan_unpoison+0x27/0x50
[ 4916.810008][ T44] ? __asan_register_globals+0x5d/0x70
[ 4916.810251][ T44] do_init_module+0x27a/0x860
[ 4916.810510][ T44] ? free_module+0x2f0/0x2f0
[ 4916.810744][ T44] ? kfree+0x21d/0x540
[ 4916.810918][ T44] ? load_module+0x20c5/0x2dd0
[ 4916.811159][ T44] load_module+0x1f40/0x2dd0
[ 4916.811412][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4916.811722][ T44] ? kernel_read_file+0x3ed/0x550
[ 4916.811960][ T44] ? kernel_read_file+0x3c8/0x550
[ 4916.812201][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4916.812460][ T44] ? init_module_from_file+0xe9/0x150
[ 4916.812693][ T44] init_module_from_file+0xe9/0x150
[ 4916.812924][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4916.813177][ T44] ? idempotent_init_module+0x316/0x610
[ 4916.813414][ T44] ? __lock_release+0x5d/0x170
[ 4916.813665][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4916.813899][ T44] idempotent_init_module+0x331/0x610
[ 4916.814135][ T44] ? init_module_from_file+0x150/0x150
[ 4916.814379][ T44] ? cap_capable+0x94/0x230
[ 4916.814634][ T44] __x64_sys_finit_module+0xca/0x150
[ 4916.814865][ T44] ? do_syscall_64+0x85/0xfd0
[ 4916.815099][ T44] do_syscall_64+0xc1/0xfd0
[ 4916.815336][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4916.815641][ T44] RIP: 0033:0x7f114e11f92d
[ 4916.815884][ T44] RSP: 002b:00007ffc2508d258 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4916.816244][ T44] RAX: ffffffffffffffda RBX: 000055d922aa4ac0 RCX: 00007f114e11f92d
[ 4916.816609][ T44] RDX: 0000000000000000 RSI: 000055d8ff660a2a RDI: 0000000000000005
[ 4916.816965][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2508d390
[ 4916.817313][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055d8ff660a2a
[ 4916.817679][ T44] R13: 000055d922aa4b60 R14: 000055d922aa4da0 R15: 0000000000000000
[ 4916.818043][ T44]
[ 4916.818232][ T44] INFO: task modprobe:32175 blocked on an rw-semaphore likely owned by task kworker/u16:1:70
[ 4916.818755][ T44] task:kworker/u16:1 state:R running task stack:26320 pid:70 tgid:70 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4916.819325][ T44] Workqueue: netns cleanup_net
[ 4916.819576][ T44] Call Trace:
[ 4916.819752][ T44]
[ 4916.819875][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 4916.820112][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 4916.820352][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.820604][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.820837][ T44] ? trace_contention_end+0xd8/0x140
[ 4916.821071][ T44] ? __mutex_lock+0x19f/0x1190
[ 4916.821305][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4916.821556][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4916.821859][ T44] ? ww_mutex_lock+0x160/0x160
[ 4916.822116][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4916.822422][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4916.822731][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4916.823088][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4916.823456][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4916.823820][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4916.824125][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4916.824433][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4916.824674][ T44] ? ops_undo_list+0x2bf/0x890
[ 4916.824914][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4916.825142][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4916.825388][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4916.825635][ T44] ? net_passive_dec+0x190/0x190
[ 4916.825871][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.826114][ T44] ? process_one_work+0xe35/0x1650
[ 4916.826357][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4916.826615][ T44] ? assign_work+0x168/0x240
[ 4916.826851][ T44] ? worker_thread+0x591/0xcf0
[ 4916.827090][ T44] ? rescuer_thread+0xd10/0xd10
[ 4916.827328][ T44] ? kthread+0x37b/0x5f0
[ 4916.827518][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.827748][ T44] ? ret_from_fork+0x1b/0x270
[ 4916.827977][ T44] ? __lock_release+0x5d/0x170
[ 4916.828207][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.828453][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.828690][ T44] ? ret_from_fork+0x1db/0x270
[ 4916.828918][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.829159][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4916.829412][ T44]
[ 4916.829624][ T44]
[ 4916.829624][ T44] Showing all locks held in the system:
[ 4916.829960][ T44] 1 lock held by khungtaskd/44:
[ 4916.830182][ T44] #0: ffffffffa3f88240 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4916.830741][ T44] 4 locks held by kworker/u16:1/70:
[ 4916.830979][ T44] 1 lock held by modprobe/32175:
[ 4916.831205][ T44] #0: ffffffffa467f890 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4916.831675][ T44]
[ 4916.831789][ T44] =============================================
[ 4916.831789][ T44]
[ 5039.681475][ T44] INFO: task modprobe:32175 blocked for more than 860 seconds.
[ 5039.681893][ T44] Not tainted 6.18.0-rc1-virtme #1
[ 5039.682116][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5039.682531][ T44] task:modprobe state:D stack:25352 pid:32175 tgid:32175 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5039.683074][ T44] Call Trace:
[ 5039.683256][ T44]
[ 5039.683381][ T44] __schedule+0x880/0x1b10
[ 5039.683667][ T44] ? io_schedule_timeout+0x150/0x150
[ 5039.683925][ T44] ? schedule+0x1ee/0x270
[ 5039.684103][ T44] ? __lock_release+0x5d/0x170
[ 5039.684354][ T44] schedule+0xe2/0x270
[ 5039.684541][ T44] schedule_preempt_disabled+0x18/0x30
[ 5039.684774][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 5039.685007][ T44] ? __lock_acquire+0x449/0x7e0
[ 5039.685249][ T44] ? down_read+0x4a0/0x4a0
[ 5039.685497][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.685732][ T44] ? lock_acquire+0x104/0x160
[ 5039.685961][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5039.686213][ T44] down_write+0x1d6/0x200
[ 5039.686391][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 5039.686689][ T44] ? find_held_lock+0x2b/0x80
[ 5039.686927][ T44] ? __create_object+0x5e/0xb0
[ 5039.687164][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5039.687467][ T44] register_pernet_subsys+0x1a/0x40
[ 5039.687701][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5039.687946][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5039.688234][ T44] do_one_initcall+0x8c/0x1d0
[ 5039.688476][ T44] ? trace_initcall_start+0x130/0x130
[ 5039.688710][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.688941][ T44] ? trace_kmalloc+0x26/0xd0
[ 5039.689173][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5039.689413][ T44] ? debug_objects_oom+0x160/0x160
[ 5039.689656][ T44] ? kasan_unpoison+0x27/0x50
[ 5039.689892][ T44] ? __asan_register_globals+0x5d/0x70
[ 5039.690127][ T44] do_init_module+0x27a/0x860
[ 5039.690368][ T44] ? free_module+0x2f0/0x2f0
[ 5039.690607][ T44] ? kfree+0x21d/0x540
[ 5039.690784][ T44] ? load_module+0x20c5/0x2dd0
[ 5039.691022][ T44] load_module+0x1f40/0x2dd0
[ 5039.691265][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5039.691572][ T44] ? kernel_read_file+0x3ed/0x550
[ 5039.691810][ T44] ? kernel_read_file+0x3c8/0x550
[ 5039.692046][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5039.692287][ T44] ? init_module_from_file+0xe9/0x150
[ 5039.692526][ T44] init_module_from_file+0xe9/0x150
[ 5039.692760][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5039.693008][ T44] ? idempotent_init_module+0x316/0x610
[ 5039.693244][ T44] ? __lock_release+0x5d/0x170
[ 5039.693485][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5039.693718][ T44] idempotent_init_module+0x331/0x610
[ 5039.693951][ T44] ? init_module_from_file+0x150/0x150
[ 5039.694196][ T44] ? cap_capable+0x94/0x230
[ 5039.694440][ T44] __x64_sys_finit_module+0xca/0x150
[ 5039.694679][ T44] ? do_syscall_64+0x85/0xfd0
[ 5039.694917][ T44] do_syscall_64+0xc1/0xfd0
[ 5039.695158][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5039.695454][ T44] RIP: 0033:0x7f114e11f92d
[ 5039.695694][ T44] RSP: 002b:00007ffc2508d258 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5039.696046][ T44] RAX: ffffffffffffffda RBX: 000055d922aa4ac0 RCX: 00007f114e11f92d
[ 5039.696407][ T44] RDX: 0000000000000000 RSI: 000055d8ff660a2a RDI: 0000000000000005
[ 5039.696754][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2508d390
[ 5039.697101][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055d8ff660a2a
[ 5039.697455][ T44] R13: 000055d922aa4b60 R14: 000055d922aa4da0 R15: 0000000000000000
[ 5039.697817][ T44]
[ 5039.698010][ T44] INFO: task modprobe:32175 blocked on an rw-semaphore likely owned by task kworker/u16:1:70
[ 5039.698511][ T44] task:kworker/u16:1 state:R running task stack:26320 pid:70 tgid:70 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5039.699081][ T44] Workqueue: netns cleanup_net
[ 5039.699314][ T44] Call Trace:
[ 5039.699496][ T44]
[ 5039.699627][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5039.699864][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5039.700097][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.700331][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.700570][ T44] ? trace_contention_end+0xd8/0x140
[ 5039.700802][ T44] ? __mutex_lock+0x19f/0x1190
[ 5039.701034][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5039.701276][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5039.701587][ T44] ? ww_mutex_lock+0x160/0x160
[ 5039.701837][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5039.702131][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5039.702433][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5039.702789][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5039.703147][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5039.703512][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5039.703815][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5039.704109][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5039.704345][ T44] ? ops_undo_list+0x2bf/0x890
[ 5039.704590][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5039.704825][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5039.705064][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5039.705306][ T44] ? net_passive_dec+0x190/0x190
[ 5039.705548][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.705786][ T44] ? process_one_work+0xe35/0x1650
[ 5039.706029][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5039.706268][ T44] ? assign_work+0x168/0x240
[ 5039.706515][ T44] ? worker_thread+0x591/0xcf0
[ 5039.706757][ T44] ? rescuer_thread+0xd10/0xd10
[ 5039.706990][ T44] ? kthread+0x37b/0x5f0
[ 5039.707167][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.707397][ T44] ? ret_from_fork+0x1b/0x270
[ 5039.707639][ T44] ? __lock_release+0x5d/0x170
[ 5039.707871][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.708103][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.708343][ T44] ? ret_from_fork+0x1db/0x270
[ 5039.708581][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.708814][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5039.709058][ T44]
[ 5039.709259][ T44]
[ 5039.709259][ T44] Showing all locks held in the system:
[ 5039.709736][ T44] 1 lock held by khungtaskd/44:
[ 5039.709959][ T44] #0: ffffffffa3f88240 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5039.710380][ T44] 4 locks held by kworker/u16:1/70:
[ 5039.710621][ T44] 1 lock held by modprobe/32175:
[ 5039.710843][ T44] #0: ffffffffa467f890 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5039.711299][ T44]
[ 5039.711418][ T44] =============================================
[ 5039.711418][ T44]
[ 5162.561459][ T44] INFO: task modprobe:32175 blocked for more than 983 seconds.
[ 5162.561819][ T44] Not tainted 6.18.0-rc1-virtme #1
[ 5162.562033][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5162.562382][ T44] task:modprobe state:D stack:25352 pid:32175 tgid:32175 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5162.562909][ T44] Call Trace:
[ 5162.563074][ T44]
[ 5162.563191][ T44] __schedule+0x880/0x1b10
[ 5162.563436][ T44] ? io_schedule_timeout+0x150/0x150
[ 5162.563668][ T44] ? schedule+0x1ee/0x270
[ 5162.563831][ T44] ? __lock_release+0x5d/0x170
[ 5162.564055][ T44] schedule+0xe2/0x270
[ 5162.564225][ T44] schedule_preempt_disabled+0x18/0x30
[ 5162.564475][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 5162.564697][ T44] ? __lock_acquire+0x449/0x7e0
[ 5162.564919][ T44] ? down_read+0x4a0/0x4a0
[ 5162.565144][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.565362][ T44] ? lock_acquire+0x104/0x160
[ 5162.565585][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5162.565811][ T44] down_write+0x1d6/0x200
[ 5162.565976][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 5162.566245][ T44] ? find_held_lock+0x2b/0x80
[ 5162.566475][ T44] ? __create_object+0x5e/0xb0
[ 5162.566700][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5162.566970][ T44] register_pernet_subsys+0x1a/0x40
[ 5162.567189][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5162.567419][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5162.567687][ T44] do_one_initcall+0x8c/0x1d0
[ 5162.567907][ T44] ? trace_initcall_start+0x130/0x130
[ 5162.568123][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.568342][ T44] ? trace_kmalloc+0x26/0xd0
[ 5162.568584][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5162.568802][ T44] ? debug_objects_oom+0x160/0x160
[ 5162.569020][ T44] ? kasan_unpoison+0x27/0x50
[ 5162.569238][ T44] ? __asan_register_globals+0x5d/0x70
[ 5162.569466][ T44] do_init_module+0x27a/0x860
[ 5162.569691][ T44] ? free_module+0x2f0/0x2f0
[ 5162.569909][ T44] ? kfree+0x21d/0x540
[ 5162.570073][ T44] ? load_module+0x20c5/0x2dd0
[ 5162.570295][ T44] load_module+0x1f40/0x2dd0
[ 5162.570531][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5162.570803][ T44] ? kernel_read_file+0x3ed/0x550
[ 5162.571023][ T44] ? kernel_read_file+0x3c8/0x550
[ 5162.571243][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5162.571474][ T44] ? init_module_from_file+0xe9/0x150
[ 5162.571696][ T44] init_module_from_file+0xe9/0x150
[ 5162.571912][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5162.572145][ T44] ? idempotent_init_module+0x316/0x610
[ 5162.572360][ T44] ? __lock_release+0x5d/0x170
[ 5162.572601][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5162.572822][ T44] idempotent_init_module+0x331/0x610
[ 5162.573045][ T44] ? init_module_from_file+0x150/0x150
[ 5162.573274][ T44] ? cap_capable+0x94/0x230
[ 5162.573505][ T44] __x64_sys_finit_module+0xca/0x150
[ 5162.573722][ T44] ? do_syscall_64+0x85/0xfd0
[ 5162.573940][ T44] do_syscall_64+0xc1/0xfd0
[ 5162.574158][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5162.574442][ T44] RIP: 0033:0x7f114e11f92d
[ 5162.574671][ T44] RSP: 002b:00007ffc2508d258 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5162.574999][ T44] RAX: ffffffffffffffda RBX: 000055d922aa4ac0 RCX: 00007f114e11f92d
[ 5162.575324][ T44] RDX: 0000000000000000 RSI: 000055d8ff660a2a RDI: 0000000000000005
[ 5162.575657][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2508d390
[ 5162.575982][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055d8ff660a2a
[ 5162.576310][ T44] R13: 000055d922aa4b60 R14: 000055d922aa4da0 R15: 0000000000000000
[ 5162.576669][ T44]
[ 5162.576847][ T44] INFO: task modprobe:32175 blocked on an rw-semaphore likely owned by task kworker/u16:1:70
[ 5162.577307][ T44] task:kworker/u16:1 state:R running task stack:26320 pid:70 tgid:70 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5162.577849][ T44] Workqueue: netns cleanup_net
[ 5162.578070][ T44] Call Trace:
[ 5162.578231][ T44]
[ 5162.578343][ T44] ? __mutex_lock+0x19f/0x1190
[ 5162.578570][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5162.578791][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5162.579077][ T44] ? ww_mutex_lock+0x160/0x160
[ 5162.579314][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5162.579600][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5162.579878][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5162.580214][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5162.580568][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5162.580908][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5162.581191][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5162.581474][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5162.581695][ T44] ? ops_undo_list+0x2bf/0x890
[ 5162.581916][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5162.582132][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5162.582360][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5162.582584][ T44] ? net_passive_dec+0x190/0x190
[ 5162.582805][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.583025][ T44] ? process_one_work+0xe35/0x1650
[ 5162.583260][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5162.583489][ T44] ? assign_work+0x168/0x240
[ 5162.583711][ T44] ? worker_thread+0x591/0xcf0
[ 5162.583936][ T44] ? rescuer_thread+0xd10/0xd10
[ 5162.584159][ T44] ? kthread+0x37b/0x5f0
[ 5162.584332][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.584568][ T44] ? ret_from_fork+0x1b/0x270
[ 5162.584787][ T44] ? __lock_release+0x5d/0x170
[ 5162.585005][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.585223][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.585447][ T44] ? ret_from_fork+0x1db/0x270
[ 5162.585663][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.585882][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5162.586114][ T44]
[ 5162.586309][ T44]
[ 5162.586309][ T44] Showing all locks held in the system:
[ 5162.587022][ T44] 1 lock held by khungtaskd/44:
[ 5162.587232][ T44] #0: ffffffffa3f88240 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5162.587612][ T44] 4 locks held by kworker/u16:1/70:
[ 5162.587832][ T44] 1 lock held by modprobe/32175:
[ 5162.588038][ T44] #0: ffffffffa467f890 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5162.588474][ T44]
[ 5162.588578][ T44] =============================================
[ 5162.588578][ T44]
[ 5285.441455][ T44] INFO: task modprobe:32175 blocked for more than 1105 seconds.
[ 5285.441876][ T44] Not tainted 6.18.0-rc1-virtme #1
[ 5285.442079][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5285.442452][ T44] task:modprobe state:D stack:25352 pid:32175 tgid:32175 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5285.442932][ T44] Call Trace:
[ 5285.443097][ T44]
[ 5285.443213][ T44] __schedule+0x880/0x1b10
[ 5285.443469][ T44] ? io_schedule_timeout+0x150/0x150
[ 5285.443699][ T44] ? schedule+0x1ee/0x270
[ 5285.443861][ T44] ? __lock_release+0x5d/0x170
[ 5285.444086][ T44] schedule+0xe2/0x270
[ 5285.444251][ T44] schedule_preempt_disabled+0x18/0x30
[ 5285.444494][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 5285.444719][ T44] ? __lock_acquire+0x449/0x7e0
[ 5285.444935][ T44] ? down_read+0x4a0/0x4a0
[ 5285.445166][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.445383][ T44] ? lock_acquire+0x104/0x160
[ 5285.445608][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5285.445833][ T44] down_write+0x1d6/0x200
[ 5285.445999][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 5285.446265][ T44] ? find_held_lock+0x2b/0x80
[ 5285.446493][ T44] ? __create_object+0x5e/0xb0
[ 5285.446718][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5285.446988][ T44] register_pernet_subsys+0x1a/0x40
[ 5285.447206][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5285.447435][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5285.447703][ T44] do_one_initcall+0x8c/0x1d0
[ 5285.447921][ T44] ? trace_initcall_start+0x130/0x130
[ 5285.448137][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.448359][ T44] ? trace_kmalloc+0x26/0xd0
[ 5285.448597][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5285.448815][ T44] ? debug_objects_oom+0x160/0x160
[ 5285.449034][ T44] ? kasan_unpoison+0x27/0x50
[ 5285.449252][ T44] ? __asan_register_globals+0x5d/0x70
[ 5285.449476][ T44] do_init_module+0x27a/0x860
[ 5285.449703][ T44] ? free_module+0x2f0/0x2f0
[ 5285.449919][ T44] ? kfree+0x21d/0x540
[ 5285.450086][ T44] ? load_module+0x20c5/0x2dd0
[ 5285.450310][ T44] load_module+0x1f40/0x2dd0
[ 5285.450544][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5285.450815][ T44] ? kernel_read_file+0x3ed/0x550
[ 5285.451035][ T44] ? kernel_read_file+0x3c8/0x550
[ 5285.451258][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5285.451487][ T44] ? init_module_from_file+0xe9/0x150
[ 5285.451708][ T44] init_module_from_file+0xe9/0x150
[ 5285.451924][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5285.452157][ T44] ? idempotent_init_module+0x316/0x610
[ 5285.452372][ T44] ? __lock_release+0x5d/0x170
[ 5285.452615][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5285.452837][ T44] idempotent_init_module+0x331/0x610
[ 5285.453060][ T44] ? init_module_from_file+0x150/0x150
[ 5285.453294][ T44] ? cap_capable+0x94/0x230
[ 5285.453535][ T44] __x64_sys_finit_module+0xca/0x150
[ 5285.453753][ T44] ? do_syscall_64+0x85/0xfd0
[ 5285.453976][ T44] do_syscall_64+0xc1/0xfd0
[ 5285.454194][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5285.454471][ T44] RIP: 0033:0x7f114e11f92d
[ 5285.454697][ T44] RSP: 002b:00007ffc2508d258 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5285.455029][ T44] RAX: ffffffffffffffda RBX: 000055d922aa4ac0 RCX: 00007f114e11f92d
[ 5285.455354][ T44] RDX: 0000000000000000 RSI: 000055d8ff660a2a RDI: 0000000000000005
[ 5285.455687][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2508d390
[ 5285.456011][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055d8ff660a2a
[ 5285.456338][ T44] R13: 000055d922aa4b60 R14: 000055d922aa4da0 R15: 0000000000000000
[ 5285.456700][ T44]
[ 5285.456879][ T44] INFO: task modprobe:32175 blocked on an rw-semaphore likely owned by task kworker/u16:1:70
[ 5285.457339][ T44] task:kworker/u16:1 state:R running task stack:26320 pid:70 tgid:70 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5285.457924][ T44] Workqueue: netns cleanup_net
[ 5285.458160][ T44] Call Trace:
[ 5285.458332][ T44]
[ 5285.458451][ T44] ? __mutex_lock+0x19f/0x1190
[ 5285.458671][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5285.458892][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5285.459174][ T44] ? ww_mutex_lock+0x160/0x160
[ 5285.459406][ T44] ? irqentry_exit+0x3b/0x80
[ 5285.459638][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5285.459913][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5285.460188][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5285.460541][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5285.460875][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5285.461213][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5285.461503][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5285.461779][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5285.462000][ T44] ? ops_undo_list+0x2bf/0x890
[ 5285.462222][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5285.462445][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5285.462673][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5285.462892][ T44] ? net_passive_dec+0x190/0x190
[ 5285.463111][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.463332][ T44] ? process_one_work+0xe35/0x1650
[ 5285.463574][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5285.463798][ T44] ? assign_work+0x168/0x240
[ 5285.464018][ T44] ? worker_thread+0x591/0xcf0
[ 5285.464244][ T44] ? rescuer_thread+0xd10/0xd10
[ 5285.464484][ T44] ? kthread+0x37b/0x5f0
[ 5285.464651][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.464868][ T44] ? ret_from_fork+0x1b/0x270
[ 5285.465082][ T44] ? __lock_release+0x5d/0x170
[ 5285.465300][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.465522][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.465741][ T44] ? ret_from_fork+0x1db/0x270
[ 5285.465955][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.466174][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5285.466411][ T44]
[ 5285.466612][ T44]
[ 5285.466612][ T44] Showing all locks held in the system:
[ 5285.466925][ T44] 1 lock held by khungtaskd/44:
[ 5285.467134][ T44] #0: ffffffffa3f88240 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5285.467918][ T44] 4 locks held by kworker/u16:1/70:
[ 5285.468142][ T44] 1 lock held by modprobe/32175:
[ 5285.468349][ T44] #0: ffffffffa467f890 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5285.468786][ T44]
[ 5285.468891][ T44] =============================================
[ 5285.468891][ T44]
[ 5408.321633][ T44] INFO: task modprobe:32175 blocked for more than 1228 seconds.
[ 5408.322281][ T44] Not tainted 6.18.0-rc1-virtme #1
[ 5408.322513][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5408.322884][ T44] task:modprobe state:D stack:25352 pid:32175 tgid:32175 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5408.323369][ T44] Call Trace:
[ 5408.323547][ T44]
[ 5408.323669][ T44] __schedule+0x880/0x1b10
[ 5408.323900][ T44] ? io_schedule_timeout+0x150/0x150
[ 5408.324136][ T44] ? schedule+0x1ee/0x270
[ 5408.324300][ T44] ? __lock_release+0x5d/0x170
[ 5408.324551][ T44] schedule+0xe2/0x270
[ 5408.324723][ T44] schedule_preempt_disabled+0x18/0x30
[ 5408.324944][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 5408.325168][ T44] ? __lock_acquire+0x449/0x7e0
[ 5408.325387][ T44] ? down_read+0x4a0/0x4a0
[ 5408.325628][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.325847][ T44] ? lock_acquire+0x104/0x160
[ 5408.326063][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5408.326295][ T44] down_write+0x1d6/0x200
[ 5408.326473][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 5408.326752][ T44] ? find_held_lock+0x2b/0x80
[ 5408.326972][ T44] ? __create_object+0x5e/0xb0
[ 5408.327194][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5408.327474][ T44] register_pernet_subsys+0x1a/0x40
[ 5408.327692][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5408.327912][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5408.328179][ T44] do_one_initcall+0x8c/0x1d0
[ 5408.328411][ T44] ? trace_initcall_start+0x130/0x130
[ 5408.328628][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.328845][ T44] ? trace_kmalloc+0x26/0xd0
[ 5408.329061][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5408.329277][ T44] ? debug_objects_oom+0x160/0x160
[ 5408.329506][ T44] ? kasan_unpoison+0x27/0x50
[ 5408.329725][ T44] ? __asan_register_globals+0x5d/0x70
[ 5408.329949][ T44] do_init_module+0x27a/0x860
[ 5408.330173][ T44] ? free_module+0x2f0/0x2f0
[ 5408.330389][ T44] ? kfree+0x21d/0x540
[ 5408.330560][ T44] ? load_module+0x20c5/0x2dd0
[ 5408.330786][ T44] load_module+0x1f40/0x2dd0
[ 5408.331013][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5408.331283][ T44] ? kernel_read_file+0x3ed/0x550
[ 5408.331513][ T44] ? kernel_read_file+0x3c8/0x550
[ 5408.331739][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5408.331963][ T44] ? init_module_from_file+0xe9/0x150
[ 5408.332179][ T44] init_module_from_file+0xe9/0x150
[ 5408.332396][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5408.332646][ T44] ? idempotent_init_module+0x316/0x610
[ 5408.332863][ T44] ? __lock_release+0x5d/0x170
[ 5408.333082][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5408.333304][ T44] idempotent_init_module+0x331/0x610
[ 5408.333530][ T44] ? init_module_from_file+0x150/0x150
[ 5408.333759][ T44] ? cap_capable+0x94/0x230
[ 5408.333983][ T44] __x64_sys_finit_module+0xca/0x150
[ 5408.334199][ T44] ? do_syscall_64+0x85/0xfd0
[ 5408.334424][ T44] do_syscall_64+0xc1/0xfd0
[ 5408.334643][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5408.334916][ T44] RIP: 0033:0x7f114e11f92d
[ 5408.335141][ T44] RSP: 002b:00007ffc2508d258 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5408.335475][ T44] RAX: ffffffffffffffda RBX: 000055d922aa4ac0 RCX: 00007f114e11f92d
[ 5408.335801][ T44] RDX: 0000000000000000 RSI: 000055d8ff660a2a RDI: 0000000000000005
[ 5408.336125][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2508d390
[ 5408.336461][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055d8ff660a2a
[ 5408.336801][ T44] R13: 000055d922aa4b60 R14: 000055d922aa4da0 R15: 0000000000000000
[ 5408.337141][ T44]
[ 5408.337317][ T44] INFO: task modprobe:32175 blocked on an rw-semaphore likely owned by task kworker/u16:1:70
[ 5408.337785][ T44] task:kworker/u16:1 state:R running task stack:26320 pid:70 tgid:70 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5408.338317][ T44] Workqueue: netns cleanup_net
[ 5408.338543][ T44] Call Trace:
[ 5408.338707][ T44]
[ 5408.338817][ T44] ? __mutex_lock+0x19f/0x1190
[ 5408.339034][ T44] ? __schedule+0x153/0x1b10
[ 5408.339253][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5408.339547][ T44] ? ww_mutex_lock+0x160/0x160
[ 5408.339784][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5408.340060][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5408.340336][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5408.340676][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5408.341010][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5408.341342][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5408.341634][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5408.341911][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5408.342131][ T44] ? ops_undo_list+0x2bf/0x890
[ 5408.342353][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5408.342586][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5408.342812][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5408.343029][ T44] ? net_passive_dec+0x190/0x190
[ 5408.343252][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.343480][ T44] ? process_one_work+0xe35/0x1650
[ 5408.343709][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5408.343935][ T44] ? assign_work+0x168/0x240
[ 5408.344160][ T44] ? worker_thread+0x591/0xcf0
[ 5408.344386][ T44] ? rescuer_thread+0xd10/0xd10
[ 5408.344611][ T44] ? kthread+0x37b/0x5f0
[ 5408.344780][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.344995][ T44] ? ret_from_fork+0x1b/0x270
[ 5408.345210][ T44] ? __lock_release+0x5d/0x170
[ 5408.345434][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.345653][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.345873][ T44] ? ret_from_fork+0x1db/0x270
[ 5408.346091][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.346307][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5408.346546][ T44]
[ 5408.346709][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings
[ 5408.347091][ T44]
[ 5408.347091][ T44] Showing all locks held in the system:
[ 5408.347476][ T44] 1 lock held by khungtaskd/44:
[ 5408.347685][ T44] #0: ffffffffa3f88240 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5408.348064][ T44] 4 locks held by kworker/u16:1/70:
[ 5408.348283][ T44] 1 lock held by modprobe/32175:
[ 5408.348504][ T44] #0: ffffffffa467f890 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5408.348964][ T44]
[ 5408.349076][ T44] =============================================
[ 5408.349076][ T44]
WAIT TIMEOUT stderr
Ctrl-C stderr
Ctrl-C stderr