[ 4325.439357][T31234] pktgen: Packet Generator for packet performance testing. Version: 2.75
[ 4548.232287][ T44] INFO: task modprobe:31234 blocked for more than 122 seconds.
[ 4548.232982][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 4548.233230][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4548.233615][ T44] task:modprobe state:D stack:25744 pid:31234 tgid:31234 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4548.234133][ T44] Call Trace:
[ 4548.234324][ T44]
[ 4548.234455][ T44] __schedule+0x880/0x1b10
[ 4548.234746][ T44] ? io_schedule_timeout+0x150/0x150
[ 4548.234997][ T44] ? schedule+0x1ee/0x270
[ 4548.235173][ T44] ? __lock_release+0x5d/0x170
[ 4548.235424][ T44] schedule+0xe2/0x270
[ 4548.235603][ T44] schedule_preempt_disabled+0x18/0x30
[ 4548.235836][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4548.236073][ T44] ? __lock_acquire+0x449/0x7e0
[ 4548.236325][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4548.236567][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.236800][ T44] ? lock_acquire+0x104/0x160
[ 4548.237029][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4548.237281][ T44] down_write+0x1d6/0x200
[ 4548.237458][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4548.237757][ T44] ? find_held_lock+0x2b/0x80
[ 4548.237994][ T44] ? __create_object+0x5e/0xb0
[ 4548.238261][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4548.238552][ T44] register_pernet_subsys+0x1a/0x40
[ 4548.238787][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4548.239027][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4548.239321][ T44] do_one_initcall+0x8c/0x1d0
[ 4548.239926][ T44] ? trace_initcall_start+0x130/0x130
[ 4548.240161][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.240413][ T44] ? trace_kmalloc+0x26/0xd0
[ 4548.240644][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4548.240878][ T44] ? debug_objects_oom+0x160/0x160
[ 4548.241112][ T44] ? kasan_unpoison+0x27/0x50
[ 4548.241352][ T44] ? __asan_register_globals+0x5d/0x70
[ 4548.241588][ T44] do_init_module+0x27a/0x860
[ 4548.241828][ T44] ? free_module+0x2f0/0x2f0
[ 4548.242064][ T44] ? kfree+0x21d/0x540
[ 4548.242248][ T44] ? load_module+0x20c5/0x2dd0
[ 4548.242487][ T44] load_module+0x1f40/0x2dd0
[ 4548.242730][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4548.243018][ T44] ? kernel_read_file+0x3ed/0x550
[ 4548.243258][ T44] ? kernel_read_file+0x3c8/0x550
[ 4548.243491][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4548.243729][ T44] ? init_module_from_file+0xe9/0x150
[ 4548.243969][ T44] init_module_from_file+0xe9/0x150
[ 4548.244209][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4548.244456][ T44] ? idempotent_init_module+0x316/0x610
[ 4548.244688][ T44] ? __lock_release+0x5d/0x170
[ 4548.244923][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4548.245158][ T44] idempotent_init_module+0x331/0x610
[ 4548.245406][ T44] ? init_module_from_file+0x150/0x150
[ 4548.245653][ T44] ? cap_capable+0x94/0x230
[ 4548.245889][ T44] __x64_sys_finit_module+0xca/0x150
[ 4548.246121][ T44] ? do_syscall_64+0x85/0xfd0
[ 4548.246364][ T44] do_syscall_64+0xc1/0xfd0
[ 4548.246599][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4548.246887][ T44] RIP: 0033:0x7fcb7084192d
[ 4548.247142][ T44] RSP: 002b:00007ffc013e67b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4548.247507][ T44] RAX: ffffffffffffffda RBX: 0000562eb053bac0 RCX: 00007fcb7084192d
[ 4548.247873][ T44] RDX: 0000000000000000 RSI: 0000562e9121ca2a RDI: 0000000000000005
[ 4548.248232][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc013e68f0
[ 4548.248584][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562e9121ca2a
[ 4548.248942][ T44] R13: 0000562eb053bb60 R14: 0000562eb053bda0 R15: 0000000000000000
[ 4548.249320][ T44]
[ 4548.249502][ T44] INFO: task modprobe:31234 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4548.249997][ T44] task:kworker/u16:0 state:R running task stack:24432 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4548.250597][ T44] Workqueue: netns cleanup_net
[ 4548.250836][ T44] Call Trace:
[ 4548.251013][ T44]
[ 4548.251145][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 4548.251388][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.251627][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.251857][ T44] ? trace_contention_end+0xd8/0x140
[ 4548.252097][ T44] ? __mutex_lock+0x19f/0x1190
[ 4548.252341][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4548.252578][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4548.252887][ T44] ? ww_mutex_lock+0x160/0x160
[ 4548.253136][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4548.253442][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4548.253744][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4548.254101][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4548.254466][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4548.254824][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4548.255127][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4548.255438][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4548.255676][ T44] ? ops_undo_list+0x2bf/0x890
[ 4548.255916][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4548.256147][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4548.256395][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4548.256631][ T44] ? net_passive_dec+0x190/0x190
[ 4548.256868][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.257103][ T44] ? process_one_work+0xe35/0x1650
[ 4548.257365][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4548.257607][ T44] ? assign_work+0x168/0x240
[ 4548.257851][ T44] ? worker_thread+0x591/0xcf0
[ 4548.258093][ T44] ? rescuer_thread+0xd10/0xd10
[ 4548.258332][ T44] ? kthread+0x37b/0x5f0
[ 4548.258508][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.258741][ T44] ? ret_from_fork+0x1b/0x270
[ 4548.258978][ T44] ? __lock_release+0x5d/0x170
[ 4548.259229][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.259465][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.259699][ T44] ? ret_from_fork+0x1db/0x270
[ 4548.259927][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.260161][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4548.260416][ T44]
[ 4548.260600][ T44]
[ 4548.260600][ T44] Showing all locks held in the system:
[ 4548.260939][ T44] 4 locks held by kworker/u16:0/12:
[ 4548.261182][ T44] 1 lock held by khungtaskd/44:
[ 4548.261415][ T44] #0: ffffffff89f88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4548.261843][ T44] 1 lock held by modprobe/31234:
[ 4548.262065][ T44] #0: ffffffff8a680310 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4548.262527][ T44]
[ 4548.262648][ T44] =============================================
[ 4548.262648][ T44]
[ 4671.112317][ T44] INFO: task modprobe:31234 blocked for more than 245 seconds.
[ 4671.112835][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 4671.113048][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4671.113440][ T44] task:modprobe state:D stack:25744 pid:31234 tgid:31234 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4671.113939][ T44] Call Trace:
[ 4671.114108][ T44]
[ 4671.114257][ T44] __schedule+0x880/0x1b10
[ 4671.114501][ T44] ? io_schedule_timeout+0x150/0x150
[ 4671.114737][ T44] ? schedule+0x1ee/0x270
[ 4671.114903][ T44] ? __lock_release+0x5d/0x170
[ 4671.115135][ T44] schedule+0xe2/0x270
[ 4671.115344][ T44] schedule_preempt_disabled+0x18/0x30
[ 4671.115569][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4671.115794][ T44] ? __lock_acquire+0x449/0x7e0
[ 4671.116025][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4671.116269][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.116498][ T44] ? lock_acquire+0x104/0x160
[ 4671.116726][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4671.116961][ T44] down_write+0x1d6/0x200
[ 4671.117157][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4671.117449][ T44] ? find_held_lock+0x2b/0x80
[ 4671.117684][ T44] ? __create_object+0x5e/0xb0
[ 4671.117917][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4671.118205][ T44] register_pernet_subsys+0x1a/0x40
[ 4671.118431][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4671.118660][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4671.118935][ T44] do_one_initcall+0x8c/0x1d0
[ 4671.119160][ T44] ? trace_initcall_start+0x130/0x130
[ 4671.119400][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.119626][ T44] ? trace_kmalloc+0x26/0xd0
[ 4671.119850][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4671.120073][ T44] ? debug_objects_oom+0x160/0x160
[ 4671.120306][ T44] ? kasan_unpoison+0x27/0x50
[ 4671.120530][ T44] ? __asan_register_globals+0x5d/0x70
[ 4671.120759][ T44] do_init_module+0x27a/0x860
[ 4671.121006][ T44] ? free_module+0x2f0/0x2f0
[ 4671.121236][ T44] ? kfree+0x21d/0x540
[ 4671.121405][ T44] ? load_module+0x20c5/0x2dd0
[ 4671.121635][ T44] load_module+0x1f40/0x2dd0
[ 4671.121867][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4671.122145][ T44] ? kernel_read_file+0x3ed/0x550
[ 4671.122377][ T44] ? kernel_read_file+0x3c8/0x550
[ 4671.122604][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4671.122839][ T44] ? init_module_from_file+0xe9/0x150
[ 4671.123062][ T44] init_module_from_file+0xe9/0x150
[ 4671.123296][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4671.123533][ T44] ? idempotent_init_module+0x316/0x610
[ 4671.123755][ T44] ? __lock_release+0x5d/0x170
[ 4671.123980][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4671.124213][ T44] idempotent_init_module+0x331/0x610
[ 4671.124446][ T44] ? init_module_from_file+0x150/0x150
[ 4671.124681][ T44] ? cap_capable+0x94/0x230
[ 4671.124911][ T44] __x64_sys_finit_module+0xca/0x150
[ 4671.125134][ T44] ? do_syscall_64+0x85/0xfd0
[ 4671.125369][ T44] do_syscall_64+0xc1/0xfd0
[ 4671.125594][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4671.125874][ T44] RIP: 0033:0x7fcb7084192d
[ 4671.126111][ T44] RSP: 002b:00007ffc013e67b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4671.126462][ T44] RAX: ffffffffffffffda RBX: 0000562eb053bac0 RCX: 00007fcb7084192d
[ 4671.126798][ T44] RDX: 0000000000000000 RSI: 0000562e9121ca2a RDI: 0000000000000005
[ 4671.127156][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc013e68f0
[ 4671.127512][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562e9121ca2a
[ 4671.127848][ T44] R13: 0000562eb053bb60 R14: 0000562eb053bda0 R15: 0000000000000000
[ 4671.128208][ T44]
[ 4671.128382][ T44] INFO: task modprobe:31234 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4671.128854][ T44] task:kworker/u16:0 state:R running task stack:24432 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4671.129417][ T44] Workqueue: netns cleanup_net
[ 4671.129645][ T44] Call Trace:
[ 4671.129813][ T44]
[ 4671.129926][ T44] ? __mutex_lock+0x19f/0x1190
[ 4671.130151][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4671.130390][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4671.130687][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.130911][ T44] ? trace_irq_disable.constprop.0+0xd0/0x130
[ 4671.131198][ T44] ? io_schedule_timeout+0x150/0x150
[ 4671.131425][ T44] ? asm_common_interrupt+0x26/0x40
[ 4671.131661][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4671.131944][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4671.132304][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4671.132641][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4671.132979][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4671.133280][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4671.133565][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4671.133801][ T44] ? ops_undo_list+0x2bf/0x890
[ 4671.134037][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4671.134266][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4671.134500][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4671.134724][ T44] ? net_passive_dec+0x190/0x190
[ 4671.134948][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.135173][ T44] ? process_one_work+0xe35/0x1650
[ 4671.135417][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4671.135658][ T44] ? assign_work+0x168/0x240
[ 4671.135885][ T44] ? worker_thread+0x591/0xcf0
[ 4671.136116][ T44] ? rescuer_thread+0xd10/0xd10
[ 4671.136351][ T44] ? kthread+0x37b/0x5f0
[ 4671.136523][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.136743][ T44] ? ret_from_fork+0x1b/0x270
[ 4671.136967][ T44] ? __lock_release+0x5d/0x170
[ 4671.137222][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.137452][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.137675][ T44] ? ret_from_fork+0x1db/0x270
[ 4671.137894][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.138116][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4671.138360][ T44]
[ 4671.138547][ T44]
[ 4671.138547][ T44] Showing all locks held in the system:
[ 4671.138875][ T44] 4 locks held by kworker/u16:0/12:
[ 4671.139101][ T44] 1 lock held by khungtaskd/44:
[ 4671.139478][ T44] #0: ffffffff89f88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4671.139883][ T44] 1 lock held by modprobe/31234:
[ 4671.140094][ T44] #0: ffffffff8a680310 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4671.140540][ T44]
[ 4671.140649][ T44] =============================================
[ 4671.140649][ T44]
[ 4793.992395][ T44] INFO: task modprobe:31234 blocked for more than 368 seconds.
[ 4793.993097][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 4793.993516][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4793.994123][ T44] task:modprobe state:D stack:25744 pid:31234 tgid:31234 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4793.995126][ T44] Call Trace:
[ 4793.995454][ T44]
[ 4793.995648][ T44] __schedule+0x880/0x1b10
[ 4793.996061][ T44] ? io_schedule_timeout+0x150/0x150
[ 4793.996431][ T44] ? schedule+0x1ee/0x270
[ 4793.996747][ T44] ? __lock_release+0x5d/0x170
[ 4793.997169][ T44] schedule+0xe2/0x270
[ 4793.997480][ T44] schedule_preempt_disabled+0x18/0x30
[ 4793.997826][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4793.998177][ T44] ? __lock_acquire+0x449/0x7e0
[ 4793.998569][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4793.998950][ T44] ? rcu_is_watching+0x12/0xb0
[ 4793.999350][ T44] ? lock_acquire+0x104/0x160
[ 4793.999739][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4794.000088][ T44] down_write+0x1d6/0x200
[ 4794.000367][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4794.000819][ T44] ? find_held_lock+0x2b/0x80
[ 4794.001217][ T44] ? __create_object+0x5e/0xb0
[ 4794.001550][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4794.001942][ T44] register_pernet_subsys+0x1a/0x40
[ 4794.002322][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4794.002660][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4794.003018][ T44] do_one_initcall+0x8c/0x1d0
[ 4794.003340][ T44] ? trace_initcall_start+0x130/0x130
[ 4794.003644][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.003951][ T44] ? trace_kmalloc+0x26/0xd0
[ 4794.004268][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4794.004565][ T44] ? debug_objects_oom+0x160/0x160
[ 4794.004882][ T44] ? kasan_unpoison+0x27/0x50
[ 4794.005208][ T44] ? __asan_register_globals+0x5d/0x70
[ 4794.005515][ T44] do_init_module+0x27a/0x860
[ 4794.005836][ T44] ? free_module+0x2f0/0x2f0
[ 4794.006123][ T44] ? kfree+0x21d/0x540
[ 4794.006367][ T44] ? load_module+0x20c5/0x2dd0
[ 4794.006719][ T44] load_module+0x1f40/0x2dd0
[ 4794.007053][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4794.007452][ T44] ? kernel_read_file+0x3ed/0x550
[ 4794.007757][ T44] ? kernel_read_file+0x3c8/0x550
[ 4794.008056][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4794.008381][ T44] ? init_module_from_file+0xe9/0x150
[ 4794.008682][ T44] init_module_from_file+0xe9/0x150
[ 4794.008985][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4794.009347][ T44] ? idempotent_init_module+0x316/0x610
[ 4794.009648][ T44] ? __lock_release+0x5d/0x170
[ 4794.009961][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4794.010281][ T44] idempotent_init_module+0x331/0x610
[ 4794.010598][ T44] ? init_module_from_file+0x150/0x150
[ 4794.010937][ T44] ? cap_capable+0x94/0x230
[ 4794.011321][ T44] __x64_sys_finit_module+0xca/0x150
[ 4794.011660][ T44] ? do_syscall_64+0x85/0xfd0
[ 4794.011972][ T44] do_syscall_64+0xc1/0xfd0
[ 4794.012297][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4794.012673][ T44] RIP: 0033:0x7fcb7084192d
[ 4794.012993][ T44] RSP: 002b:00007ffc013e67b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4794.013497][ T44] RAX: ffffffffffffffda RBX: 0000562eb053bac0 RCX: 00007fcb7084192d
[ 4794.013979][ T44] RDX: 0000000000000000 RSI: 0000562e9121ca2a RDI: 0000000000000005
[ 4794.014461][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc013e68f0
[ 4794.014920][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562e9121ca2a
[ 4794.015415][ T44] R13: 0000562eb053bb60 R14: 0000562eb053bda0 R15: 0000000000000000
[ 4794.015924][ T44]
[ 4794.016168][ T44] INFO: task modprobe:31234 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4794.016954][ T44] task:kworker/u16:0 state:R running task stack:24432 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4794.017808][ T44] Workqueue: netns cleanup_net
[ 4794.018141][ T44] Call Trace:
[ 4794.018419][ T44]
[ 4794.018591][ T44] ? __mutex_lock+0x19f/0x1190
[ 4794.018946][ T44] ? lockdep_hardirqs_on+0x7c/0x110
[ 4794.019358][ T44] ? irqentry_exit+0x3b/0x80
[ 4794.019738][ T44] ? lockdep_hardirqs_on+0x7c/0x110
[ 4794.020072][ T44] ? asm_common_interrupt+0x26/0x40
[ 4794.020479][ T44] ? nf_ct_iterate_cleanup+0x9b/0x340 [nf_conntrack]
[ 4794.021005][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4794.021561][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4794.022074][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4794.022629][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4794.023067][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4794.023499][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4794.023843][ T44] ? ops_undo_list+0x2bf/0x890
[ 4794.024227][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4794.024564][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4794.024875][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4794.025234][ T44] ? net_passive_dec+0x190/0x190
[ 4794.025572][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.025908][ T44] ? process_one_work+0xe35/0x1650
[ 4794.026283][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4794.026671][ T44] ? assign_work+0x168/0x240
[ 4794.027034][ T44] ? worker_thread+0x591/0xcf0
[ 4794.027399][ T44] ? rescuer_thread+0xd10/0xd10
[ 4794.027747][ T44] ? kthread+0x37b/0x5f0
[ 4794.027995][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4794.028398][ T44] ? ret_from_fork+0x1b/0x270
[ 4794.028778][ T44] ? __lock_release+0x5d/0x170
[ 4794.029182][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.029580][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4794.029889][ T44] ? ret_from_fork+0x1db/0x270
[ 4794.030247][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4794.030632][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4794.031040][ T44]
[ 4794.031388][ T44]
[ 4794.031388][ T44] Showing all locks held in the system:
[ 4794.031999][ T44] 4 locks held by kworker/u16:0/12:
[ 4794.032643][ T44] 1 lock held by khungtaskd/44:
[ 4794.033075][ T44] #0: ffffffff89f88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4794.033800][ T44] 1 lock held by modprobe/31234:
[ 4794.034170][ T44] #0: ffffffff8a680310 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4794.034878][ T44]
[ 4794.035036][ T44] =============================================
[ 4794.035036][ T44]
[ 4916.872290][ T44] INFO: task modprobe:31234 blocked for more than 491 seconds.
[ 4916.872777][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 4916.872980][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4916.873365][ T44] task:modprobe state:D stack:25744 pid:31234 tgid:31234 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4916.873860][ T44] Call Trace:
[ 4916.874022][ T44]
[ 4916.874139][ T44] __schedule+0x880/0x1b10
[ 4916.874422][ T44] ? io_schedule_timeout+0x150/0x150
[ 4916.874655][ T44] ? schedule+0x1ee/0x270
[ 4916.874816][ T44] ? __lock_release+0x5d/0x170
[ 4916.875037][ T44] schedule+0xe2/0x270
[ 4916.875217][ T44] schedule_preempt_disabled+0x18/0x30
[ 4916.875452][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4916.875668][ T44] ? __lock_acquire+0x449/0x7e0
[ 4916.875909][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4916.876135][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.876380][ T44] ? lock_acquire+0x104/0x160
[ 4916.876599][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4916.876831][ T44] down_write+0x1d6/0x200
[ 4916.877018][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4916.877300][ T44] ? find_held_lock+0x2b/0x80
[ 4916.877528][ T44] ? __create_object+0x5e/0xb0
[ 4916.877749][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4916.878013][ T44] register_pernet_subsys+0x1a/0x40
[ 4916.878243][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4916.878473][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 4916.878744][ T44] do_one_initcall+0x8c/0x1d0
[ 4916.878960][ T44] ? trace_initcall_start+0x130/0x130
[ 4916.879175][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.879414][ T44] ? trace_kmalloc+0x26/0xd0
[ 4916.879633][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4916.879845][ T44] ? debug_objects_oom+0x160/0x160
[ 4916.880063][ T44] ? kasan_unpoison+0x27/0x50
[ 4916.880290][ T44] ? __asan_register_globals+0x5d/0x70
[ 4916.880524][ T44] do_init_module+0x27a/0x860
[ 4916.880747][ T44] ? free_module+0x2f0/0x2f0
[ 4916.880959][ T44] ? kfree+0x21d/0x540
[ 4916.881118][ T44] ? load_module+0x20c5/0x2dd0
[ 4916.881352][ T44] load_module+0x1f40/0x2dd0
[ 4916.881584][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4916.881847][ T44] ? kernel_read_file+0x3ed/0x550
[ 4916.882069][ T44] ? kernel_read_file+0x3c8/0x550
[ 4916.882298][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4916.882528][ T44] ? init_module_from_file+0xe9/0x150
[ 4916.882741][ T44] init_module_from_file+0xe9/0x150
[ 4916.882956][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4916.883198][ T44] ? idempotent_init_module+0x316/0x610
[ 4916.883419][ T44] ? __lock_release+0x5d/0x170
[ 4916.883644][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4916.883859][ T44] idempotent_init_module+0x331/0x610
[ 4916.884075][ T44] ? init_module_from_file+0x150/0x150
[ 4916.884314][ T44] ? cap_capable+0x94/0x230
[ 4916.884545][ T44] __x64_sys_finit_module+0xca/0x150
[ 4916.884757][ T44] ? do_syscall_64+0x85/0xfd0
[ 4916.884972][ T44] do_syscall_64+0xc1/0xfd0
[ 4916.885208][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4916.885482][ T44] RIP: 0033:0x7fcb7084192d
[ 4916.885705][ T44] RSP: 002b:00007ffc013e67b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4916.886068][ T44] RAX: ffffffffffffffda RBX: 0000562eb053bac0 RCX: 00007fcb7084192d
[ 4916.886427][ T44] RDX: 0000000000000000 RSI: 0000562e9121ca2a RDI: 0000000000000005
[ 4916.886771][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc013e68f0
[ 4916.887106][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562e9121ca2a
[ 4916.887451][ T44] R13: 0000562eb053bb60 R14: 0000562eb053bda0 R15: 0000000000000000
[ 4916.887789][ T44]
[ 4916.887954][ T44] INFO: task modprobe:31234 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4916.888436][ T44] task:kworker/u16:0 state:R running task stack:24432 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4916.888959][ T44] Workqueue: netns cleanup_net
[ 4916.889197][ T44] Call Trace:
[ 4916.889366][ T44]
[ 4916.889484][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 4916.889707][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 4916.889920][ T44] ? find_held_lock+0x2b/0x80
[ 4916.890133][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.890376][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.890589][ T44] ? trace_contention_end+0xd8/0x140
[ 4916.890806][ T44] ? __mutex_lock+0x19f/0x1190
[ 4916.891020][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4916.891259][ T44] ? irqentry_exit+0x3b/0x80
[ 4916.891487][ T44] ? common_interrupt+0x9b/0xe0
[ 4916.891701][ T44] ? asm_common_interrupt+0x26/0x40
[ 4916.891915][ T44] ? __mutex_unlock_slowpath+0x149/0x4f0
[ 4916.892132][ T44] ? nf_ct_iterate_cleanup+0x73/0x340 [nf_conntrack]
[ 4916.892431][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4916.892759][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4916.893093][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4916.893441][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4916.893719][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4916.893993][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4916.894218][ T44] ? ops_undo_list+0x2bf/0x890
[ 4916.894447][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4916.894665][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4916.894887][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4916.895102][ T44] ? net_passive_dec+0x190/0x190
[ 4916.895332][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.895559][ T44] ? process_one_work+0xe35/0x1650
[ 4916.895817][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4916.896053][ T44] ? assign_work+0x168/0x240
[ 4916.896302][ T44] ? worker_thread+0x591/0xcf0
[ 4916.896540][ T44] ? rescuer_thread+0xd10/0xd10
[ 4916.896764][ T44] ? kthread+0x37b/0x5f0
[ 4916.896931][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.897156][ T44] ? ret_from_fork+0x1b/0x270
[ 4916.897391][ T44] ? __lock_release+0x5d/0x170
[ 4916.897607][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.897817][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.898032][ T44] ? ret_from_fork+0x1db/0x270
[ 4916.898262][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.898482][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4916.898708][ T44]
[ 4916.898893][ T44]
[ 4916.898893][ T44] Showing all locks held in the system:
[ 4916.899346][ T44] 4 locks held by kworker/u16:0/12:
[ 4916.899598][ T44] 1 lock held by khungtaskd/44:
[ 4916.899807][ T44] #0: ffffffff89f88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4916.900218][ T44] 1 lock held by modprobe/31234:
[ 4916.900431][ T44] #0: ffffffff8a680310 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4916.900850][ T44]
[ 4916.900955][ T44] =============================================
[ 4916.900955][ T44]
[ 5039.752305][ T44] INFO: task modprobe:31234 blocked for more than 614 seconds.
[ 5039.752774][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5039.753013][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5039.753461][ T44] task:modprobe state:D stack:25744 pid:31234 tgid:31234 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5039.754043][ T44] Call Trace:
[ 5039.754249][ T44]
[ 5039.754383][ T44] __schedule+0x880/0x1b10
[ 5039.754649][ T44] ? io_schedule_timeout+0x150/0x150
[ 5039.754911][ T44] ? schedule+0x1ee/0x270
[ 5039.755106][ T44] ? __lock_release+0x5d/0x170
[ 5039.755401][ T44] schedule+0xe2/0x270
[ 5039.755597][ T44] schedule_preempt_disabled+0x18/0x30
[ 5039.755844][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5039.756106][ T44] ? __lock_acquire+0x449/0x7e0
[ 5039.756370][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5039.756631][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.756882][ T44] ? lock_acquire+0x104/0x160
[ 5039.757130][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5039.757405][ T44] down_write+0x1d6/0x200
[ 5039.757596][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5039.757912][ T44] ? find_held_lock+0x2b/0x80
[ 5039.758164][ T44] ? __create_object+0x5e/0xb0
[ 5039.758433][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5039.758745][ T44] register_pernet_subsys+0x1a/0x40
[ 5039.758992][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5039.759259][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5039.759566][ T44] do_one_initcall+0x8c/0x1d0
[ 5039.759824][ T44] ? trace_initcall_start+0x130/0x130
[ 5039.760066][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.760323][ T44] ? trace_kmalloc+0x26/0xd0
[ 5039.760565][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5039.760809][ T44] ? debug_objects_oom+0x160/0x160
[ 5039.761057][ T44] ? kasan_unpoison+0x27/0x50
[ 5039.761318][ T44] ? __asan_register_globals+0x5d/0x70
[ 5039.761589][ T44] do_init_module+0x27a/0x860
[ 5039.761844][ T44] ? free_module+0x2f0/0x2f0
[ 5039.762090][ T44] ? kfree+0x21d/0x540
[ 5039.762288][ T44] ? load_module+0x20c5/0x2dd0
[ 5039.762543][ T44] load_module+0x1f40/0x2dd0
[ 5039.762803][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5039.763110][ T44] ? kernel_read_file+0x3ed/0x550
[ 5039.763374][ T44] ? kernel_read_file+0x3c8/0x550
[ 5039.763632][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5039.763886][ T44] ? init_module_from_file+0xe9/0x150
[ 5039.764131][ T44] init_module_from_file+0xe9/0x150
[ 5039.764392][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5039.764663][ T44] ? idempotent_init_module+0x316/0x610
[ 5039.764908][ T44] ? __lock_release+0x5d/0x170
[ 5039.765166][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5039.765434][ T44] idempotent_init_module+0x331/0x610
[ 5039.765686][ T44] ? init_module_from_file+0x150/0x150
[ 5039.765945][ T44] ? cap_capable+0x94/0x230
[ 5039.766212][ T44] __x64_sys_finit_module+0xca/0x150
[ 5039.766461][ T44] ? do_syscall_64+0x85/0xfd0
[ 5039.766713][ T44] do_syscall_64+0xc1/0xfd0
[ 5039.766960][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5039.767275][ T44] RIP: 0033:0x7fcb7084192d
[ 5039.767525][ T44] RSP: 002b:00007ffc013e67b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5039.767894][ T44] RAX: ffffffffffffffda RBX: 0000562eb053bac0 RCX: 00007fcb7084192d
[ 5039.768276][ T44] RDX: 0000000000000000 RSI: 0000562e9121ca2a RDI: 0000000000000005
[ 5039.768653][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc013e68f0
[ 5039.769029][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562e9121ca2a
[ 5039.769415][ T44] R13: 0000562eb053bb60 R14: 0000562eb053bda0 R15: 0000000000000000
[ 5039.769808][ T44]
[ 5039.770000][ T44] INFO: task modprobe:31234 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5039.770549][ T44] task:kworker/u16:0 state:R running task stack:24432 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5039.771165][ T44] Workqueue: netns cleanup_net
[ 5039.771428][ T44] Call Trace:
[ 5039.771617][ T44]
[ 5039.771744][ T44] ? __mutex_lock+0x19f/0x1190
[ 5039.771993][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5039.772289][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5039.772615][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5039.772995][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5039.773382][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5039.773764][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5039.774086][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5039.774407][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5039.774655][ T44] ? ops_undo_list+0x2bf/0x890
[ 5039.774902][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5039.775159][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5039.775427][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5039.775679][ T44] ? net_passive_dec+0x190/0x190
[ 5039.775938][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.776201][ T44] ? process_one_work+0xe35/0x1650
[ 5039.776465][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5039.776723][ T44] ? assign_work+0x168/0x240
[ 5039.776977][ T44] ? worker_thread+0x591/0xcf0
[ 5039.777241][ T44] ? rescuer_thread+0xd10/0xd10
[ 5039.777495][ T44] ? kthread+0x37b/0x5f0
[ 5039.777686][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.777939][ T44] ? ret_from_fork+0x1b/0x270
[ 5039.778199][ T44] ? __lock_release+0x5d/0x170
[ 5039.778447][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.778694][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.778949][ T44] ? ret_from_fork+0x1db/0x270
[ 5039.779207][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.779456][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5039.779719][ T44]
[ 5039.779936][ T44]
[ 5039.779936][ T44] Showing all locks held in the system:
[ 5039.780446][ T44] 4 locks held by kworker/u16:0/12:
[ 5039.780701][ T44] 1 lock held by khungtaskd/44:
[ 5039.780940][ T44] #0: ffffffff89f88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5039.781400][ T44] 1 lock held by modprobe/31234:
[ 5039.781631][ T44] #0: ffffffff8a680310 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5039.782120][ T44]
[ 5039.782253][ T44] =============================================
[ 5039.782253][ T44]
[ 5162.632284][ T44] INFO: task modprobe:31234 blocked for more than 737 seconds.
[ 5162.632744][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5162.632981][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5162.633441][ T44] task:modprobe state:D stack:25744 pid:31234 tgid:31234 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5162.634012][ T44] Call Trace:
[ 5162.634217][ T44]
[ 5162.634359][ T44] __schedule+0x880/0x1b10
[ 5162.634643][ T44] ? io_schedule_timeout+0x150/0x150
[ 5162.634906][ T44] ? schedule+0x1ee/0x270
[ 5162.635092][ T44] ? __lock_release+0x5d/0x170
[ 5162.635388][ T44] schedule+0xe2/0x270
[ 5162.635581][ T44] schedule_preempt_disabled+0x18/0x30
[ 5162.635833][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5162.636089][ T44] ? __lock_acquire+0x449/0x7e0
[ 5162.636361][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5162.636621][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.636872][ T44] ? lock_acquire+0x104/0x160
[ 5162.637113][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5162.637380][ T44] down_write+0x1d6/0x200
[ 5162.637566][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5162.637869][ T44] ? find_held_lock+0x2b/0x80
[ 5162.638119][ T44] ? __create_object+0x5e/0xb0
[ 5162.638392][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5162.638704][ T44] register_pernet_subsys+0x1a/0x40
[ 5162.638952][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5162.639214][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5162.639521][ T44] do_one_initcall+0x8c/0x1d0
[ 5162.639771][ T44] ? trace_initcall_start+0x130/0x130
[ 5162.640018][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.640280][ T44] ? trace_kmalloc+0x26/0xd0
[ 5162.640526][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5162.640773][ T44] ? debug_objects_oom+0x160/0x160
[ 5162.641022][ T44] ? kasan_unpoison+0x27/0x50
[ 5162.641279][ T44] ? __asan_register_globals+0x5d/0x70
[ 5162.641532][ T44] do_init_module+0x27a/0x860
[ 5162.641787][ T44] ? free_module+0x2f0/0x2f0
[ 5162.642041][ T44] ? kfree+0x21d/0x540
[ 5162.642239][ T44] ? load_module+0x20c5/0x2dd0
[ 5162.642497][ T44] load_module+0x1f40/0x2dd0
[ 5162.642760][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5162.643069][ T44] ? kernel_read_file+0x3ed/0x550
[ 5162.643330][ T44] ? kernel_read_file+0x3c8/0x550
[ 5162.643580][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5162.643833][ T44] ? init_module_from_file+0xe9/0x150
[ 5162.644082][ T44] init_module_from_file+0xe9/0x150
[ 5162.644335][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5162.644608][ T44] ? idempotent_init_module+0x316/0x610
[ 5162.644855][ T44] ? __lock_release+0x5d/0x170
[ 5162.645106][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5162.645367][ T44] idempotent_init_module+0x331/0x610
[ 5162.645626][ T44] ? init_module_from_file+0x150/0x150
[ 5162.645888][ T44] ? cap_capable+0x94/0x230
[ 5162.646142][ T44] __x64_sys_finit_module+0xca/0x150
[ 5162.646409][ T44] ? do_syscall_64+0x85/0xfd0
[ 5162.646663][ T44] do_syscall_64+0xc1/0xfd0
[ 5162.646914][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5162.647233][ T44] RIP: 0033:0x7fcb7084192d
[ 5162.647498][ T44] RSP: 002b:00007ffc013e67b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5162.647874][ T44] RAX: ffffffffffffffda RBX: 0000562eb053bac0 RCX: 00007fcb7084192d
[ 5162.648267][ T44] RDX: 0000000000000000 RSI: 0000562e9121ca2a RDI: 0000000000000005
[ 5162.648639][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc013e68f0
[ 5162.649015][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562e9121ca2a
[ 5162.649408][ T44] R13: 0000562eb053bb60 R14: 0000562eb053bda0 R15: 0000000000000000
[ 5162.649796][ T44]
[ 5162.649986][ T44] INFO: task modprobe:31234 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5162.650524][ T44] task:kworker/u16:0 state:R running task stack:24432 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5162.651134][ T44] Workqueue: netns cleanup_net
[ 5162.651395][ T44] Call Trace:
[ 5162.651582][ T44]
[ 5162.651708][ T44] ? __mutex_lock+0x19f/0x1190
[ 5162.651955][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5162.652223][ T44] ? irqentry_exit+0x3b/0x80
[ 5162.652471][ T44] ? common_interrupt+0x9b/0xe0
[ 5162.652727][ T44] ? asm_common_interrupt+0x26/0x40
[ 5162.652985][ T44] ? nf_ct_iterate_cleanup+0x79/0x340 [nf_conntrack]
[ 5162.653324][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5162.653704][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5162.654079][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5162.654478][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5162.654802][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5162.655117][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5162.655380][ T44] ? ops_undo_list+0x2bf/0x890
[ 5162.655633][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5162.655877][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5162.656132][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5162.656396][ T44] ? net_passive_dec+0x190/0x190
[ 5162.656648][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.656904][ T44] ? process_one_work+0xe35/0x1650
[ 5162.657163][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5162.657425][ T44] ? assign_work+0x168/0x240
[ 5162.657675][ T44] ? worker_thread+0x591/0xcf0
[ 5162.657931][ T44] ? rescuer_thread+0xd10/0xd10
[ 5162.658180][ T44] ? kthread+0x37b/0x5f0
[ 5162.658387][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.658636][ T44] ? ret_from_fork+0x1b/0x270
[ 5162.658887][ T44] ? __lock_release+0x5d/0x170
[ 5162.659136][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.659393][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.659643][ T44] ? ret_from_fork+0x1db/0x270
[ 5162.659888][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.660138][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5162.660415][ T44]
[ 5162.660636][ T44]
[ 5162.660636][ T44] Showing all locks held in the system:
[ 5162.660995][ T44] 5 locks held by kworker/u16:0/12:
[ 5162.661398][ T44] 1 lock held by khungtaskd/44:
[ 5162.661638][ T44] #0: ffffffff89f88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5162.662083][ T44] 1 lock held by modprobe/31234:
[ 5162.662336][ T44] #0: ffffffff8a680310 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5162.662825][ T44]
[ 5162.662945][ T44] =============================================
[ 5162.662945][ T44]
[ 5285.512394][ T44] INFO: task modprobe:31234 blocked for more than 860 seconds.
[ 5285.513114][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5285.513449][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5285.513974][ T44] task:modprobe state:D stack:25744 pid:31234 tgid:31234 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5285.514755][ T44] Call Trace:
[ 5285.514995][ T44]
[ 5285.515163][ T44] __schedule+0x880/0x1b10
[ 5285.515561][ T44] ? io_schedule_timeout+0x150/0x150
[ 5285.515909][ T44] ? schedule+0x1ee/0x270
[ 5285.516135][ T44] ? __lock_release+0x5d/0x170
[ 5285.516479][ T44] schedule+0xe2/0x270
[ 5285.516722][ T44] schedule_preempt_disabled+0x18/0x30
[ 5285.517049][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5285.517410][ T44] ? __lock_acquire+0x449/0x7e0
[ 5285.517750][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5285.518109][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.518505][ T44] ? lock_acquire+0x104/0x160
[ 5285.518851][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5285.519169][ T44] down_write+0x1d6/0x200
[ 5285.519415][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5285.519844][ T44] ? find_held_lock+0x2b/0x80
[ 5285.520152][ T44] ? __create_object+0x5e/0xb0
[ 5285.520496][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5285.520876][ T44] register_pernet_subsys+0x1a/0x40
[ 5285.521266][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5285.521606][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5285.521983][ T44] do_one_initcall+0x8c/0x1d0
[ 5285.522322][ T44] ? trace_initcall_start+0x130/0x130
[ 5285.522667][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.522983][ T44] ? trace_kmalloc+0x26/0xd0
[ 5285.523287][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5285.523580][ T44] ? debug_objects_oom+0x160/0x160
[ 5285.523914][ T44] ? kasan_unpoison+0x27/0x50
[ 5285.524283][ T44] ? __asan_register_globals+0x5d/0x70
[ 5285.524608][ T44] do_init_module+0x27a/0x860
[ 5285.524937][ T44] ? free_module+0x2f0/0x2f0
[ 5285.525269][ T44] ? kfree+0x21d/0x540
[ 5285.525537][ T44] ? load_module+0x20c5/0x2dd0
[ 5285.525866][ T44] load_module+0x1f40/0x2dd0
[ 5285.526180][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5285.526550][ T44] ? kernel_read_file+0x3ed/0x550
[ 5285.526844][ T44] ? kernel_read_file+0x3c8/0x550
[ 5285.527134][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5285.527446][ T44] ? init_module_from_file+0xe9/0x150
[ 5285.527771][ T44] init_module_from_file+0xe9/0x150
[ 5285.528123][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5285.528469][ T44] ? idempotent_init_module+0x316/0x610
[ 5285.528755][ T44] ? __lock_release+0x5d/0x170
[ 5285.529057][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5285.529369][ T44] idempotent_init_module+0x331/0x610
[ 5285.529672][ T44] ? init_module_from_file+0x150/0x150
[ 5285.529997][ T44] ? cap_capable+0x94/0x230
[ 5285.530383][ T44] __x64_sys_finit_module+0xca/0x150
[ 5285.530697][ T44] ? do_syscall_64+0x85/0xfd0
[ 5285.531005][ T44] do_syscall_64+0xc1/0xfd0
[ 5285.531327][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5285.531677][ T44] RIP: 0033:0x7fcb7084192d
[ 5285.531986][ T44] RSP: 002b:00007ffc013e67b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5285.532500][ T44] RAX: ffffffffffffffda RBX: 0000562eb053bac0 RCX: 00007fcb7084192d
[ 5285.532934][ T44] RDX: 0000000000000000 RSI: 0000562e9121ca2a RDI: 0000000000000005
[ 5285.533429][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc013e68f0
[ 5285.533895][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562e9121ca2a
[ 5285.534339][ T44] R13: 0000562eb053bb60 R14: 0000562eb053bda0 R15: 0000000000000000
[ 5285.534837][ T44]
[ 5285.535127][ T44] INFO: task modprobe:31234 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5285.535741][ T44] task:kworker/u16:0 state:R running task stack:24432 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5285.536525][ T44] Workqueue: netns cleanup_net
[ 5285.536832][ T44] Call Trace:
[ 5285.537067][ T44]
[ 5285.537257][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5285.537624][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5285.537935][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.538286][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.538644][ T44] ? trace_contention_end+0xd8/0x140
[ 5285.539006][ T44] ? __mutex_lock+0x19f/0x1190
[ 5285.539403][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5285.539783][ T44] ? irqentry_exit+0x3b/0x80
[ 5285.540179][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5285.540675][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5285.541234][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5285.541785][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5285.542354][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5285.542821][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5285.543294][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5285.543665][ T44] ? ops_undo_list+0x2bf/0x890
[ 5285.544045][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5285.544440][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5285.544819][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5285.545236][ T44] ? net_passive_dec+0x190/0x190
[ 5285.545615][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.545987][ T44] ? process_one_work+0xe35/0x1650
[ 5285.546398][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5285.546776][ T44] ? assign_work+0x168/0x240
[ 5285.547145][ T44] ? worker_thread+0x591/0xcf0
[ 5285.547527][ T44] ? rescuer_thread+0xd10/0xd10
[ 5285.547890][ T44] ? kthread+0x37b/0x5f0
[ 5285.548180][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.548570][ T44] ? ret_from_fork+0x1b/0x270
[ 5285.548912][ T44] ? __lock_release+0x5d/0x170
[ 5285.549286][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.549648][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.549997][ T44] ? ret_from_fork+0x1db/0x270
[ 5285.550396][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.550735][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5285.551119][ T44]
[ 5285.551457][ T44]
[ 5285.551457][ T44] Showing all locks held in the system:
[ 5285.551971][ T44] 4 locks held by kworker/u16:0/12:
[ 5285.552492][ T44] 1 lock held by khungtaskd/44:
[ 5285.552867][ T44] #0: ffffffff89f88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5285.553524][ T44] 1 lock held by modprobe/31234:
[ 5285.553882][ T44] #0: ffffffff8a680310 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5285.554605][ T44]
[ 5285.554780][ T44] =============================================
[ 5285.554780][ T44]
[ 5408.392371][ T44] INFO: task modprobe:31234 blocked for more than 983 seconds.
[ 5408.392914][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5408.393142][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5408.393554][ T44] task:modprobe state:D stack:25744 pid:31234 tgid:31234 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5408.394106][ T44] Call Trace:
[ 5408.394295][ T44]
[ 5408.394426][ T44] __schedule+0x880/0x1b10
[ 5408.394688][ T44] ? io_schedule_timeout+0x150/0x150
[ 5408.394960][ T44] ? schedule+0x1ee/0x270
[ 5408.395131][ T44] ? __lock_release+0x5d/0x170
[ 5408.395441][ T44] schedule+0xe2/0x270
[ 5408.395635][ T44] schedule_preempt_disabled+0x18/0x30
[ 5408.395862][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5408.396108][ T44] ? __lock_acquire+0x449/0x7e0
[ 5408.396347][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5408.396583][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.396823][ T44] ? lock_acquire+0x104/0x160
[ 5408.397060][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5408.397321][ T44] down_write+0x1d6/0x200
[ 5408.397497][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5408.397782][ T44] ? find_held_lock+0x2b/0x80
[ 5408.398016][ T44] ? __create_object+0x5e/0xb0
[ 5408.398267][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5408.398552][ T44] register_pernet_subsys+0x1a/0x40
[ 5408.398779][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5408.399020][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5408.399308][ T44] do_one_initcall+0x8c/0x1d0
[ 5408.399541][ T44] ? trace_initcall_start+0x130/0x130
[ 5408.399760][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.399989][ T44] ? trace_kmalloc+0x26/0xd0
[ 5408.400236][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5408.400459][ T44] ? debug_objects_oom+0x160/0x160
[ 5408.400698][ T44] ? kasan_unpoison+0x27/0x50
[ 5408.400924][ T44] ? __asan_register_globals+0x5d/0x70
[ 5408.401157][ T44] do_init_module+0x27a/0x860
[ 5408.401411][ T44] ? free_module+0x2f0/0x2f0
[ 5408.401632][ T44] ? kfree+0x21d/0x540
[ 5408.401807][ T44] ? load_module+0x20c5/0x2dd0
[ 5408.402034][ T44] load_module+0x1f40/0x2dd0
[ 5408.402279][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5408.402566][ T44] ? kernel_read_file+0x3ed/0x550
[ 5408.402795][ T44] ? kernel_read_file+0x3c8/0x550
[ 5408.403034][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5408.403294][ T44] ? init_module_from_file+0xe9/0x150
[ 5408.403524][ T44] init_module_from_file+0xe9/0x150
[ 5408.403750][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5408.403990][ T44] ? idempotent_init_module+0x316/0x610
[ 5408.404253][ T44] ? __lock_release+0x5d/0x170
[ 5408.404497][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5408.404726][ T44] idempotent_init_module+0x331/0x610
[ 5408.404956][ T44] ? init_module_from_file+0x150/0x150
[ 5408.405203][ T44] ? cap_capable+0x94/0x230
[ 5408.405442][ T44] __x64_sys_finit_module+0xca/0x150
[ 5408.405663][ T44] ? do_syscall_64+0x85/0xfd0
[ 5408.405914][ T44] do_syscall_64+0xc1/0xfd0
[ 5408.406139][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5408.406433][ T44] RIP: 0033:0x7fcb7084192d
[ 5408.406688][ T44] RSP: 002b:00007ffc013e67b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5408.407030][ T44] RAX: ffffffffffffffda RBX: 0000562eb053bac0 RCX: 00007fcb7084192d
[ 5408.407376][ T44] RDX: 0000000000000000 RSI: 0000562e9121ca2a RDI: 0000000000000005
[ 5408.407724][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc013e68f0
[ 5408.408063][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562e9121ca2a
[ 5408.408413][ T44] R13: 0000562eb053bb60 R14: 0000562eb053bda0 R15: 0000000000000000
[ 5408.408774][ T44]
[ 5408.408980][ T44] INFO: task modprobe:31234 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5408.409477][ T44] task:kworker/u16:0 state:R running task stack:24432 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5408.410033][ T44] Workqueue: netns cleanup_net
[ 5408.410273][ T44] Call Trace:
[ 5408.410448][ T44]
[ 5408.410583][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5408.410814][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5408.411041][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.411276][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.411502][ T44] ? trace_contention_end+0xd8/0x140
[ 5408.411730][ T44] ? __mutex_lock+0x19f/0x1190
[ 5408.411952][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5408.412185][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.412431][ T44] ? trace_irq_disable.constprop.0+0xd0/0x130
[ 5408.412709][ T44] ? common_interrupt+0x9b/0xe0
[ 5408.412933][ T44] ? lockdep_hardirqs_on+0x7c/0x110
[ 5408.413167][ T44] ? asm_common_interrupt+0x26/0x40
[ 5408.413412][ T44] ? _mutex_trylock_nest_lock+0x140/0x140
[ 5408.413641][ T44] ? nf_ct_iterate_cleanup+0x92/0x340 [nf_conntrack]
[ 5408.413960][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5408.414322][ T44] ? schedule+0xe2/0x270
[ 5408.414498][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5408.414846][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5408.415203][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5408.415500][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5408.415799][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5408.416032][ T44] ? ops_undo_list+0x2bf/0x890
[ 5408.416280][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5408.416503][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5408.416740][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5408.416965][ T44] ? net_passive_dec+0x190/0x190
[ 5408.417201][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.417452][ T44] ? process_one_work+0xe35/0x1650
[ 5408.417694][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5408.417929][ T44] ? assign_work+0x168/0x240
[ 5408.418160][ T44] ? worker_thread+0x591/0xcf0
[ 5408.418405][ T44] ? rescuer_thread+0xd10/0xd10
[ 5408.418632][ T44] ? kthread+0x37b/0x5f0
[ 5408.418809][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.419036][ T44] ? ret_from_fork+0x1b/0x270
[ 5408.419296][ T44] ? __lock_release+0x5d/0x170
[ 5408.419525][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.419748][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.419975][ T44] ? ret_from_fork+0x1db/0x270
[ 5408.420207][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.420430][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5408.420685][ T44]
[ 5408.420933][ T44]
[ 5408.420933][ T44] Showing all locks held in the system:
[ 5408.421459][ T44] 4 locks held by kworker/u16:0/12:
[ 5408.421703][ T44] 1 lock held by khungtaskd/44:
[ 5408.421918][ T44] #0: ffffffff89f88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5408.422368][ T44] 1 lock held by modprobe/31234:
[ 5408.422585][ T44] #0: ffffffff8a680310 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5408.423051][ T44]
[ 5408.423170][ T44] =============================================
[ 5408.423170][ T44]
[ 5531.272303][ T44] INFO: task modprobe:31234 blocked for more than 1105 seconds.
[ 5531.272808][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5531.273025][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5531.273420][ T44] task:modprobe state:D stack:25744 pid:31234 tgid:31234 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5531.273918][ T44] Call Trace:
[ 5531.274092][ T44]
[ 5531.274226][ T44] __schedule+0x880/0x1b10
[ 5531.274467][ T44] ? io_schedule_timeout+0x150/0x150
[ 5531.274717][ T44] ? schedule+0x1ee/0x270
[ 5531.274882][ T44] ? __lock_release+0x5d/0x170
[ 5531.275110][ T44] schedule+0xe2/0x270
[ 5531.275313][ T44] schedule_preempt_disabled+0x18/0x30
[ 5531.275536][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5531.275757][ T44] ? __lock_acquire+0x449/0x7e0
[ 5531.275975][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5531.276224][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.276446][ T44] ? lock_acquire+0x104/0x160
[ 5531.276669][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5531.276902][ T44] down_write+0x1d6/0x200
[ 5531.277067][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5531.277347][ T44] ? find_held_lock+0x2b/0x80
[ 5531.277570][ T44] ? __create_object+0x5e/0xb0
[ 5531.277806][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5531.278081][ T44] register_pernet_subsys+0x1a/0x40
[ 5531.278313][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5531.278541][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5531.278813][ T44] do_one_initcall+0x8c/0x1d0
[ 5531.279044][ T44] ? trace_initcall_start+0x130/0x130
[ 5531.279271][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.279506][ T44] ? trace_kmalloc+0x26/0xd0
[ 5531.279728][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5531.279947][ T44] ? debug_objects_oom+0x160/0x160
[ 5531.280168][ T44] ? kasan_unpoison+0x27/0x50
[ 5531.280403][ T44] ? __asan_register_globals+0x5d/0x70
[ 5531.280629][ T44] do_init_module+0x27a/0x860
[ 5531.280857][ T44] ? free_module+0x2f0/0x2f0
[ 5531.281076][ T44] ? kfree+0x21d/0x540
[ 5531.281259][ T44] ? load_module+0x20c5/0x2dd0
[ 5531.281484][ T44] load_module+0x1f40/0x2dd0
[ 5531.281718][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5531.281990][ T44] ? kernel_read_file+0x3ed/0x550
[ 5531.282220][ T44] ? kernel_read_file+0x3c8/0x550
[ 5531.282452][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5531.282678][ T44] ? init_module_from_file+0xe9/0x150
[ 5531.282904][ T44] init_module_from_file+0xe9/0x150
[ 5531.283124][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5531.283369][ T44] ? idempotent_init_module+0x316/0x610
[ 5531.283588][ T44] ? __lock_release+0x5d/0x170
[ 5531.283808][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5531.284029][ T44] idempotent_init_module+0x331/0x610
[ 5531.284259][ T44] ? init_module_from_file+0x150/0x150
[ 5531.284497][ T44] ? cap_capable+0x94/0x230
[ 5531.284725][ T44] __x64_sys_finit_module+0xca/0x150
[ 5531.284942][ T44] ? do_syscall_64+0x85/0xfd0
[ 5531.285163][ T44] do_syscall_64+0xc1/0xfd0
[ 5531.285395][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5531.285668][ T44] RIP: 0033:0x7fcb7084192d
[ 5531.285898][ T44] RSP: 002b:00007ffc013e67b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5531.286248][ T44] RAX: ffffffffffffffda RBX: 0000562eb053bac0 RCX: 00007fcb7084192d
[ 5531.286579][ T44] RDX: 0000000000000000 RSI: 0000562e9121ca2a RDI: 0000000000000005
[ 5531.286913][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc013e68f0
[ 5531.287251][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562e9121ca2a
[ 5531.287590][ T44] R13: 0000562eb053bb60 R14: 0000562eb053bda0 R15: 0000000000000000
[ 5531.287938][ T44]
[ 5531.288110][ T44] INFO: task modprobe:31234 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5531.288588][ T44] task:kworker/u16:0 state:R running task stack:24432 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5531.289133][ T44] Workqueue: netns cleanup_net
[ 5531.289370][ T44] Call Trace:
[ 5531.289536][ T44]
[ 5531.289655][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5531.289877][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5531.290098][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.290331][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.290550][ T44] ? trace_contention_end+0xd8/0x140
[ 5531.290778][ T44] ? __mutex_lock+0x19f/0x1190
[ 5531.290998][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5531.291237][ T44] ? irqentry_exit+0x3b/0x80
[ 5531.291457][ T44] ? common_interrupt+0x9b/0xe0
[ 5531.291679][ T44] ? asm_common_interrupt+0x26/0x40
[ 5531.291906][ T44] ? nf_ct_iterate_cleanup+0x92/0x340 [nf_conntrack]
[ 5531.292211][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5531.292559][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5531.292891][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5531.293235][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5531.293520][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5531.293809][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5531.294033][ T44] ? ops_undo_list+0x2bf/0x890
[ 5531.294266][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5531.294483][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5531.294714][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5531.294937][ T44] ? net_passive_dec+0x190/0x190
[ 5531.295157][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.295387][ T44] ? process_one_work+0xe35/0x1650
[ 5531.295626][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5531.295852][ T44] ? assign_work+0x168/0x240
[ 5531.296075][ T44] ? worker_thread+0x591/0xcf0
[ 5531.296312][ T44] ? rescuer_thread+0xd10/0xd10
[ 5531.296533][ T44] ? kthread+0x37b/0x5f0
[ 5531.296703][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.296921][ T44] ? ret_from_fork+0x1b/0x270
[ 5531.297144][ T44] ? __lock_release+0x5d/0x170
[ 5531.297378][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.297598][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.297822][ T44] ? ret_from_fork+0x1db/0x270
[ 5531.298035][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.298263][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5531.298496][ T44]
[ 5531.298706][ T44]
[ 5531.298706][ T44] Showing all locks held in the system:
[ 5531.299018][ T44] 4 locks held by kworker/u16:0/12:
[ 5531.299408][ T44] 1 lock held by khungtaskd/44:
[ 5531.299620][ T44] #0: ffffffff89f88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5531.300024][ T44] 1 lock held by modprobe/31234:
[ 5531.300240][ T44] #0: ffffffff8a680310 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5531.300676][ T44]
[ 5531.300781][ T44] =============================================
[ 5531.300781][ T44]
[ 5654.152321][ T44] INFO: task modprobe:31234 blocked for more than 1228 seconds.
[ 5654.152777][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5654.152996][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5654.153396][ T44] task:modprobe state:D stack:25744 pid:31234 tgid:31234 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5654.153909][ T44] Call Trace:
[ 5654.154090][ T44]
[ 5654.154224][ T44] __schedule+0x880/0x1b10
[ 5654.154468][ T44] ? io_schedule_timeout+0x150/0x150
[ 5654.154712][ T44] ? schedule+0x1ee/0x270
[ 5654.154881][ T44] ? __lock_release+0x5d/0x170
[ 5654.155130][ T44] schedule+0xe2/0x270
[ 5654.155337][ T44] schedule_preempt_disabled+0x18/0x30
[ 5654.155567][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5654.155789][ T44] ? __lock_acquire+0x449/0x7e0
[ 5654.156014][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5654.156260][ T44] ? rcu_is_watching+0x12/0xb0
[ 5654.156483][ T44] ? lock_acquire+0x104/0x160
[ 5654.156700][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5654.156952][ T44] down_write+0x1d6/0x200
[ 5654.157121][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5654.157404][ T44] ? find_held_lock+0x2b/0x80
[ 5654.157627][ T44] ? __create_object+0x5e/0xb0
[ 5654.157854][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5654.158136][ T44] register_pernet_subsys+0x1a/0x40
[ 5654.158376][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5654.158603][ T44] ? _sub_I_65535_1+0xcf0/0xcf0 [xt_conntrack]
[ 5654.158874][ T44] do_one_initcall+0x8c/0x1d0
[ 5654.159104][ T44] ? trace_initcall_start+0x130/0x130
[ 5654.159351][ T44] ? rcu_is_watching+0x12/0xb0
[ 5654.159576][ T44] ? trace_kmalloc+0x26/0xd0
[ 5654.159808][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5654.160029][ T44] ? debug_objects_oom+0x160/0x160
[ 5654.160264][ T44] ? kasan_unpoison+0x27/0x50
[ 5654.160483][ T44] ? __asan_register_globals+0x5d/0x70
[ 5654.160708][ T44] do_init_module+0x27a/0x860
[ 5654.160950][ T44] ? free_module+0x2f0/0x2f0
[ 5654.161170][ T44] ? kfree+0x21d/0x540
[ 5654.161346][ T44] ? load_module+0x20c5/0x2dd0
[ 5654.161573][ T44] load_module+0x1f40/0x2dd0
[ 5654.161815][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5654.162094][ T44] ? kernel_read_file+0x3ed/0x550
[ 5654.162326][ T44] ? kernel_read_file+0x3c8/0x550
[ 5654.162551][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5654.162785][ T44] ? init_module_from_file+0xe9/0x150
[ 5654.163004][ T44] init_module_from_file+0xe9/0x150
[ 5654.163233][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5654.163470][ T44] ? idempotent_init_module+0x316/0x610
[ 5654.163688][ T44] ? __lock_release+0x5d/0x170
[ 5654.163912][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5654.164144][ T44] idempotent_init_module+0x331/0x610
[ 5654.164375][ T44] ? init_module_from_file+0x150/0x150
[ 5654.164607][ T44] ? cap_capable+0x94/0x230
[ 5654.164834][ T44] __x64_sys_finit_module+0xca/0x150
[ 5654.165055][ T44] ? do_syscall_64+0x85/0xfd0
[ 5654.165288][ T44] do_syscall_64+0xc1/0xfd0
[ 5654.165512][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5654.165792][ T44] RIP: 0033:0x7fcb7084192d
[ 5654.166021][ T44] RSP: 002b:00007ffc013e67b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5654.166368][ T44] RAX: ffffffffffffffda RBX: 0000562eb053bac0 RCX: 00007fcb7084192d
[ 5654.166705][ T44] RDX: 0000000000000000 RSI: 0000562e9121ca2a RDI: 0000000000000005
[ 5654.167040][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc013e68f0
[ 5654.167391][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562e9121ca2a
[ 5654.167726][ T44] R13: 0000562eb053bb60 R14: 0000562eb053bda0 R15: 0000000000000000
[ 5654.168077][ T44]
[ 5654.168261][ T44] INFO: task modprobe:31234 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5654.168742][ T44] task:kworker/u16:0 state:R running task stack:24432 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5654.169294][ T44] Workqueue: netns cleanup_net
[ 5654.169529][ T44] Call Trace:
[ 5654.169694][ T44]
[ 5654.169815][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5654.170037][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5654.170265][ T44] ? rcu_is_watching+0x12/0xb0
[ 5654.170502][ T44] ? rcu_is_watching+0x12/0xb0
[ 5654.170724][ T44] ? trace_contention_end+0xd8/0x140
[ 5654.170944][ T44] ? __mutex_lock+0x19f/0x1190
[ 5654.171168][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5654.171408][ T44] ? irqentry_exit+0x3b/0x80
[ 5654.171638][ T44] ? common_interrupt+0x9b/0xe0
[ 5654.171873][ T44] ? asm_common_interrupt+0x26/0x40
[ 5654.172112][ T44] ? nf_ct_iterate_cleanup+0x92/0x340 [nf_conntrack]
[ 5654.172412][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5654.172751][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5654.173091][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5654.173434][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5654.173784][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5654.174075][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5654.174368][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5654.174594][ T44] ? ops_undo_list+0x2bf/0x890
[ 5654.174821][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5654.175040][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5654.175275][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5654.175503][ T44] ? net_passive_dec+0x190/0x190
[ 5654.175727][ T44] ? rcu_is_watching+0x12/0xb0
[ 5654.175951][ T44] ? process_one_work+0xe35/0x1650
[ 5654.176182][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5654.176417][ T44] ? assign_work+0x168/0x240
[ 5654.176644][ T44] ? worker_thread+0x591/0xcf0
[ 5654.176876][ T44] ? rescuer_thread+0xd10/0xd10
[ 5654.177103][ T44] ? kthread+0x37b/0x5f0
[ 5654.177282][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5654.177500][ T44] ? ret_from_fork+0x1b/0x270
[ 5654.177721][ T44] ? __lock_release+0x5d/0x170
[ 5654.177949][ T44] ? rcu_is_watching+0x12/0xb0
[ 5654.178171][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5654.178402][ T44] ? ret_from_fork+0x1db/0x270
[ 5654.178621][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5654.178840][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5654.179082][ T44]
[ 5654.179256][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings
[ 5654.179664][ T44]
[ 5654.179664][ T44] Showing all locks held in the system:
[ 5654.179980][ T44] 5 locks held by kworker/u16:0/12:
[ 5654.180373][ T44] 1 lock held by khungtaskd/44:
[ 5654.180586][ T44] #0: ffffffff89f88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5654.181001][ T44] 1 lock held by modprobe/31234:
[ 5654.181217][ T44] #0: ffffffff8a680310 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5654.181663][ T44]
[ 5654.181781][ T44] =============================================
[ 5654.181781][ T44]
WAIT TIMEOUT stderr
Ctrl-C stderr
Ctrl-C stderr