[ 4286.624270][ T816] pktgen: Packet Generator for packet performance testing. Version: 2.75
[ 4425.347753][ T44] INFO: task modprobe:816 blocked for more than 122 seconds.
[ 4425.348394][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 4425.348630][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4425.349062][ T44] task:modprobe state:D stack:25664 pid:816 tgid:816 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4425.349675][ T44] Call Trace:
[ 4425.349873][ T44]
[ 4425.350042][ T44] __schedule+0x880/0x1b10
[ 4425.350381][ T44] ? io_schedule_timeout+0x150/0x150
[ 4425.350749][ T44] ? schedule+0x1ee/0x270
[ 4425.350994][ T44] ? __lock_release+0x5d/0x170
[ 4425.351324][ T44] schedule+0xe2/0x270
[ 4425.351538][ T44] schedule_preempt_disabled+0x18/0x30
[ 4425.351899][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4425.352224][ T44] ? __lock_acquire+0x449/0x7e0
[ 4425.352513][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4425.352836][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.353138][ T44] ? lock_acquire+0x104/0x160
[ 4425.353448][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4425.353878][ T44] down_write+0x1d6/0x200
[ 4425.354158][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4425.354620][ T44] ? find_held_lock+0x2b/0x80
[ 4425.355017][ T44] ? __create_object+0x5e/0xb0
[ 4425.355410][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4425.355828][ T44] register_pernet_subsys+0x1a/0x40
[ 4425.356208][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4425.356588][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4425.356985][ T44] do_one_initcall+0x8c/0x1d0
[ 4425.357359][ T44] ? trace_initcall_start+0x130/0x130
[ 4425.357661][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.358260][ T44] ? trace_kmalloc+0x26/0xd0
[ 4425.358525][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4425.358790][ T44] ? debug_objects_oom+0x160/0x160
[ 4425.359036][ T44] ? kasan_unpoison+0x27/0x50
[ 4425.359268][ T44] ? __asan_register_globals+0x5d/0x70
[ 4425.359581][ T44] do_init_module+0x27a/0x860
[ 4425.359916][ T44] ? free_module+0x2f0/0x2f0
[ 4425.360151][ T44] ? kfree+0x21d/0x540
[ 4425.360351][ T44] ? load_module+0x20c5/0x2dd0
[ 4425.360715][ T44] load_module+0x1f40/0x2dd0
[ 4425.361017][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4425.361308][ T44] ? kernel_read_file+0x3ed/0x550
[ 4425.361550][ T44] ? kernel_read_file+0x3c8/0x550
[ 4425.361803][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4425.362044][ T44] ? init_module_from_file+0xe9/0x150
[ 4425.362275][ T44] init_module_from_file+0xe9/0x150
[ 4425.362518][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4425.362833][ T44] ? idempotent_init_module+0x316/0x610
[ 4425.363146][ T44] ? __lock_release+0x5d/0x170
[ 4425.363384][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4425.363625][ T44] idempotent_init_module+0x331/0x610
[ 4425.363880][ T44] ? init_module_from_file+0x150/0x150
[ 4425.364125][ T44] ? cap_capable+0x94/0x230
[ 4425.364383][ T44] __x64_sys_finit_module+0xca/0x150
[ 4425.364663][ T44] ? do_syscall_64+0x85/0xfd0
[ 4425.364951][ T44] do_syscall_64+0xc1/0xfd0
[ 4425.365232][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4425.365527][ T44] RIP: 0033:0x7f6e1b7c392d
[ 4425.365879][ T44] RSP: 002b:00007ffef2099ed8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4425.366251][ T44] RAX: ffffffffffffffda RBX: 000055678e9a6ac0 RCX: 00007f6e1b7c392d
[ 4425.366624][ T44] RDX: 0000000000000000 RSI: 0000556751736a2a RDI: 0000000000000005
[ 4425.367122][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffef209a010
[ 4425.367478][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000556751736a2a
[ 4425.367920][ T44] R13: 000055678e9a6b60 R14: 000055678e9a6da0 R15: 0000000000000000
[ 4425.368377][ T44]
[ 4425.368583][ T44] INFO: task modprobe:816 blocked on an rw-semaphore likely owned by task kworker/u16:1:68
[ 4425.369186][ T44] task:kworker/u16:1 state:R running task stack:25920 pid:68 tgid:68 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4425.369876][ T44] Workqueue: netns cleanup_net
[ 4425.370119][ T44] Call Trace:
[ 4425.370306][ T44]
[ 4425.370426][ T44] ? __mutex_lock+0x19f/0x1190
[ 4425.370744][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4425.371125][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4425.371596][ T44] ? ww_mutex_lock+0x160/0x160
[ 4425.372033][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4425.372505][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4425.373018][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4425.373611][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4425.374210][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4425.374813][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4425.375320][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4425.375825][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4425.376228][ T44] ? ops_undo_list+0x2bf/0x890
[ 4425.376614][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4425.377017][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4425.377412][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4425.377808][ T44] ? net_passive_dec+0x190/0x190
[ 4425.378219][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.378600][ T44] ? process_one_work+0xe35/0x1650
[ 4425.379041][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4425.379436][ T44] ? assign_work+0x168/0x240
[ 4425.379843][ T44] ? worker_thread+0x591/0xcf0
[ 4425.380243][ T44] ? rescuer_thread+0xd10/0xd10
[ 4425.380671][ T44] ? kthread+0x37b/0x5f0
[ 4425.380965][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4425.381346][ T44] ? ret_from_fork+0x1b/0x270
[ 4425.381735][ T44] ? __lock_release+0x5d/0x170
[ 4425.382115][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.382499][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4425.382913][ T44] ? ret_from_fork+0x1db/0x270
[ 4425.383305][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4425.383698][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4425.384116][ T44]
[ 4425.384423][ T44]
[ 4425.384423][ T44] Showing all locks held in the system:
[ 4425.384998][ T44] 1 lock held by khungtaskd/44:
[ 4425.385372][ T44] #0: ffffffff91d88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4425.386048][ T44] 4 locks held by kworker/u16:1/68:
[ 4425.386442][ T44] 1 lock held by modprobe/816:
[ 4425.386834][ T44] #0: ffffffff924800d0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4425.387640][ T44]
[ 4425.387861][ T44] =============================================
[ 4425.387861][ T44]
[ 4548.227755][ T44] INFO: task modprobe:816 blocked for more than 245 seconds.
[ 4548.228222][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 4548.228432][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4548.228829][ T44] task:modprobe state:D stack:25664 pid:816 tgid:816 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4548.229327][ T44] Call Trace:
[ 4548.229501][ T44]
[ 4548.229633][ T44] __schedule+0x880/0x1b10
[ 4548.229906][ T44] ? io_schedule_timeout+0x150/0x150
[ 4548.230141][ T44] ? schedule+0x1ee/0x270
[ 4548.230306][ T44] ? __lock_release+0x5d/0x170
[ 4548.230534][ T44] schedule+0xe2/0x270
[ 4548.230714][ T44] schedule_preempt_disabled+0x18/0x30
[ 4548.230939][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4548.231164][ T44] ? __lock_acquire+0x449/0x7e0
[ 4548.231392][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4548.231622][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.231857][ T44] ? lock_acquire+0x104/0x160
[ 4548.232077][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4548.232309][ T44] down_write+0x1d6/0x200
[ 4548.232475][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4548.232760][ T44] ? find_held_lock+0x2b/0x80
[ 4548.232986][ T44] ? __create_object+0x5e/0xb0
[ 4548.233220][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4548.233449][ T44] register_pernet_subsys+0x1a/0x40
[ 4548.233680][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4548.233905][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4548.234126][ T44] do_one_initcall+0x8c/0x1d0
[ 4548.234347][ T44] ? trace_initcall_start+0x130/0x130
[ 4548.234565][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.234805][ T44] ? trace_kmalloc+0x26/0xd0
[ 4548.235028][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4548.235248][ T44] ? debug_objects_oom+0x160/0x160
[ 4548.235471][ T44] ? kasan_unpoison+0x27/0x50
[ 4548.235701][ T44] ? __asan_register_globals+0x5d/0x70
[ 4548.235929][ T44] do_init_module+0x27a/0x860
[ 4548.236158][ T44] ? free_module+0x2f0/0x2f0
[ 4548.236383][ T44] ? kfree+0x21d/0x540
[ 4548.236550][ T44] ? load_module+0x20c5/0x2dd0
[ 4548.236783][ T44] load_module+0x1f40/0x2dd0
[ 4548.237017][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4548.237287][ T44] ? kernel_read_file+0x3ed/0x550
[ 4548.237510][ T44] ? kernel_read_file+0x3c8/0x550
[ 4548.237741][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4548.237967][ T44] ? init_module_from_file+0xe9/0x150
[ 4548.238199][ T44] init_module_from_file+0xe9/0x150
[ 4548.238418][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4548.238664][ T44] ? idempotent_init_module+0x316/0x610
[ 4548.238887][ T44] ? __lock_release+0x5d/0x170
[ 4548.239108][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4548.239331][ T44] idempotent_init_module+0x331/0x610
[ 4548.239561][ T44] ? init_module_from_file+0x150/0x150
[ 4548.239812][ T44] ? cap_capable+0x94/0x230
[ 4548.240040][ T44] __x64_sys_finit_module+0xca/0x150
[ 4548.240260][ T44] ? do_syscall_64+0x85/0xfd0
[ 4548.240480][ T44] do_syscall_64+0xc1/0xfd0
[ 4548.240711][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4548.240989][ T44] RIP: 0033:0x7f6e1b7c392d
[ 4548.241224][ T44] RSP: 002b:00007ffef2099ed8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4548.241555][ T44] RAX: ffffffffffffffda RBX: 000055678e9a6ac0 RCX: 00007f6e1b7c392d
[ 4548.241900][ T44] RDX: 0000000000000000 RSI: 0000556751736a2a RDI: 0000000000000005
[ 4548.242228][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffef209a010
[ 4548.242554][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000556751736a2a
[ 4548.242899][ T44] R13: 000055678e9a6b60 R14: 000055678e9a6da0 R15: 0000000000000000
[ 4548.243245][ T44]
[ 4548.243430][ T44] INFO: task modprobe:816 blocked on an rw-semaphore likely owned by task kworker/u16:1:68
[ 4548.243906][ T44] task:kworker/u16:1 state:R running task stack:25920 pid:68 tgid:68 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4548.244454][ T44] Workqueue: netns cleanup_net
[ 4548.244690][ T44] Call Trace:
[ 4548.244855][ T44]
[ 4548.244970][ T44] ? __mutex_lock+0x19f/0x1190
[ 4548.245193][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4548.245418][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4548.245724][ T44] ? ww_mutex_lock+0x160/0x160
[ 4548.245964][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4548.246245][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4548.246525][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4548.246876][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4548.247210][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4548.247552][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4548.247851][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4548.248129][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4548.248352][ T44] ? ops_undo_list+0x2bf/0x890
[ 4548.248578][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4548.248807][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4548.249040][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4548.249260][ T44] ? net_passive_dec+0x190/0x190
[ 4548.249486][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.249727][ T44] ? process_one_work+0xe35/0x1650
[ 4548.249959][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4548.250186][ T44] ? assign_work+0x168/0x240
[ 4548.250407][ T44] ? worker_thread+0x591/0xcf0
[ 4548.250634][ T44] ? rescuer_thread+0xd10/0xd10
[ 4548.250874][ T44] ? kthread+0x37b/0x5f0
[ 4548.251052][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.251268][ T44] ? ret_from_fork+0x1b/0x270
[ 4548.251492][ T44] ? __lock_release+0x5d/0x170
[ 4548.251723][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.251951][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.252173][ T44] ? ret_from_fork+0x1db/0x270
[ 4548.252393][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.252617][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4548.252866][ T44]
[ 4548.253040][ T44]
[ 4548.253040][ T44] Showing all locks held in the system:
[ 4548.253367][ T44] 1 lock held by khungtaskd/44:
[ 4548.253578][ T44] #0: ffffffff91d88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4548.253973][ T44] 4 locks held by kworker/u16:1/68:
[ 4548.254205][ T44] 1 lock held by modprobe/816:
[ 4548.254416][ T44] #0: ffffffff924800d0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4548.254852][ T44]
[ 4548.254960][ T44] =============================================
[ 4548.254960][ T44]
[ 4671.107805][ T44] INFO: task modprobe:816 blocked for more than 368 seconds.
[ 4671.108829][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 4671.109099][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4671.109542][ T44] task:modprobe state:D stack:25664 pid:816 tgid:816 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4671.110135][ T44] Call Trace:
[ 4671.110331][ T44]
[ 4671.110470][ T44] __schedule+0x880/0x1b10
[ 4671.110761][ T44] ? io_schedule_timeout+0x150/0x150
[ 4671.111035][ T44] ? schedule+0x1ee/0x270
[ 4671.111228][ T44] ? __lock_release+0x5d/0x170
[ 4671.111504][ T44] schedule+0xe2/0x270
[ 4671.111717][ T44] schedule_preempt_disabled+0x18/0x30
[ 4671.111976][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4671.112238][ T44] ? __lock_acquire+0x449/0x7e0
[ 4671.112496][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4671.112777][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.113038][ T44] ? lock_acquire+0x104/0x160
[ 4671.113310][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4671.113581][ T44] down_write+0x1d6/0x200
[ 4671.113792][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4671.114111][ T44] ? find_held_lock+0x2b/0x80
[ 4671.114370][ T44] ? __create_object+0x5e/0xb0
[ 4671.114631][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4671.114913][ T44] register_pernet_subsys+0x1a/0x40
[ 4671.115183][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4671.115445][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4671.115719][ T44] do_one_initcall+0x8c/0x1d0
[ 4671.115981][ T44] ? trace_initcall_start+0x130/0x130
[ 4671.116237][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.116498][ T44] ? trace_kmalloc+0x26/0xd0
[ 4671.116765][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4671.117032][ T44] ? debug_objects_oom+0x160/0x160
[ 4671.117292][ T44] ? kasan_unpoison+0x27/0x50
[ 4671.117551][ T44] ? __asan_register_globals+0x5d/0x70
[ 4671.117826][ T44] do_init_module+0x27a/0x860
[ 4671.118094][ T44] ? free_module+0x2f0/0x2f0
[ 4671.118351][ T44] ? kfree+0x21d/0x540
[ 4671.118546][ T44] ? load_module+0x20c5/0x2dd0
[ 4671.118819][ T44] load_module+0x1f40/0x2dd0
[ 4671.119111][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4671.119429][ T44] ? kernel_read_file+0x3ed/0x550
[ 4671.119700][ T44] ? kernel_read_file+0x3c8/0x550
[ 4671.119961][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4671.120226][ T44] ? init_module_from_file+0xe9/0x150
[ 4671.120483][ T44] init_module_from_file+0xe9/0x150
[ 4671.120754][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4671.121037][ T44] ? idempotent_init_module+0x316/0x610
[ 4671.121292][ T44] ? __lock_release+0x5d/0x170
[ 4671.121551][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4671.121821][ T44] idempotent_init_module+0x331/0x610
[ 4671.122082][ T44] ? init_module_from_file+0x150/0x150
[ 4671.122352][ T44] ? cap_capable+0x94/0x230
[ 4671.122618][ T44] __x64_sys_finit_module+0xca/0x150
[ 4671.122894][ T44] ? do_syscall_64+0x85/0xfd0
[ 4671.123158][ T44] do_syscall_64+0xc1/0xfd0
[ 4671.123421][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4671.123755][ T44] RIP: 0033:0x7f6e1b7c392d
[ 4671.124024][ T44] RSP: 002b:00007ffef2099ed8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4671.124410][ T44] RAX: ffffffffffffffda RBX: 000055678e9a6ac0 RCX: 00007f6e1b7c392d
[ 4671.124817][ T44] RDX: 0000000000000000 RSI: 0000556751736a2a RDI: 0000000000000005
[ 4671.125206][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffef209a010
[ 4671.125589][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000556751736a2a
[ 4671.125985][ T44] R13: 000055678e9a6b60 R14: 000055678e9a6da0 R15: 0000000000000000
[ 4671.126397][ T44]
[ 4671.126616][ T44] INFO: task modprobe:816 blocked on an rw-semaphore likely owned by task kworker/u16:1:68
[ 4671.127179][ T44] task:kworker/u16:1 state:R running task stack:25920 pid:68 tgid:68 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4671.127825][ T44] Workqueue: netns cleanup_net
[ 4671.128097][ T44] Call Trace:
[ 4671.128295][ T44]
[ 4671.128427][ T44] ? __mutex_lock+0x19f/0x1190
[ 4671.128705][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4671.128980][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4671.129317][ T44] ? ww_mutex_lock+0x160/0x160
[ 4671.129594][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4671.129938][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4671.130276][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4671.130683][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4671.131078][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4671.131472][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4671.131816][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4671.132153][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4671.132421][ T44] ? ops_undo_list+0x2bf/0x890
[ 4671.132695][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4671.132953][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4671.133220][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4671.133478][ T44] ? net_passive_dec+0x190/0x190
[ 4671.133749][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.134039][ T44] ? process_one_work+0xe35/0x1650
[ 4671.134308][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4671.134573][ T44] ? assign_work+0x168/0x240
[ 4671.134844][ T44] ? worker_thread+0x591/0xcf0
[ 4671.135111][ T44] ? rescuer_thread+0xd10/0xd10
[ 4671.135370][ T44] ? kthread+0x37b/0x5f0
[ 4671.135567][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.135835][ T44] ? ret_from_fork+0x1b/0x270
[ 4671.136100][ T44] ? __lock_release+0x5d/0x170
[ 4671.136358][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.136615][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.136884][ T44] ? ret_from_fork+0x1db/0x270
[ 4671.137143][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.137399][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4671.137680][ T44]
[ 4671.137893][ T44]
[ 4671.137893][ T44] Showing all locks held in the system:
[ 4671.138276][ T44] 1 lock held by khungtaskd/44:
[ 4671.138524][ T44] #0: ffffffff91d88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4671.138996][ T44] 4 locks held by kworker/u16:1/68:
[ 4671.139261][ T44] 1 lock held by modprobe/816:
[ 4671.139507][ T44] #0: ffffffff924800d0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4671.140028][ T44]
[ 4671.140155][ T44] =============================================
[ 4671.140155][ T44]
[ 4793.987734][ T44] INFO: task modprobe:816 blocked for more than 491 seconds.
[ 4793.988235][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 4793.988509][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4793.988977][ T44] task:modprobe state:D stack:25664 pid:816 tgid:816 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4793.989579][ T44] Call Trace:
[ 4793.989810][ T44]
[ 4793.989953][ T44] __schedule+0x880/0x1b10
[ 4793.990227][ T44] ? io_schedule_timeout+0x150/0x150
[ 4793.990499][ T44] ? schedule+0x1ee/0x270
[ 4793.990708][ T44] ? __lock_release+0x5d/0x170
[ 4793.990974][ T44] schedule+0xe2/0x270
[ 4793.991171][ T44] schedule_preempt_disabled+0x18/0x30
[ 4793.991440][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4793.991714][ T44] ? __lock_acquire+0x449/0x7e0
[ 4793.991972][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4793.992243][ T44] ? rcu_is_watching+0x12/0xb0
[ 4793.992501][ T44] ? lock_acquire+0x104/0x160
[ 4793.992770][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4793.993043][ T44] down_write+0x1d6/0x200
[ 4793.993251][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4793.993572][ T44] ? find_held_lock+0x2b/0x80
[ 4793.993865][ T44] ? __create_object+0x5e/0xb0
[ 4793.994136][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4793.994403][ T44] register_pernet_subsys+0x1a/0x40
[ 4793.994677][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4793.994940][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4793.995208][ T44] do_one_initcall+0x8c/0x1d0
[ 4793.995469][ T44] ? trace_initcall_start+0x130/0x130
[ 4793.995740][ T44] ? rcu_is_watching+0x12/0xb0
[ 4793.996000][ T44] ? trace_kmalloc+0x26/0xd0
[ 4793.996256][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4793.996512][ T44] ? debug_objects_oom+0x160/0x160
[ 4793.996786][ T44] ? kasan_unpoison+0x27/0x50
[ 4793.997054][ T44] ? __asan_register_globals+0x5d/0x70
[ 4793.997317][ T44] do_init_module+0x27a/0x860
[ 4793.997582][ T44] ? free_module+0x2f0/0x2f0
[ 4793.997867][ T44] ? kfree+0x21d/0x540
[ 4793.998067][ T44] ? load_module+0x20c5/0x2dd0
[ 4793.998339][ T44] load_module+0x1f40/0x2dd0
[ 4793.998609][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4793.998945][ T44] ? kernel_read_file+0x3ed/0x550
[ 4793.999219][ T44] ? kernel_read_file+0x3c8/0x550
[ 4793.999478][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4793.999757][ T44] ? init_module_from_file+0xe9/0x150
[ 4794.000015][ T44] init_module_from_file+0xe9/0x150
[ 4794.000273][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4794.000545][ T44] ? idempotent_init_module+0x316/0x610
[ 4794.000814][ T44] ? __lock_release+0x5d/0x170
[ 4794.001085][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4794.001345][ T44] idempotent_init_module+0x331/0x610
[ 4794.001606][ T44] ? init_module_from_file+0x150/0x150
[ 4794.001901][ T44] ? cap_capable+0x94/0x230
[ 4794.002174][ T44] __x64_sys_finit_module+0xca/0x150
[ 4794.002430][ T44] ? do_syscall_64+0x85/0xfd0
[ 4794.002705][ T44] do_syscall_64+0xc1/0xfd0
[ 4794.002977][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4794.003297][ T44] RIP: 0033:0x7f6e1b7c392d
[ 4794.003570][ T44] RSP: 002b:00007ffef2099ed8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4794.003972][ T44] RAX: ffffffffffffffda RBX: 000055678e9a6ac0 RCX: 00007f6e1b7c392d
[ 4794.004360][ T44] RDX: 0000000000000000 RSI: 0000556751736a2a RDI: 0000000000000005
[ 4794.004762][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffef209a010
[ 4794.005148][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000556751736a2a
[ 4794.005531][ T44] R13: 000055678e9a6b60 R14: 000055678e9a6da0 R15: 0000000000000000
[ 4794.005961][ T44]
[ 4794.006181][ T44] INFO: task modprobe:816 blocked on an rw-semaphore likely owned by task kworker/u16:1:68
[ 4794.006752][ T44] task:kworker/u16:1 state:R running task stack:25920 pid:68 tgid:68 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4794.007386][ T44] Workqueue: netns cleanup_net
[ 4794.007661][ T44] Call Trace:
[ 4794.007857][ T44]
[ 4794.007988][ T44] ? __mutex_lock+0x19f/0x1190
[ 4794.008271][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4794.008538][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4794.008889][ T44] ? ww_mutex_lock+0x160/0x160
[ 4794.009166][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4794.009491][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4794.009845][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4794.010257][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4794.010664][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4794.011062][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4794.011395][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4794.011731][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4794.012003][ T44] ? ops_undo_list+0x2bf/0x890
[ 4794.012268][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4794.012526][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4794.012801][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4794.013063][ T44] ? net_passive_dec+0x190/0x190
[ 4794.013324][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.013589][ T44] ? process_one_work+0xe35/0x1650
[ 4794.013889][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4794.014168][ T44] ? assign_work+0x168/0x240
[ 4794.014433][ T44] ? worker_thread+0x591/0xcf0
[ 4794.014710][ T44] ? rescuer_thread+0xd10/0xd10
[ 4794.014973][ T44] ? kthread+0x37b/0x5f0
[ 4794.015171][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4794.015429][ T44] ? ret_from_fork+0x1b/0x270
[ 4794.015695][ T44] ? __lock_release+0x5d/0x170
[ 4794.015954][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.016219][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4794.016476][ T44] ? ret_from_fork+0x1db/0x270
[ 4794.016738][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4794.016995][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4794.017270][ T44]
[ 4794.017503][ T44]
[ 4794.017503][ T44] Showing all locks held in the system:
[ 4794.018127][ T44] 1 lock held by khungtaskd/44:
[ 4794.018395][ T44] #0: ffffffff91d88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4794.018867][ T44] 4 locks held by kworker/u16:1/68:
[ 4794.019133][ T44] 1 lock held by modprobe/816:
[ 4794.019380][ T44] #0: ffffffff924800d0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4794.019903][ T44]
[ 4794.020031][ T44] =============================================
[ 4794.020031][ T44]
[ 4916.867791][ T44] INFO: task modprobe:816 blocked for more than 614 seconds.
[ 4916.868913][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 4916.869232][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4916.869595][ T44] task:modprobe state:D stack:25664 pid:816 tgid:816 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4916.870108][ T44] Call Trace:
[ 4916.870294][ T44]
[ 4916.870417][ T44] __schedule+0x880/0x1b10
[ 4916.870665][ T44] ? io_schedule_timeout+0x150/0x150
[ 4916.870910][ T44] ? schedule+0x1ee/0x270
[ 4916.871076][ T44] ? __lock_release+0x5d/0x170
[ 4916.871310][ T44] schedule+0xe2/0x270
[ 4916.871477][ T44] schedule_preempt_disabled+0x18/0x30
[ 4916.871708][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4916.871932][ T44] ? __lock_acquire+0x449/0x7e0
[ 4916.872151][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4916.872380][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.872611][ T44] ? lock_acquire+0x104/0x160
[ 4916.872860][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4916.873092][ T44] down_write+0x1d6/0x200
[ 4916.873261][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4916.873531][ T44] ? find_held_lock+0x2b/0x80
[ 4916.873766][ T44] ? __create_object+0x5e/0xb0
[ 4916.873991][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4916.874217][ T44] register_pernet_subsys+0x1a/0x40
[ 4916.874442][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4916.874672][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4916.874893][ T44] do_one_initcall+0x8c/0x1d0
[ 4916.875117][ T44] ? trace_initcall_start+0x130/0x130
[ 4916.875337][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.875554][ T44] ? trace_kmalloc+0x26/0xd0
[ 4916.875783][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4916.876008][ T44] ? debug_objects_oom+0x160/0x160
[ 4916.876236][ T44] ? kasan_unpoison+0x27/0x50
[ 4916.876456][ T44] ? __asan_register_globals+0x5d/0x70
[ 4916.876691][ T44] do_init_module+0x27a/0x860
[ 4916.876921][ T44] ? free_module+0x2f0/0x2f0
[ 4916.877140][ T44] ? kfree+0x21d/0x540
[ 4916.877307][ T44] ? load_module+0x20c5/0x2dd0
[ 4916.877541][ T44] load_module+0x1f40/0x2dd0
[ 4916.877804][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4916.878081][ T44] ? kernel_read_file+0x3ed/0x550
[ 4916.878306][ T44] ? kernel_read_file+0x3c8/0x550
[ 4916.878529][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4916.878761][ T44] ? init_module_from_file+0xe9/0x150
[ 4916.878981][ T44] init_module_from_file+0xe9/0x150
[ 4916.879199][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4916.879442][ T44] ? idempotent_init_module+0x316/0x610
[ 4916.879670][ T44] ? __lock_release+0x5d/0x170
[ 4916.879891][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4916.880111][ T44] idempotent_init_module+0x331/0x610
[ 4916.880332][ T44] ? init_module_from_file+0x150/0x150
[ 4916.880562][ T44] ? cap_capable+0x94/0x230
[ 4916.880801][ T44] __x64_sys_finit_module+0xca/0x150
[ 4916.881028][ T44] ? do_syscall_64+0x85/0xfd0
[ 4916.881251][ T44] do_syscall_64+0xc1/0xfd0
[ 4916.881473][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4916.881755][ T44] RIP: 0033:0x7f6e1b7c392d
[ 4916.881986][ T44] RSP: 002b:00007ffef2099ed8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4916.882318][ T44] RAX: ffffffffffffffda RBX: 000055678e9a6ac0 RCX: 00007f6e1b7c392d
[ 4916.882666][ T44] RDX: 0000000000000000 RSI: 0000556751736a2a RDI: 0000000000000005
[ 4916.882997][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffef209a010
[ 4916.883331][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000556751736a2a
[ 4916.883666][ T44] R13: 000055678e9a6b60 R14: 000055678e9a6da0 R15: 0000000000000000
[ 4916.884021][ T44]
[ 4916.884203][ T44] INFO: task modprobe:816 blocked on an rw-semaphore likely owned by task kworker/u16:1:68
[ 4916.884678][ T44] task:kworker/u16:1 state:R running task stack:25920 pid:68 tgid:68 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4916.885216][ T44] Workqueue: netns cleanup_net
[ 4916.885445][ T44] Call Trace:
[ 4916.885609][ T44]
[ 4916.885735][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 4916.885960][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 4916.886178][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.886400][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.886622][ T44] ? trace_contention_end+0xd8/0x140
[ 4916.886852][ T44] ? __mutex_lock+0x19f/0x1190
[ 4916.887074][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4916.887311][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4916.887603][ T44] ? ww_mutex_lock+0x160/0x160
[ 4916.887853][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4916.888137][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4916.888415][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4916.888770][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4916.889107][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4916.889447][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4916.889743][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4916.890026][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4916.890251][ T44] ? ops_undo_list+0x2bf/0x890
[ 4916.890481][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4916.890709][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4916.890937][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4916.891158][ T44] ? net_passive_dec+0x190/0x190
[ 4916.891379][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.891600][ T44] ? process_one_work+0xe35/0x1650
[ 4916.891839][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4916.892073][ T44] ? assign_work+0x168/0x240
[ 4916.892298][ T44] ? worker_thread+0x591/0xcf0
[ 4916.892528][ T44] ? rescuer_thread+0xd10/0xd10
[ 4916.892758][ T44] ? kthread+0x37b/0x5f0
[ 4916.892927][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.893145][ T44] ? ret_from_fork+0x1b/0x270
[ 4916.893362][ T44] ? __lock_release+0x5d/0x170
[ 4916.893580][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.893817][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.894043][ T44] ? ret_from_fork+0x1db/0x270
[ 4916.894262][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.894482][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4916.894727][ T44]
[ 4916.894907][ T44]
[ 4916.894907][ T44] Showing all locks held in the system:
[ 4916.895229][ T44] 1 lock held by khungtaskd/44:
[ 4916.895440][ T44] #0: ffffffff91d88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4916.895838][ T44] 4 locks held by kworker/u16:1/68:
[ 4916.896061][ T44] 1 lock held by modprobe/816:
[ 4916.896272][ T44] #0: ffffffff924800d0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4916.896710][ T44]
[ 4916.896817][ T44] =============================================
[ 4916.896817][ T44]
[ 5039.747863][ T44] INFO: task modprobe:816 blocked for more than 737 seconds.
[ 5039.748313][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5039.748521][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5039.748919][ T44] task:modprobe state:D stack:25664 pid:816 tgid:816 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5039.749428][ T44] Call Trace:
[ 5039.749593][ T44]
[ 5039.749726][ T44] __schedule+0x880/0x1b10
[ 5039.749961][ T44] ? io_schedule_timeout+0x150/0x150
[ 5039.750191][ T44] ? schedule+0x1ee/0x270
[ 5039.750356][ T44] ? __lock_release+0x5d/0x170
[ 5039.750582][ T44] schedule+0xe2/0x270
[ 5039.750760][ T44] schedule_preempt_disabled+0x18/0x30
[ 5039.750985][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5039.751204][ T44] ? __lock_acquire+0x449/0x7e0
[ 5039.751421][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5039.751662][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.751885][ T44] ? lock_acquire+0x104/0x160
[ 5039.752101][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5039.752329][ T44] down_write+0x1d6/0x200
[ 5039.752502][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5039.752781][ T44] ? find_held_lock+0x2b/0x80
[ 5039.753004][ T44] ? __create_object+0x5e/0xb0
[ 5039.753226][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5039.753452][ T44] register_pernet_subsys+0x1a/0x40
[ 5039.753684][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5039.753908][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5039.754132][ T44] do_one_initcall+0x8c/0x1d0
[ 5039.754352][ T44] ? trace_initcall_start+0x130/0x130
[ 5039.754569][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.754798][ T44] ? trace_kmalloc+0x26/0xd0
[ 5039.755017][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5039.755231][ T44] ? debug_objects_oom+0x160/0x160
[ 5039.755451][ T44] ? kasan_unpoison+0x27/0x50
[ 5039.755684][ T44] ? __asan_register_globals+0x5d/0x70
[ 5039.755907][ T44] do_init_module+0x27a/0x860
[ 5039.756136][ T44] ? free_module+0x2f0/0x2f0
[ 5039.756353][ T44] ? kfree+0x21d/0x540
[ 5039.756518][ T44] ? load_module+0x20c5/0x2dd0
[ 5039.756751][ T44] load_module+0x1f40/0x2dd0
[ 5039.756990][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5039.757259][ T44] ? kernel_read_file+0x3ed/0x550
[ 5039.757485][ T44] ? kernel_read_file+0x3c8/0x550
[ 5039.757714][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5039.757938][ T44] ? init_module_from_file+0xe9/0x150
[ 5039.758157][ T44] init_module_from_file+0xe9/0x150
[ 5039.758375][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5039.758609][ T44] ? idempotent_init_module+0x316/0x610
[ 5039.758839][ T44] ? __lock_release+0x5d/0x170
[ 5039.759063][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5039.759284][ T44] idempotent_init_module+0x331/0x610
[ 5039.759506][ T44] ? init_module_from_file+0x150/0x150
[ 5039.759746][ T44] ? cap_capable+0x94/0x230
[ 5039.759974][ T44] __x64_sys_finit_module+0xca/0x150
[ 5039.760193][ T44] ? do_syscall_64+0x85/0xfd0
[ 5039.760419][ T44] do_syscall_64+0xc1/0xfd0
[ 5039.760665][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5039.760939][ T44] RIP: 0033:0x7f6e1b7c392d
[ 5039.761167][ T44] RSP: 002b:00007ffef2099ed8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5039.761499][ T44] RAX: ffffffffffffffda RBX: 000055678e9a6ac0 RCX: 00007f6e1b7c392d
[ 5039.761835][ T44] RDX: 0000000000000000 RSI: 0000556751736a2a RDI: 0000000000000005
[ 5039.762167][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffef209a010
[ 5039.762493][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000556751736a2a
[ 5039.762825][ T44] R13: 000055678e9a6b60 R14: 000055678e9a6da0 R15: 0000000000000000
[ 5039.763169][ T44]
[ 5039.763352][ T44] INFO: task modprobe:816 blocked on an rw-semaphore likely owned by task kworker/u16:1:68
[ 5039.763828][ T44] task:kworker/u16:1 state:R running task stack:25920 pid:68 tgid:68 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5039.764361][ T44] Workqueue: netns cleanup_net
[ 5039.764582][ T44] Call Trace:
[ 5039.764753][ T44]
[ 5039.764871][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5039.765098][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5039.765315][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.765539][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.765767][ T44] ? trace_contention_end+0xd8/0x140
[ 5039.765987][ T44] ? __mutex_lock+0x19f/0x1190
[ 5039.766207][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5039.766428][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5039.766723][ T44] ? ww_mutex_lock+0x160/0x160
[ 5039.766979][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5039.767256][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5039.767531][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5039.767875][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5039.768213][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5039.768546][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5039.768836][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5039.769113][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5039.769336][ T44] ? ops_undo_list+0x2bf/0x890
[ 5039.769562][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5039.769795][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5039.770021][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5039.770243][ T44] ? net_passive_dec+0x190/0x190
[ 5039.770462][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.770691][ T44] ? process_one_work+0xe35/0x1650
[ 5039.770922][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5039.771147][ T44] ? assign_work+0x168/0x240
[ 5039.771367][ T44] ? worker_thread+0x591/0xcf0
[ 5039.771598][ T44] ? rescuer_thread+0xd10/0xd10
[ 5039.771827][ T44] ? kthread+0x37b/0x5f0
[ 5039.771996][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.772214][ T44] ? ret_from_fork+0x1b/0x270
[ 5039.772432][ T44] ? __lock_release+0x5d/0x170
[ 5039.772660][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.772877][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.773095][ T44] ? ret_from_fork+0x1db/0x270
[ 5039.773313][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.773530][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5039.773773][ T44]
[ 5039.773954][ T44]
[ 5039.773954][ T44] Showing all locks held in the system:
[ 5039.774272][ T44] 1 lock held by khungtaskd/44:
[ 5039.774482][ T44] #0: ffffffff91d88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5039.774868][ T44] 4 locks held by kworker/u16:1/68:
[ 5039.775097][ T44] 1 lock held by modprobe/816:
[ 5039.775304][ T44] #0: ffffffff924800d0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5039.775744][ T44]
[ 5039.775849][ T44] =============================================
[ 5039.775849][ T44]
[ 5162.627723][ T44] INFO: task modprobe:816 blocked for more than 860 seconds.
[ 5162.628194][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5162.628438][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5162.628840][ T44] task:modprobe state:D stack:25664 pid:816 tgid:816 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5162.629373][ T44] Call Trace:
[ 5162.629540][ T44]
[ 5162.629674][ T44] __schedule+0x880/0x1b10
[ 5162.629923][ T44] ? io_schedule_timeout+0x150/0x150
[ 5162.630166][ T44] ? schedule+0x1ee/0x270
[ 5162.630339][ T44] ? __lock_release+0x5d/0x170
[ 5162.630579][ T44] schedule+0xe2/0x270
[ 5162.630778][ T44] schedule_preempt_disabled+0x18/0x30
[ 5162.631012][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5162.631259][ T44] ? __lock_acquire+0x449/0x7e0
[ 5162.631483][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5162.631747][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.631977][ T44] ? lock_acquire+0x104/0x160
[ 5162.632218][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5162.632457][ T44] down_write+0x1d6/0x200
[ 5162.632635][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5162.632930][ T44] ? find_held_lock+0x2b/0x80
[ 5162.633163][ T44] ? __create_object+0x5e/0xb0
[ 5162.633398][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5162.633632][ T44] register_pernet_subsys+0x1a/0x40
[ 5162.633884][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5162.634124][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5162.634359][ T44] do_one_initcall+0x8c/0x1d0
[ 5162.634607][ T44] ? trace_initcall_start+0x130/0x130
[ 5162.634843][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.635073][ T44] ? trace_kmalloc+0x26/0xd0
[ 5162.635300][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5162.635549][ T44] ? debug_objects_oom+0x160/0x160
[ 5162.635807][ T44] ? kasan_unpoison+0x27/0x50
[ 5162.636042][ T44] ? __asan_register_globals+0x5d/0x70
[ 5162.636301][ T44] do_init_module+0x27a/0x860
[ 5162.636544][ T44] ? free_module+0x2f0/0x2f0
[ 5162.636787][ T44] ? kfree+0x21d/0x540
[ 5162.636962][ T44] ? load_module+0x20c5/0x2dd0
[ 5162.637201][ T44] load_module+0x1f40/0x2dd0
[ 5162.637457][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5162.637767][ T44] ? kernel_read_file+0x3ed/0x550
[ 5162.638007][ T44] ? kernel_read_file+0x3c8/0x550
[ 5162.638239][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5162.638472][ T44] ? init_module_from_file+0xe9/0x150
[ 5162.638728][ T44] init_module_from_file+0xe9/0x150
[ 5162.638961][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5162.639210][ T44] ? idempotent_init_module+0x316/0x610
[ 5162.639448][ T44] ? __lock_release+0x5d/0x170
[ 5162.639693][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5162.639934][ T44] idempotent_init_module+0x331/0x610
[ 5162.640165][ T44] ? init_module_from_file+0x150/0x150
[ 5162.640406][ T44] ? cap_capable+0x94/0x230
[ 5162.640653][ T44] __x64_sys_finit_module+0xca/0x150
[ 5162.640878][ T44] ? do_syscall_64+0x85/0xfd0
[ 5162.641116][ T44] do_syscall_64+0xc1/0xfd0
[ 5162.641346][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5162.641627][ T44] RIP: 0033:0x7f6e1b7c392d
[ 5162.641876][ T44] RSP: 002b:00007ffef2099ed8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5162.642222][ T44] RAX: ffffffffffffffda RBX: 000055678e9a6ac0 RCX: 00007f6e1b7c392d
[ 5162.642564][ T44] RDX: 0000000000000000 RSI: 0000556751736a2a RDI: 0000000000000005
[ 5162.642921][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffef209a010
[ 5162.643262][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000556751736a2a
[ 5162.643603][ T44] R13: 000055678e9a6b60 R14: 000055678e9a6da0 R15: 0000000000000000
[ 5162.643969][ T44]
[ 5162.644157][ T44] INFO: task modprobe:816 blocked on an rw-semaphore likely owned by task kworker/u16:1:68
[ 5162.644658][ T44] task:kworker/u16:1 state:R running task stack:25920 pid:68 tgid:68 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5162.645217][ T44] Workqueue: netns cleanup_net
[ 5162.645450][ T44] Call Trace:
[ 5162.645626][ T44]
[ 5162.645757][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5162.645995][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5162.646253][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.646486][ T44] ? trace_contention_end+0xd8/0x140
[ 5162.646730][ T44] ? __mutex_lock+0x19f/0x1190
[ 5162.646964][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5162.647201][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5162.647516][ T44] ? ww_mutex_lock+0x160/0x160
[ 5162.647769][ T44] ? _mutex_trylock_nest_lock+0x140/0x140
[ 5162.648004][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5162.648294][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5162.648584][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5162.648941][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5162.649292][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5162.649656][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5162.649953][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5162.650241][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5162.650473][ T44] ? ops_undo_list+0x2bf/0x890
[ 5162.650716][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5162.650949][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5162.651187][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5162.651415][ T44] ? net_passive_dec+0x190/0x190
[ 5162.651656][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.651888][ T44] ? process_one_work+0xe35/0x1650
[ 5162.652129][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5162.652364][ T44] ? assign_work+0x168/0x240
[ 5162.652597][ T44] ? worker_thread+0x591/0xcf0
[ 5162.652845][ T44] ? rescuer_thread+0xd10/0xd10
[ 5162.653074][ T44] ? kthread+0x37b/0x5f0
[ 5162.653251][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.653475][ T44] ? ret_from_fork+0x1b/0x270
[ 5162.653714][ T44] ? __lock_release+0x5d/0x170
[ 5162.653944][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.654172][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.654401][ T44] ? ret_from_fork+0x1db/0x270
[ 5162.654632][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.654868][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5162.655109][ T44]
[ 5162.655301][ T44]
[ 5162.655301][ T44] Showing all locks held in the system:
[ 5162.655635][ T44] 1 lock held by khungtaskd/44:
[ 5162.655864][ T44] #0: ffffffff91d88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5162.656283][ T44] 4 locks held by kworker/u16:1/68:
[ 5162.656530][ T44] 1 lock held by modprobe/816:
[ 5162.656759][ T44] #0: ffffffff924800d0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5162.657220][ T44]
[ 5162.657334][ T44] =============================================
[ 5162.657334][ T44]
[ 5285.507705][ T44] INFO: task modprobe:816 blocked for more than 983 seconds.
[ 5285.508197][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5285.508428][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5285.508838][ T44] task:modprobe state:D stack:25664 pid:816 tgid:816 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5285.509360][ T44] Call Trace:
[ 5285.509536][ T44]
[ 5285.509674][ T44] __schedule+0x880/0x1b10
[ 5285.509925][ T44] ? io_schedule_timeout+0x150/0x150
[ 5285.510181][ T44] ? schedule+0x1ee/0x270
[ 5285.510359][ T44] ? __lock_release+0x5d/0x170
[ 5285.510602][ T44] schedule+0xe2/0x270
[ 5285.510794][ T44] schedule_preempt_disabled+0x18/0x30
[ 5285.511031][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5285.511275][ T44] ? __lock_acquire+0x449/0x7e0
[ 5285.511509][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5285.511764][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.511999][ T44] ? lock_acquire+0x104/0x160
[ 5285.512233][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5285.512485][ T44] down_write+0x1d6/0x200
[ 5285.512668][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5285.513011][ T44] ? find_held_lock+0x2b/0x80
[ 5285.513247][ T44] ? __create_object+0x5e/0xb0
[ 5285.513480][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5285.513748][ T44] register_pernet_subsys+0x1a/0x40
[ 5285.513979][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5285.514212][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5285.514445][ T44] do_one_initcall+0x8c/0x1d0
[ 5285.514689][ T44] ? trace_initcall_start+0x130/0x130
[ 5285.514928][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.515159][ T44] ? trace_kmalloc+0x26/0xd0
[ 5285.515390][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5285.515629][ T44] ? debug_objects_oom+0x160/0x160
[ 5285.515875][ T44] ? kasan_unpoison+0x27/0x50
[ 5285.516109][ T44] ? __asan_register_globals+0x5d/0x70
[ 5285.516344][ T44] do_init_module+0x27a/0x860
[ 5285.516588][ T44] ? free_module+0x2f0/0x2f0
[ 5285.516830][ T44] ? kfree+0x21d/0x540
[ 5285.517007][ T44] ? load_module+0x20c5/0x2dd0
[ 5285.517243][ T44] load_module+0x1f40/0x2dd0
[ 5285.517487][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5285.517783][ T44] ? kernel_read_file+0x3ed/0x550
[ 5285.518018][ T44] ? kernel_read_file+0x3c8/0x550
[ 5285.518253][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5285.518494][ T44] ? init_module_from_file+0xe9/0x150
[ 5285.518736][ T44] init_module_from_file+0xe9/0x150
[ 5285.518968][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5285.519216][ T44] ? idempotent_init_module+0x316/0x610
[ 5285.519447][ T44] ? __lock_release+0x5d/0x170
[ 5285.519691][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5285.519931][ T44] idempotent_init_module+0x331/0x610
[ 5285.520169][ T44] ? init_module_from_file+0x150/0x150
[ 5285.520413][ T44] ? cap_capable+0x94/0x230
[ 5285.520660][ T44] __x64_sys_finit_module+0xca/0x150
[ 5285.520891][ T44] ? do_syscall_64+0x85/0xfd0
[ 5285.521123][ T44] do_syscall_64+0xc1/0xfd0
[ 5285.521356][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5285.521660][ T44] RIP: 0033:0x7f6e1b7c392d
[ 5285.521903][ T44] RSP: 002b:00007ffef2099ed8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5285.522255][ T44] RAX: ffffffffffffffda RBX: 000055678e9a6ac0 RCX: 00007f6e1b7c392d
[ 5285.522602][ T44] RDX: 0000000000000000 RSI: 0000556751736a2a RDI: 0000000000000005
[ 5285.522964][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffef209a010
[ 5285.523315][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000556751736a2a
[ 5285.523668][ T44] R13: 000055678e9a6b60 R14: 000055678e9a6da0 R15: 0000000000000000
[ 5285.524033][ T44]
[ 5285.524221][ T44] INFO: task modprobe:816 blocked on an rw-semaphore likely owned by task kworker/u16:1:68
[ 5285.524720][ T44] task:kworker/u16:1 state:R running task stack:25920 pid:68 tgid:68 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5285.525293][ T44] Workqueue: netns cleanup_net
[ 5285.525542][ T44] Call Trace:
[ 5285.525724][ T44]
[ 5285.525843][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.526080][ T44] ? rcu_read_lock_any_held+0x3f/0xa0
[ 5285.526310][ T44] ? validate_chain+0x15e/0x4d0
[ 5285.526553][ T44] ? __lock_acquire+0x449/0x7e0
[ 5285.526795][ T44] ? update_se+0x3bf/0x560
[ 5285.527029][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5285.527263][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5285.527494][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.527739][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.527971][ T44] ? trace_contention_end+0xd8/0x140
[ 5285.528202][ T44] ? __mutex_lock+0x19f/0x1190
[ 5285.528438][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5285.528683][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5285.528986][ T44] ? ww_mutex_lock+0x160/0x160
[ 5285.529238][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5285.529544][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5285.529849][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5285.530203][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5285.530557][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5285.530917][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5285.531271][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5285.531572][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5285.531879][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5285.532116][ T44] ? ops_undo_list+0x2bf/0x890
[ 5285.532354][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5285.532583][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5285.532833][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5285.533068][ T44] ? net_passive_dec+0x190/0x190
[ 5285.533302][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.533540][ T44] ? process_one_work+0xe35/0x1650
[ 5285.533790][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5285.534033][ T44] ? assign_work+0x168/0x240
[ 5285.534265][ T44] ? worker_thread+0x591/0xcf0
[ 5285.534505][ T44] ? rescuer_thread+0xd10/0xd10
[ 5285.534748][ T44] ? kthread+0x37b/0x5f0
[ 5285.534927][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.535155][ T44] ? ret_from_fork+0x1b/0x270
[ 5285.535389][ T44] ? __lock_release+0x5d/0x170
[ 5285.535628][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.535871][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.536109][ T44] ? ret_from_fork+0x1db/0x270
[ 5285.536338][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.536569][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5285.536836][ T44]
[ 5285.537030][ T44]
[ 5285.537030][ T44] Showing all locks held in the system:
[ 5285.537367][ T44] 1 lock held by khungtaskd/44:
[ 5285.537588][ T44] #0: ffffffff91d88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5285.537997][ T44] 4 locks held by kworker/u16:1/68:
[ 5285.538232][ T44] 1 lock held by modprobe/816:
[ 5285.538450][ T44] #0: ffffffff924800d0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5285.538921][ T44]
[ 5285.539035][ T44] =============================================
[ 5285.539035][ T44]
[ 5408.387711][ T44] INFO: task modprobe:816 blocked for more than 1105 seconds.
[ 5408.388280][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5408.388570][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5408.389086][ T44] task:modprobe state:D stack:25664 pid:816 tgid:816 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5408.389661][ T44] Call Trace:
[ 5408.389836][ T44]
[ 5408.389959][ T44] __schedule+0x880/0x1b10
[ 5408.390206][ T44] ? io_schedule_timeout+0x150/0x150
[ 5408.390453][ T44] ? schedule+0x1ee/0x270
[ 5408.390633][ T44] ? __lock_release+0x5d/0x170
[ 5408.390900][ T44] schedule+0xe2/0x270
[ 5408.391085][ T44] schedule_preempt_disabled+0x18/0x30
[ 5408.391322][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5408.391567][ T44] ? __lock_acquire+0x449/0x7e0
[ 5408.391818][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5408.392073][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.392303][ T44] ? lock_acquire+0x104/0x160
[ 5408.392542][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5408.392792][ T44] down_write+0x1d6/0x200
[ 5408.392988][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5408.393276][ T44] ? find_held_lock+0x2b/0x80
[ 5408.393509][ T44] ? __create_object+0x5e/0xb0
[ 5408.393757][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5408.393995][ T44] register_pernet_subsys+0x1a/0x40
[ 5408.394242][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5408.394475][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5408.394733][ T44] do_one_initcall+0x8c/0x1d0
[ 5408.394995][ T44] ? trace_initcall_start+0x130/0x130
[ 5408.395228][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.395460][ T44] ? trace_kmalloc+0x26/0xd0
[ 5408.395706][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5408.395935][ T44] ? debug_objects_oom+0x160/0x160
[ 5408.396185][ T44] ? kasan_unpoison+0x27/0x50
[ 5408.396422][ T44] ? __asan_register_globals+0x5d/0x70
[ 5408.396668][ T44] do_init_module+0x27a/0x860
[ 5408.396908][ T44] ? free_module+0x2f0/0x2f0
[ 5408.397139][ T44] ? kfree+0x21d/0x540
[ 5408.397315][ T44] ? load_module+0x20c5/0x2dd0
[ 5408.397554][ T44] load_module+0x1f40/0x2dd0
[ 5408.397806][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5408.398098][ T44] ? kernel_read_file+0x3ed/0x550
[ 5408.398335][ T44] ? kernel_read_file+0x3c8/0x550
[ 5408.398577][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5408.398827][ T44] ? init_module_from_file+0xe9/0x150
[ 5408.399058][ T44] init_module_from_file+0xe9/0x150
[ 5408.399288][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5408.399536][ T44] ? idempotent_init_module+0x316/0x610
[ 5408.399778][ T44] ? __lock_release+0x5d/0x170
[ 5408.400019][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5408.400251][ T44] idempotent_init_module+0x331/0x610
[ 5408.400485][ T44] ? init_module_from_file+0x150/0x150
[ 5408.400738][ T44] ? cap_capable+0x94/0x230
[ 5408.400979][ T44] __x64_sys_finit_module+0xca/0x150
[ 5408.401209][ T44] ? do_syscall_64+0x85/0xfd0
[ 5408.401444][ T44] do_syscall_64+0xc1/0xfd0
[ 5408.401690][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5408.401979][ T44] RIP: 0033:0x7f6e1b7c392d
[ 5408.402219][ T44] RSP: 002b:00007ffef2099ed8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5408.402568][ T44] RAX: ffffffffffffffda RBX: 000055678e9a6ac0 RCX: 00007f6e1b7c392d
[ 5408.402927][ T44] RDX: 0000000000000000 RSI: 0000556751736a2a RDI: 0000000000000005
[ 5408.403284][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffef209a010
[ 5408.403633][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000556751736a2a
[ 5408.403988][ T44] R13: 000055678e9a6b60 R14: 000055678e9a6da0 R15: 0000000000000000
[ 5408.404352][ T44]
[ 5408.404540][ T44] INFO: task modprobe:816 blocked on an rw-semaphore likely owned by task kworker/u16:1:68
[ 5408.405053][ T44] task:kworker/u16:1 state:R running task stack:25920 pid:68 tgid:68 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5408.405618][ T44] Workqueue: netns cleanup_net
[ 5408.405862][ T44] Call Trace:
[ 5408.406037][ T44]
[ 5408.406160][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5408.406404][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5408.406635][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.406881][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.407113][ T44] ? trace_contention_end+0xd8/0x140
[ 5408.407348][ T44] ? __mutex_lock+0x19f/0x1190
[ 5408.407579][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5408.407821][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5408.408128][ T44] ? ww_mutex_lock+0x160/0x160
[ 5408.408378][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5408.408683][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5408.408979][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5408.409336][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5408.409694][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5408.410052][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5408.410354][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5408.410658][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5408.410894][ T44] ? ops_undo_list+0x2bf/0x890
[ 5408.411145][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5408.411374][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5408.411617][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5408.411857][ T44] ? net_passive_dec+0x190/0x190
[ 5408.412095][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.412328][ T44] ? process_one_work+0xe35/0x1650
[ 5408.412568][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5408.412817][ T44] ? assign_work+0x168/0x240
[ 5408.413049][ T44] ? worker_thread+0x591/0xcf0
[ 5408.413298][ T44] ? rescuer_thread+0xd10/0xd10
[ 5408.413529][ T44] ? kthread+0x37b/0x5f0
[ 5408.413716][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.413946][ T44] ? ret_from_fork+0x1b/0x270
[ 5408.414180][ T44] ? __lock_release+0x5d/0x170
[ 5408.414411][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.414651][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.414906][ T44] ? ret_from_fork+0x1db/0x270
[ 5408.415135][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.415370][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5408.415616][ T44]
[ 5408.415828][ T44]
[ 5408.415828][ T44] Showing all locks held in the system:
[ 5408.416167][ T44] 1 lock held by khungtaskd/44:
[ 5408.416388][ T44] #0: ffffffff91d88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5408.416935][ T44] 4 locks held by kworker/u16:1/68:
[ 5408.417176][ T44] 1 lock held by modprobe/816:
[ 5408.417395][ T44] #0: ffffffff924800d0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5408.417863][ T44]
[ 5408.417975][ T44] =============================================
[ 5408.417975][ T44]
[ 5531.267705][ T44] INFO: task modprobe:816 blocked for more than 1228 seconds.
[ 5531.268178][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5531.268401][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5531.268811][ T44] task:modprobe state:D stack:25664 pid:816 tgid:816 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5531.269335][ T44] Call Trace:
[ 5531.269513][ T44]
[ 5531.269637][ T44] __schedule+0x880/0x1b10
[ 5531.269909][ T44] ? io_schedule_timeout+0x150/0x150
[ 5531.270153][ T44] ? schedule+0x1ee/0x270
[ 5531.270325][ T44] ? __lock_release+0x5d/0x170
[ 5531.270568][ T44] schedule+0xe2/0x270
[ 5531.270773][ T44] schedule_preempt_disabled+0x18/0x30
[ 5531.271006][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5531.271243][ T44] ? __lock_acquire+0x449/0x7e0
[ 5531.271479][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5531.271733][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.271968][ T44] ? lock_acquire+0x104/0x160
[ 5531.272198][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5531.272440][ T44] down_write+0x1d6/0x200
[ 5531.272615][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5531.272914][ T44] ? find_held_lock+0x2b/0x80
[ 5531.273150][ T44] ? __create_object+0x5e/0xb0
[ 5531.273390][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5531.273629][ T44] register_pernet_subsys+0x1a/0x40
[ 5531.273871][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5531.274106][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5531.274346][ T44] do_one_initcall+0x8c/0x1d0
[ 5531.274583][ T44] ? trace_initcall_start+0x130/0x130
[ 5531.274844][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.275083][ T44] ? trace_kmalloc+0x26/0xd0
[ 5531.275314][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5531.275545][ T44] ? debug_objects_oom+0x160/0x160
[ 5531.275789][ T44] ? kasan_unpoison+0x27/0x50
[ 5531.276022][ T44] ? __asan_register_globals+0x5d/0x70
[ 5531.276256][ T44] do_init_module+0x27a/0x860
[ 5531.276497][ T44] ? free_module+0x2f0/0x2f0
[ 5531.276743][ T44] ? kfree+0x21d/0x540
[ 5531.276921][ T44] ? load_module+0x20c5/0x2dd0
[ 5531.277157][ T44] load_module+0x1f40/0x2dd0
[ 5531.277400][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5531.277699][ T44] ? kernel_read_file+0x3ed/0x550
[ 5531.277935][ T44] ? kernel_read_file+0x3c8/0x550
[ 5531.278168][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5531.278407][ T44] ? init_module_from_file+0xe9/0x150
[ 5531.278666][ T44] init_module_from_file+0xe9/0x150
[ 5531.278901][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5531.279149][ T44] ? idempotent_init_module+0x316/0x610
[ 5531.279378][ T44] ? __lock_release+0x5d/0x170
[ 5531.279613][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5531.279855][ T44] idempotent_init_module+0x331/0x610
[ 5531.280094][ T44] ? init_module_from_file+0x150/0x150
[ 5531.280340][ T44] ? cap_capable+0x94/0x230
[ 5531.280581][ T44] __x64_sys_finit_module+0xca/0x150
[ 5531.280823][ T44] ? do_syscall_64+0x85/0xfd0
[ 5531.281059][ T44] do_syscall_64+0xc1/0xfd0
[ 5531.281292][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5531.281579][ T44] RIP: 0033:0x7f6e1b7c392d
[ 5531.281837][ T44] RSP: 002b:00007ffef2099ed8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5531.282189][ T44] RAX: ffffffffffffffda RBX: 000055678e9a6ac0 RCX: 00007f6e1b7c392d
[ 5531.282547][ T44] RDX: 0000000000000000 RSI: 0000556751736a2a RDI: 0000000000000005
[ 5531.282917][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffef209a010
[ 5531.283263][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000556751736a2a
[ 5531.283614][ T44] R13: 000055678e9a6b60 R14: 000055678e9a6da0 R15: 0000000000000000
[ 5531.283986][ T44]
[ 5531.284181][ T44] INFO: task modprobe:816 blocked on an rw-semaphore likely owned by task kworker/u16:1:68
[ 5531.284692][ T44] task:kworker/u16:1 state:R running task stack:25920 pid:68 tgid:68 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5531.285263][ T44] Workqueue: netns cleanup_net
[ 5531.285503][ T44] Call Trace:
[ 5531.285685][ T44]
[ 5531.285805][ T44] ? __mutex_lock+0x19f/0x1190
[ 5531.286039][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5531.286276][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5531.286583][ T44] ? ww_mutex_lock+0x160/0x160
[ 5531.286860][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5531.287157][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5531.287449][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5531.287815][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5531.288170][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5531.288530][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5531.288838][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5531.289133][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5531.289370][ T44] ? ops_undo_list+0x2bf/0x890
[ 5531.289606][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5531.289843][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5531.290087][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5531.290322][ T44] ? net_passive_dec+0x190/0x190
[ 5531.290557][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.290815][ T44] ? process_one_work+0xe35/0x1650
[ 5531.291059][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5531.291297][ T44] ? assign_work+0x168/0x240
[ 5531.291532][ T44] ? worker_thread+0x591/0xcf0
[ 5531.291784][ T44] ? rescuer_thread+0xd10/0xd10
[ 5531.292024][ T44] ? kthread+0x37b/0x5f0
[ 5531.292200][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.292430][ T44] ? ret_from_fork+0x1b/0x270
[ 5531.292669][ T44] ? __lock_release+0x5d/0x170
[ 5531.292904][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.293135][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.293367][ T44] ? ret_from_fork+0x1db/0x270
[ 5531.293595][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.293837][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5531.294084][ T44]
[ 5531.294286][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings
[ 5531.294739][ T44]
[ 5531.294739][ T44] Showing all locks held in the system:
[ 5531.295077][ T44] 1 lock held by khungtaskd/44:
[ 5531.295300][ T44] #0: ffffffff91d88580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5531.296107][ T44] 4 locks held by kworker/u16:1/68:
[ 5531.296342][ T44] 1 lock held by modprobe/816:
[ 5531.296563][ T44] #0: ffffffff924800d0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5531.297034][ T44]
[ 5531.297148][ T44] =============================================
[ 5531.297148][ T44]
WAIT TIMEOUT stderr
Ctrl-C stderr
Ctrl-C stderr