[ 4191.264757][ T524] pktgen: Packet Generator for packet performance testing. Version: 2.75
[ 4425.376383][ T44] INFO: task modprobe:524 blocked for more than 122 seconds.
[ 4425.376944][ T44] Not tainted 6.18.0-rc5-virtme #1
[ 4425.377159][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4425.377520][ T44] task:modprobe state:D stack:25664 pid:524 tgid:524 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4425.378066][ T44] Call Trace:
[ 4425.378241][ T44]
[ 4425.378365][ T44] __schedule+0x880/0x1b10
[ 4425.378630][ T44] ? io_schedule_timeout+0x150/0x150
[ 4425.378877][ T44] ? schedule+0x1ee/0x270
[ 4425.379047][ T44] ? __lock_release+0x5d/0x170
[ 4425.379286][ T44] schedule+0xe2/0x270
[ 4425.379453][ T44] schedule_preempt_disabled+0x18/0x30
[ 4425.379685][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4425.379919][ T44] ? __lock_acquire+0x449/0x7e0
[ 4425.380141][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4425.380370][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.380595][ T44] ? lock_acquire+0x104/0x160
[ 4425.380820][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4425.381063][ T44] down_write+0x1d6/0x200
[ 4425.381228][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4425.381511][ T44] ? find_held_lock+0x2b/0x80
[ 4425.381751][ T44] ? __create_object+0x5e/0xb0
[ 4425.381990][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 4425.382216][ T44] register_pernet_subsys+0x1a/0x40
[ 4425.382436][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4425.382659][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 4425.382889][ T44] do_one_initcall+0x8c/0x1d0
[ 4425.383135][ T44] ? trace_initcall_start+0x130/0x130
[ 4425.383664][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.383894][ T44] ? trace_kmalloc+0x26/0xd0
[ 4425.384118][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4425.384339][ T44] ? debug_objects_oom+0x160/0x160
[ 4425.384573][ T44] ? kasan_unpoison+0x27/0x50
[ 4425.384800][ T44] ? __asan_register_globals+0x5d/0x70
[ 4425.385034][ T44] do_init_module+0x27a/0x860
[ 4425.385269][ T44] ? free_module+0x2f0/0x2f0
[ 4425.385488][ T44] ? kfree+0x21d/0x540
[ 4425.385653][ T44] ? load_module+0x20c5/0x2dd0
[ 4425.385898][ T44] load_module+0x1f40/0x2dd0
[ 4425.386131][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4425.386401][ T44] ? kernel_read_file+0x3ed/0x550
[ 4425.386628][ T44] ? kernel_read_file+0x3c8/0x550
[ 4425.386866][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4425.387094][ T44] ? init_module_from_file+0xe9/0x150
[ 4425.387313][ T44] init_module_from_file+0xe9/0x150
[ 4425.387532][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4425.387774][ T44] ? idempotent_init_module+0x316/0x610
[ 4425.387993][ T44] ? __lock_release+0x5d/0x170
[ 4425.388222][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4425.388441][ T44] idempotent_init_module+0x331/0x610
[ 4425.388662][ T44] ? init_module_from_file+0x150/0x150
[ 4425.388904][ T44] ? cap_capable+0x94/0x230
[ 4425.389151][ T44] __x64_sys_finit_module+0xca/0x150
[ 4425.389370][ T44] ? do_syscall_64+0x85/0xfd0
[ 4425.389600][ T44] do_syscall_64+0xc1/0xfd0
[ 4425.389843][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4425.390127][ T44] RIP: 0033:0x7f3257c4992d
[ 4425.390362][ T44] RSP: 002b:00007ffe11740368 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4425.390700][ T44] RAX: ffffffffffffffda RBX: 000055a639e11ac0 RCX: 00007f3257c4992d
[ 4425.391039][ T44] RDX: 0000000000000000 RSI: 000055a62d638a2a RDI: 0000000000000005
[ 4425.391414][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe117404a0
[ 4425.391753][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055a62d638a2a
[ 4425.392090][ T44] R13: 000055a639e11b60 R14: 000055a639e11da0 R15: 0000000000000000
[ 4425.392438][ T44]
[ 4425.392611][ T44] INFO: task modprobe:524 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4425.393099][ T44] task:kworker/u16:0 state:R running task stack:25856 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4425.393640][ T44] Workqueue: netns cleanup_net
[ 4425.393873][ T44] Call Trace:
[ 4425.394044][ T44]
[ 4425.394162][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 4425.394391][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 4425.394620][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.394852][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.395071][ T44] ? trace_contention_end+0xd8/0x140
[ 4425.395290][ T44] ? __mutex_lock+0x19f/0x1190
[ 4425.395510][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4425.395752][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.395973][ T44] ? trace_irq_disable.constprop.0+0xd0/0x130
[ 4425.396257][ T44] ? common_interrupt+0x9b/0xe0
[ 4425.396475][ T44] ? asm_common_interrupt+0x26/0x40
[ 4425.396703][ T44] ? nf_ct_iterate_cleanup+0x8d/0x340 [nf_conntrack]
[ 4425.397005][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4425.397345][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4425.397682][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4425.398031][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4425.398316][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4425.398597][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4425.398831][ T44] ? ops_undo_list+0x2bf/0x890
[ 4425.399056][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4425.399276][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4425.399508][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4425.399729][ T44] ? net_passive_dec+0x190/0x190
[ 4425.399962][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.400182][ T44] ? process_one_work+0xe35/0x1650
[ 4425.400416][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4425.400643][ T44] ? assign_work+0x168/0x240
[ 4425.400966][ T44] ? worker_thread+0x591/0xcf0
[ 4425.401198][ T44] ? rescuer_thread+0xd10/0xd10
[ 4425.401424][ T44] ? kthread+0x37b/0x5f0
[ 4425.401596][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4425.401818][ T44] ? ret_from_fork+0x1b/0x270
[ 4425.402043][ T44] ? __lock_release+0x5d/0x170
[ 4425.402262][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.402478][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4425.402698][ T44] ? ret_from_fork+0x1db/0x270
[ 4425.402924][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4425.403149][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4425.403383][ T44]
[ 4425.403565][ T44]
[ 4425.403565][ T44] Showing all locks held in the system:
[ 4425.403946][ T44] 4 locks held by kworker/u16:0/12:
[ 4425.404175][ T44] 1 lock held by khungtaskd/44:
[ 4425.404387][ T44] #0: ffffffffb9388540 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4425.404802][ T44] 1 lock held by modprobe/524:
[ 4425.405012][ T44] #0: ffffffffb9a80910 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4425.405435][ T44]
[ 4425.405542][ T44] =============================================
[ 4425.405542][ T44]
[ 4548.255041][ T44] INFO: task modprobe:524 blocked for more than 245 seconds.
[ 4548.255666][ T44] Not tainted 6.18.0-rc5-virtme #1
[ 4548.256001][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4548.256575][ T44] task:modprobe state:D stack:25664 pid:524 tgid:524 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4548.257493][ T44] Call Trace:
[ 4548.257799][ T44]
[ 4548.257999][ T44] __schedule+0x880/0x1b10
[ 4548.258415][ T44] ? io_schedule_timeout+0x150/0x150
[ 4548.258818][ T44] ? schedule+0x1ee/0x270
[ 4548.259094][ T44] ? __lock_release+0x5d/0x170
[ 4548.259473][ T44] schedule+0xe2/0x270
[ 4548.259765][ T44] schedule_preempt_disabled+0x18/0x30
[ 4548.260125][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4548.260417][ T44] ? __lock_acquire+0x449/0x7e0
[ 4548.260675][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4548.260970][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.261233][ T44] ? lock_acquire+0x104/0x160
[ 4548.261452][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4548.261694][ T44] down_write+0x1d6/0x200
[ 4548.261884][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4548.262160][ T44] ? find_held_lock+0x2b/0x80
[ 4548.262460][ T44] ? __create_object+0x5e/0xb0
[ 4548.262764][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 4548.263053][ T44] register_pernet_subsys+0x1a/0x40
[ 4548.263279][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4548.263506][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 4548.263760][ T44] do_one_initcall+0x8c/0x1d0
[ 4548.264073][ T44] ? trace_initcall_start+0x130/0x130
[ 4548.264347][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.264661][ T44] ? trace_kmalloc+0x26/0xd0
[ 4548.264978][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4548.265262][ T44] ? debug_objects_oom+0x160/0x160
[ 4548.265493][ T44] ? kasan_unpoison+0x27/0x50
[ 4548.265716][ T44] ? __asan_register_globals+0x5d/0x70
[ 4548.265982][ T44] do_init_module+0x27a/0x860
[ 4548.266275][ T44] ? free_module+0x2f0/0x2f0
[ 4548.266513][ T44] ? kfree+0x21d/0x540
[ 4548.266680][ T44] ? load_module+0x20c5/0x2dd0
[ 4548.266998][ T44] load_module+0x1f40/0x2dd0
[ 4548.267249][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4548.267527][ T44] ? kernel_read_file+0x3ed/0x550
[ 4548.267843][ T44] ? kernel_read_file+0x3c8/0x550
[ 4548.268089][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4548.268317][ T44] ? init_module_from_file+0xe9/0x150
[ 4548.268553][ T44] init_module_from_file+0xe9/0x150
[ 4548.268782][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4548.269029][ T44] ? idempotent_init_module+0x316/0x610
[ 4548.269250][ T44] ? __lock_release+0x5d/0x170
[ 4548.269479][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4548.269703][ T44] idempotent_init_module+0x331/0x610
[ 4548.269951][ T44] ? init_module_from_file+0x150/0x150
[ 4548.270185][ T44] ? cap_capable+0x94/0x230
[ 4548.270421][ T44] __x64_sys_finit_module+0xca/0x150
[ 4548.270642][ T44] ? do_syscall_64+0x85/0xfd0
[ 4548.270886][ T44] do_syscall_64+0xc1/0xfd0
[ 4548.271110][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4548.271388][ T44] RIP: 0033:0x7f3257c4992d
[ 4548.271656][ T44] RSP: 002b:00007ffe11740368 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4548.272103][ T44] RAX: ffffffffffffffda RBX: 000055a639e11ac0 RCX: 00007f3257c4992d
[ 4548.272433][ T44] RDX: 0000000000000000 RSI: 000055a62d638a2a RDI: 0000000000000005
[ 4548.272779][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe117404a0
[ 4548.273120][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055a62d638a2a
[ 4548.273461][ T44] R13: 000055a639e11b60 R14: 000055a639e11da0 R15: 0000000000000000
[ 4548.273826][ T44]
[ 4548.274012][ T44] INFO: task modprobe:524 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4548.274478][ T44] task:kworker/u16:0 state:R running task stack:25856 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4548.275060][ T44] Workqueue: netns cleanup_net
[ 4548.275292][ T44] Call Trace:
[ 4548.275457][ T44]
[ 4548.275582][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 4548.275827][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 4548.276059][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.276307][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.276545][ T44] ? trace_contention_end+0xd8/0x140
[ 4548.276772][ T44] ? __mutex_lock+0x19f/0x1190
[ 4548.277017][ T44] ? __schedule+0x888/0x1b10
[ 4548.277239][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4548.277465][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.277752][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.277992][ T44] ? trace_irq_disable.constprop.0+0xd0/0x130
[ 4548.278351][ T44] ? irqentry_exit+0x3b/0x80
[ 4548.278622][ T44] ? common_interrupt+0x9b/0xe0
[ 4548.278941][ T44] ? lockdep_hardirqs_on+0x7c/0x110
[ 4548.279287][ T44] ? asm_common_interrupt+0x26/0x40
[ 4548.279580][ T44] ? nf_ct_iterate_cleanup+0x6a/0x340 [nf_conntrack]
[ 4548.280035][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4548.280480][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4548.280928][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4548.281271][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4548.281558][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4548.281898][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4548.282204][ T44] ? ops_undo_list+0x2bf/0x890
[ 4548.282476][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4548.282781][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4548.283058][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4548.283371][ T44] ? net_passive_dec+0x190/0x190
[ 4548.283678][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.284027][ T44] ? process_one_work+0xe35/0x1650
[ 4548.284318][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4548.284614][ T44] ? assign_work+0x168/0x240
[ 4548.284876][ T44] ? worker_thread+0x591/0xcf0
[ 4548.285118][ T44] ? rescuer_thread+0xd10/0xd10
[ 4548.285340][ T44] ? kthread+0x37b/0x5f0
[ 4548.285513][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.285816][ T44] ? ret_from_fork+0x1b/0x270
[ 4548.286042][ T44] ? __lock_release+0x5d/0x170
[ 4548.286312][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.286579][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.286881][ T44] ? ret_from_fork+0x1db/0x270
[ 4548.287107][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.287365][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4548.287651][ T44]
[ 4548.287908][ T44]
[ 4548.287908][ T44] Showing all locks held in the system:
[ 4548.288276][ T44] 4 locks held by kworker/u16:0/12:
[ 4548.288559][ T44] 1 lock held by khungtaskd/44:
[ 4548.288922][ T44] #0: ffffffffb9388540 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4548.289357][ T44] 1 lock held by modprobe/524:
[ 4548.289582][ T44] #0: ffffffffb9a80910 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4548.290154][ T44]
[ 4548.290308][ T44] =============================================
[ 4548.290308][ T44]
[ 4671.135105][ T44] INFO: task modprobe:524 blocked for more than 368 seconds.
[ 4671.135794][ T44] Not tainted 6.18.0-rc5-virtme #1
[ 4671.136033][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4671.136424][ T44] task:modprobe state:D stack:25664 pid:524 tgid:524 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4671.136980][ T44] Call Trace:
[ 4671.137163][ T44]
[ 4671.137292][ T44] __schedule+0x880/0x1b10
[ 4671.137563][ T44] ? io_schedule_timeout+0x150/0x150
[ 4671.137846][ T44] ? schedule+0x1ee/0x270
[ 4671.138053][ T44] ? __lock_release+0x5d/0x170
[ 4671.138326][ T44] schedule+0xe2/0x270
[ 4671.138510][ T44] schedule_preempt_disabled+0x18/0x30
[ 4671.138768][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4671.138997][ T44] ? __lock_acquire+0x449/0x7e0
[ 4671.139219][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4671.139458][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.139692][ T44] ? lock_acquire+0x104/0x160
[ 4671.139914][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4671.140176][ T44] down_write+0x1d6/0x200
[ 4671.140347][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4671.140622][ T44] ? find_held_lock+0x2b/0x80
[ 4671.140856][ T44] ? __create_object+0x5e/0xb0
[ 4671.141095][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 4671.141322][ T44] register_pernet_subsys+0x1a/0x40
[ 4671.141548][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4671.141820][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 4671.142043][ T44] do_one_initcall+0x8c/0x1d0
[ 4671.142267][ T44] ? trace_initcall_start+0x130/0x130
[ 4671.142487][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.142711][ T44] ? trace_kmalloc+0x26/0xd0
[ 4671.142940][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4671.143165][ T44] ? debug_objects_oom+0x160/0x160
[ 4671.143420][ T44] ? kasan_unpoison+0x27/0x50
[ 4671.143642][ T44] ? __asan_register_globals+0x5d/0x70
[ 4671.143879][ T44] do_init_module+0x27a/0x860
[ 4671.144115][ T44] ? free_module+0x2f0/0x2f0
[ 4671.144346][ T44] ? kfree+0x21d/0x540
[ 4671.144512][ T44] ? load_module+0x20c5/0x2dd0
[ 4671.144743][ T44] load_module+0x1f40/0x2dd0
[ 4671.144975][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4671.145262][ T44] ? kernel_read_file+0x3ed/0x550
[ 4671.145490][ T44] ? kernel_read_file+0x3c8/0x550
[ 4671.145714][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4671.145963][ T44] ? init_module_from_file+0xe9/0x150
[ 4671.146186][ T44] init_module_from_file+0xe9/0x150
[ 4671.146405][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4671.146655][ T44] ? idempotent_init_module+0x316/0x610
[ 4671.146880][ T44] ? __lock_release+0x5d/0x170
[ 4671.147119][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4671.147347][ T44] idempotent_init_module+0x331/0x610
[ 4671.147569][ T44] ? init_module_from_file+0x150/0x150
[ 4671.147812][ T44] ? cap_capable+0x94/0x230
[ 4671.148039][ T44] __x64_sys_finit_module+0xca/0x150
[ 4671.148276][ T44] ? do_syscall_64+0x85/0xfd0
[ 4671.148505][ T44] do_syscall_64+0xc1/0xfd0
[ 4671.148739][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4671.149016][ T44] RIP: 0033:0x7f3257c4992d
[ 4671.149307][ T44] RSP: 002b:00007ffe11740368 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4671.149651][ T44] RAX: ffffffffffffffda RBX: 000055a639e11ac0 RCX: 00007f3257c4992d
[ 4671.150021][ T44] RDX: 0000000000000000 RSI: 000055a62d638a2a RDI: 0000000000000005
[ 4671.150364][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe117404a0
[ 4671.150701][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055a62d638a2a
[ 4671.151041][ T44] R13: 000055a639e11b60 R14: 000055a639e11da0 R15: 0000000000000000
[ 4671.151402][ T44]
[ 4671.151578][ T44] INFO: task modprobe:524 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4671.152060][ T44] task:kworker/u16:0 state:R running task stack:25856 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4671.152621][ T44] Workqueue: netns cleanup_net
[ 4671.152863][ T44] Call Trace:
[ 4671.153044][ T44]
[ 4671.153167][ T44] ? update_curr+0x39f/0x500
[ 4671.153402][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 4671.153622][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.153870][ T44] ? trace_contention_end+0xd8/0x140
[ 4671.154090][ T44] ? __mutex_lock+0x19f/0x1190
[ 4671.154320][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4671.154546][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.154795][ T44] ? irqentry_exit+0x3b/0x80
[ 4671.155015][ T44] ? common_interrupt+0x9b/0xe0
[ 4671.155237][ T44] ? asm_common_interrupt+0x26/0x40
[ 4671.155468][ T44] ? nf_ct_iterate_cleanup+0x73/0x340 [nf_conntrack]
[ 4671.155766][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4671.156110][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4671.156465][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4671.156815][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4671.157101][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4671.157392][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4671.157615][ T44] ? ops_undo_list+0x2bf/0x890
[ 4671.157861][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4671.158093][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4671.158319][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4671.158539][ T44] ? net_passive_dec+0x190/0x190
[ 4671.158767][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.158988][ T44] ? process_one_work+0xe35/0x1650
[ 4671.159226][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4671.159456][ T44] ? assign_work+0x168/0x240
[ 4671.159678][ T44] ? worker_thread+0x591/0xcf0
[ 4671.159926][ T44] ? rescuer_thread+0xd10/0xd10
[ 4671.160152][ T44] ? kthread+0x37b/0x5f0
[ 4671.160323][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.160552][ T44] ? ret_from_fork+0x1b/0x270
[ 4671.160779][ T44] ? __lock_release+0x5d/0x170
[ 4671.161005][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.161235][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.161457][ T44] ? ret_from_fork+0x1db/0x270
[ 4671.161690][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.161942][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4671.162187][ T44]
[ 4671.162405][ T44]
[ 4671.162405][ T44] Showing all locks held in the system:
[ 4671.163065][ T44] 4 locks held by kworker/u16:0/12:
[ 4671.163305][ T44] 1 lock held by khungtaskd/44:
[ 4671.163526][ T44] #0: ffffffffb9388540 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4671.163956][ T44] 1 lock held by modprobe/524:
[ 4671.164164][ T44] #0: ffffffffb9a80910 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4671.164607][ T44]
[ 4671.164716][ T44] =============================================
[ 4671.164716][ T44]
[ 4794.015884][ T44] INFO: task modprobe:524 blocked for more than 491 seconds.
[ 4794.016378][ T44] Not tainted 6.18.0-rc5-virtme #1
[ 4794.016608][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4794.017024][ T44] task:modprobe state:D stack:25664 pid:524 tgid:524 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4794.017519][ T44] Call Trace:
[ 4794.017686][ T44]
[ 4794.017815][ T44] __schedule+0x880/0x1b10
[ 4794.018052][ T44] ? io_schedule_timeout+0x150/0x150
[ 4794.018283][ T44] ? schedule+0x1ee/0x270
[ 4794.018452][ T44] ? __lock_release+0x5d/0x170
[ 4794.018690][ T44] schedule+0xe2/0x270
[ 4794.018866][ T44] schedule_preempt_disabled+0x18/0x30
[ 4794.019084][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4794.019306][ T44] ? __lock_acquire+0x449/0x7e0
[ 4794.019524][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4794.019764][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.019988][ T44] ? lock_acquire+0x104/0x160
[ 4794.020204][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4794.020446][ T44] down_write+0x1d6/0x200
[ 4794.020614][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4794.020894][ T44] ? find_held_lock+0x2b/0x80
[ 4794.021117][ T44] ? __create_object+0x5e/0xb0
[ 4794.021340][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 4794.021566][ T44] register_pernet_subsys+0x1a/0x40
[ 4794.021794][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4794.022026][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 4794.022246][ T44] do_one_initcall+0x8c/0x1d0
[ 4794.022468][ T44] ? trace_initcall_start+0x130/0x130
[ 4794.022686][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.022911][ T44] ? trace_kmalloc+0x26/0xd0
[ 4794.023132][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4794.023351][ T44] ? debug_objects_oom+0x160/0x160
[ 4794.023592][ T44] ? kasan_unpoison+0x27/0x50
[ 4794.023820][ T44] ? __asan_register_globals+0x5d/0x70
[ 4794.024045][ T44] do_init_module+0x27a/0x860
[ 4794.024273][ T44] ? free_module+0x2f0/0x2f0
[ 4794.024506][ T44] ? kfree+0x21d/0x540
[ 4794.024671][ T44] ? load_module+0x20c5/0x2dd0
[ 4794.024904][ T44] load_module+0x1f40/0x2dd0
[ 4794.025136][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4794.025416][ T44] ? kernel_read_file+0x3ed/0x550
[ 4794.025638][ T44] ? kernel_read_file+0x3c8/0x550
[ 4794.025867][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4794.026094][ T44] ? init_module_from_file+0xe9/0x150
[ 4794.026313][ T44] init_module_from_file+0xe9/0x150
[ 4794.026531][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4794.026783][ T44] ? idempotent_init_module+0x316/0x610
[ 4794.026999][ T44] ? __lock_release+0x5d/0x170
[ 4794.027222][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4794.027441][ T44] idempotent_init_module+0x331/0x610
[ 4794.027664][ T44] ? init_module_from_file+0x150/0x150
[ 4794.027903][ T44] ? cap_capable+0x94/0x230
[ 4794.028128][ T44] __x64_sys_finit_module+0xca/0x150
[ 4794.028353][ T44] ? do_syscall_64+0x85/0xfd0
[ 4794.028573][ T44] do_syscall_64+0xc1/0xfd0
[ 4794.028802][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4794.029072][ T44] RIP: 0033:0x7f3257c4992d
[ 4794.029302][ T44] RSP: 002b:00007ffe11740368 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4794.029637][ T44] RAX: ffffffffffffffda RBX: 000055a639e11ac0 RCX: 00007f3257c4992d
[ 4794.029978][ T44] RDX: 0000000000000000 RSI: 000055a62d638a2a RDI: 0000000000000005
[ 4794.030309][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe117404a0
[ 4794.030636][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055a62d638a2a
[ 4794.030969][ T44] R13: 000055a639e11b60 R14: 000055a639e11da0 R15: 0000000000000000
[ 4794.031322][ T44]
[ 4794.031492][ T44] INFO: task modprobe:524 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4794.031961][ T44] task:kworker/u16:0 state:R running task stack:25856 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4794.032498][ T44] Workqueue: netns cleanup_net
[ 4794.032724][ T44] Call Trace:
[ 4794.032911][ T44]
[ 4794.033026][ T44] ? __mutex_lock+0x19f/0x1190
[ 4794.033251][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4794.033475][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.033699][ T44] ? trace_irq_disable.constprop.0+0xd0/0x130
[ 4794.033982][ T44] ? irqentry_exit+0x3b/0x80
[ 4794.034200][ T44] ? common_interrupt+0x9b/0xe0
[ 4794.034420][ T44] ? asm_common_interrupt+0x26/0x40
[ 4794.034657][ T44] ? nf_ct_iterate_cleanup+0x86/0x340 [nf_conntrack]
[ 4794.034952][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4794.035289][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4794.035623][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4794.036039][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4794.036333][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4794.036614][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4794.036844][ T44] ? ops_undo_list+0x2bf/0x890
[ 4794.037077][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4794.037295][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4794.037522][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4794.037751][ T44] ? net_passive_dec+0x190/0x190
[ 4794.037987][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.038216][ T44] ? process_one_work+0xe35/0x1650
[ 4794.038450][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4794.038675][ T44] ? assign_work+0x168/0x240
[ 4794.038905][ T44] ? worker_thread+0x591/0xcf0
[ 4794.039130][ T44] ? rescuer_thread+0xd10/0xd10
[ 4794.039349][ T44] ? kthread+0x37b/0x5f0
[ 4794.039517][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4794.039752][ T44] ? ret_from_fork+0x1b/0x270
[ 4794.039971][ T44] ? __lock_release+0x5d/0x170
[ 4794.040189][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.040407][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4794.040627][ T44] ? ret_from_fork+0x1db/0x270
[ 4794.040852][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4794.041070][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4794.041302][ T44]
[ 4794.041483][ T44]
[ 4794.041483][ T44] Showing all locks held in the system:
[ 4794.041810][ T44] 4 locks held by kworker/u16:0/12:
[ 4794.042036][ T44] 1 lock held by khungtaskd/44:
[ 4794.042246][ T44] #0: ffffffffb9388540 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4794.042644][ T44] 1 lock held by modprobe/524:
[ 4794.042859][ T44] #0: ffffffffb9a80910 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4794.043299][ T44]
[ 4794.043405][ T44] =============================================
[ 4794.043405][ T44]
[ 4916.895872][ T44] INFO: task modprobe:524 blocked for more than 614 seconds.
[ 4916.896352][ T44] Not tainted 6.18.0-rc5-virtme #1
[ 4916.896568][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4916.896952][ T44] task:modprobe state:D stack:25664 pid:524 tgid:524 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4916.897439][ T44] Call Trace:
[ 4916.897627][ T44]
[ 4916.897757][ T44] __schedule+0x880/0x1b10
[ 4916.898006][ T44] ? io_schedule_timeout+0x150/0x150
[ 4916.898241][ T44] ? schedule+0x1ee/0x270
[ 4916.898406][ T44] ? __lock_release+0x5d/0x170
[ 4916.898643][ T44] schedule+0xe2/0x270
[ 4916.898821][ T44] schedule_preempt_disabled+0x18/0x30
[ 4916.899041][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4916.899273][ T44] ? __lock_acquire+0x449/0x7e0
[ 4916.899494][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4916.899722][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.899958][ T44] ? lock_acquire+0x104/0x160
[ 4916.900177][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4916.900408][ T44] down_write+0x1d6/0x200
[ 4916.900574][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4916.900872][ T44] ? find_held_lock+0x2b/0x80
[ 4916.901097][ T44] ? __create_object+0x5e/0xb0
[ 4916.901319][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 4916.901546][ T44] register_pernet_subsys+0x1a/0x40
[ 4916.901774][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4916.901997][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 4916.902217][ T44] do_one_initcall+0x8c/0x1d0
[ 4916.902442][ T44] ? trace_initcall_start+0x130/0x130
[ 4916.902673][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.902908][ T44] ? trace_kmalloc+0x26/0xd0
[ 4916.903128][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4916.903347][ T44] ? debug_objects_oom+0x160/0x160
[ 4916.903570][ T44] ? kasan_unpoison+0x27/0x50
[ 4916.903796][ T44] ? __asan_register_globals+0x5d/0x70
[ 4916.904021][ T44] do_init_module+0x27a/0x860
[ 4916.904261][ T44] ? free_module+0x2f0/0x2f0
[ 4916.904478][ T44] ? kfree+0x21d/0x540
[ 4916.904643][ T44] ? load_module+0x20c5/0x2dd0
[ 4916.904876][ T44] load_module+0x1f40/0x2dd0
[ 4916.905105][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4916.905380][ T44] ? kernel_read_file+0x3ed/0x550
[ 4916.905612][ T44] ? kernel_read_file+0x3c8/0x550
[ 4916.905843][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4916.906077][ T44] ? init_module_from_file+0xe9/0x150
[ 4916.906296][ T44] init_module_from_file+0xe9/0x150
[ 4916.906517][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4916.906759][ T44] ? idempotent_init_module+0x316/0x610
[ 4916.906975][ T44] ? __lock_release+0x5d/0x170
[ 4916.907195][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4916.907428][ T44] idempotent_init_module+0x331/0x610
[ 4916.907651][ T44] ? init_module_from_file+0x150/0x150
[ 4916.907890][ T44] ? cap_capable+0x94/0x230
[ 4916.908119][ T44] __x64_sys_finit_module+0xca/0x150
[ 4916.908335][ T44] ? do_syscall_64+0x85/0xfd0
[ 4916.908556][ T44] do_syscall_64+0xc1/0xfd0
[ 4916.908783][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4916.909062][ T44] RIP: 0033:0x7f3257c4992d
[ 4916.909292][ T44] RSP: 002b:00007ffe11740368 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4916.909622][ T44] RAX: ffffffffffffffda RBX: 000055a639e11ac0 RCX: 00007f3257c4992d
[ 4916.909959][ T44] RDX: 0000000000000000 RSI: 000055a62d638a2a RDI: 0000000000000005
[ 4916.910289][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe117404a0
[ 4916.910628][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055a62d638a2a
[ 4916.910966][ T44] R13: 000055a639e11b60 R14: 000055a639e11da0 R15: 0000000000000000
[ 4916.911313][ T44]
[ 4916.911484][ T44] INFO: task modprobe:524 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4916.911964][ T44] task:kworker/u16:0 state:R running task stack:25856 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4916.912500][ T44] Workqueue: netns cleanup_net
[ 4916.912722][ T44] Call Trace:
[ 4916.912900][ T44]
[ 4916.913020][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 4916.913245][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 4916.913463][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.913695][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.913930][ T44] ? trace_contention_end+0xd8/0x140
[ 4916.914149][ T44] ? __mutex_lock+0x19f/0x1190
[ 4916.914370][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4916.914592][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.914821][ T44] ? irqentry_exit+0x3b/0x80
[ 4916.915040][ T44] ? common_interrupt+0x9b/0xe0
[ 4916.915270][ T44] ? asm_common_interrupt+0x26/0x40
[ 4916.915501][ T44] ? nf_ct_iterate_cleanup+0x8d/0x340 [nf_conntrack]
[ 4916.915798][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4916.916141][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4916.916478][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4916.916824][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4916.917121][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4916.917403][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4916.917626][ T44] ? ops_undo_list+0x2bf/0x890
[ 4916.917856][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4916.918073][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4916.918340][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4916.918569][ T44] ? net_passive_dec+0x190/0x190
[ 4916.918815][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.919038][ T44] ? process_one_work+0xe35/0x1650
[ 4916.919269][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4916.919497][ T44] ? assign_work+0x168/0x240
[ 4916.919722][ T44] ? worker_thread+0x591/0xcf0
[ 4916.919957][ T44] ? rescuer_thread+0xd10/0xd10
[ 4916.920177][ T44] ? kthread+0x37b/0x5f0
[ 4916.920355][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.920572][ T44] ? ret_from_fork+0x1b/0x270
[ 4916.920799][ T44] ? __lock_release+0x5d/0x170
[ 4916.921021][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.921238][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.921458][ T44] ? ret_from_fork+0x1db/0x270
[ 4916.921673][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.921900][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4916.922144][ T44]
[ 4916.922336][ T44]
[ 4916.922336][ T44] Showing all locks held in the system:
[ 4916.922649][ T44] 5 locks held by kworker/u16:0/12:
[ 4916.922887][ T44] 1 lock held by khungtaskd/44:
[ 4916.923098][ T44] #0: ffffffffb9388540 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4916.923494][ T44] 1 lock held by modprobe/524:
[ 4916.923702][ T44] #0: ffffffffb9a80910 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4916.924147][ T44]
[ 4916.924255][ T44] =============================================
[ 4916.924255][ T44]
[ 5039.775885][ T44] INFO: task modprobe:524 blocked for more than 737 seconds.
[ 5039.776333][ T44] Not tainted 6.18.0-rc5-virtme #1
[ 5039.776549][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5039.776998][ T44] task:modprobe state:D stack:25664 pid:524 tgid:524 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5039.777486][ T44] Call Trace:
[ 5039.777655][ T44]
[ 5039.777793][ T44] __schedule+0x880/0x1b10
[ 5039.778061][ T44] ? io_schedule_timeout+0x150/0x150
[ 5039.778313][ T44] ? schedule+0x1ee/0x270
[ 5039.778491][ T44] ? __lock_release+0x5d/0x170
[ 5039.778769][ T44] schedule+0xe2/0x270
[ 5039.778948][ T44] schedule_preempt_disabled+0x18/0x30
[ 5039.779166][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5039.779391][ T44] ? __lock_acquire+0x449/0x7e0
[ 5039.779609][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5039.779851][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.780075][ T44] ? lock_acquire+0x104/0x160
[ 5039.780299][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5039.780549][ T44] down_write+0x1d6/0x200
[ 5039.780737][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5039.781027][ T44] ? find_held_lock+0x2b/0x80
[ 5039.781247][ T44] ? __create_object+0x5e/0xb0
[ 5039.781472][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 5039.781699][ T44] register_pernet_subsys+0x1a/0x40
[ 5039.781939][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5039.782172][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 5039.782400][ T44] do_one_initcall+0x8c/0x1d0
[ 5039.782627][ T44] ? trace_initcall_start+0x130/0x130
[ 5039.782882][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.783120][ T44] ? trace_kmalloc+0x26/0xd0
[ 5039.783349][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5039.783577][ T44] ? debug_objects_oom+0x160/0x160
[ 5039.783810][ T44] ? kasan_unpoison+0x27/0x50
[ 5039.784033][ T44] ? __asan_register_globals+0x5d/0x70
[ 5039.784259][ T44] do_init_module+0x27a/0x860
[ 5039.784492][ T44] ? free_module+0x2f0/0x2f0
[ 5039.784712][ T44] ? kfree+0x21d/0x540
[ 5039.784891][ T44] ? load_module+0x20c5/0x2dd0
[ 5039.785118][ T44] load_module+0x1f40/0x2dd0
[ 5039.785371][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5039.785660][ T44] ? kernel_read_file+0x3ed/0x550
[ 5039.785898][ T44] ? kernel_read_file+0x3c8/0x550
[ 5039.786128][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5039.786355][ T44] ? init_module_from_file+0xe9/0x150
[ 5039.786573][ T44] init_module_from_file+0xe9/0x150
[ 5039.786831][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5039.787082][ T44] ? idempotent_init_module+0x316/0x610
[ 5039.787299][ T44] ? __lock_release+0x5d/0x170
[ 5039.787522][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5039.787761][ T44] idempotent_init_module+0x331/0x610
[ 5039.787998][ T44] ? init_module_from_file+0x150/0x150
[ 5039.788230][ T44] ? cap_capable+0x94/0x230
[ 5039.788459][ T44] __x64_sys_finit_module+0xca/0x150
[ 5039.788685][ T44] ? do_syscall_64+0x85/0xfd0
[ 5039.788916][ T44] do_syscall_64+0xc1/0xfd0
[ 5039.789137][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5039.789431][ T44] RIP: 0033:0x7f3257c4992d
[ 5039.789666][ T44] RSP: 002b:00007ffe11740368 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5039.790011][ T44] RAX: ffffffffffffffda RBX: 000055a639e11ac0 RCX: 00007f3257c4992d
[ 5039.790370][ T44] RDX: 0000000000000000 RSI: 000055a62d638a2a RDI: 0000000000000005
[ 5039.790698][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe117404a0
[ 5039.791053][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055a62d638a2a
[ 5039.791385][ T44] R13: 000055a639e11b60 R14: 000055a639e11da0 R15: 0000000000000000
[ 5039.791759][ T44]
[ 5039.791935][ T44] INFO: task modprobe:524 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5039.792410][ T44] task:kworker/u16:0 state:R running task stack:25856 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5039.792991][ T44] Workqueue: netns cleanup_net
[ 5039.793233][ T44] Call Trace:
[ 5039.793398][ T44]
[ 5039.793518][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5039.793754][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5039.793979][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.794221][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.794448][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.794669][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5039.794927][ T44] ? irqentry_exit+0x3b/0x80
[ 5039.795171][ T44] ? common_interrupt+0x9b/0xe0
[ 5039.795390][ T44] ? asm_common_interrupt+0x26/0x40
[ 5039.795621][ T44] ? nf_ct_iterate_cleanup+0x79/0x340 [nf_conntrack]
[ 5039.795919][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5039.796257][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5039.796608][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5039.796984][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5039.797272][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5039.797551][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5039.797785][ T44] ? ops_undo_list+0x2bf/0x890
[ 5039.798013][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5039.798231][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5039.798467][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5039.798689][ T44] ? net_passive_dec+0x190/0x190
[ 5039.798932][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.799171][ T44] ? process_one_work+0xe35/0x1650
[ 5039.799422][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5039.799650][ T44] ? assign_work+0x168/0x240
[ 5039.799891][ T44] ? worker_thread+0x591/0xcf0
[ 5039.800155][ T44] ? rescuer_thread+0xd10/0xd10
[ 5039.800382][ T44] ? kthread+0x37b/0x5f0
[ 5039.800552][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.800779][ T44] ? ret_from_fork+0x1b/0x270
[ 5039.801016][ T44] ? __lock_release+0x5d/0x170
[ 5039.801247][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.801479][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.801714][ T44] ? ret_from_fork+0x1db/0x270
[ 5039.801943][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.802178][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5039.802416][ T44]
[ 5039.802623][ T44]
[ 5039.802623][ T44] Showing all locks held in the system:
[ 5039.803312][ T44] 4 locks held by kworker/u16:0/12:
[ 5039.803557][ T44] 1 lock held by khungtaskd/44:
[ 5039.803772][ T44] #0: ffffffffb9388540 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5039.804201][ T44] 1 lock held by modprobe/524:
[ 5039.804408][ T44] #0: ffffffffb9a80910 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5039.804849][ T44]
[ 5039.804956][ T44] =============================================
[ 5039.804956][ T44]
[ 5162.655900][ T44] INFO: task modprobe:524 blocked for more than 860 seconds.
[ 5162.656424][ T44] Not tainted 6.18.0-rc5-virtme #1
[ 5162.656654][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5162.657069][ T44] task:modprobe state:D stack:25664 pid:524 tgid:524 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5162.657600][ T44] Call Trace:
[ 5162.657800][ T44]
[ 5162.657929][ T44] __schedule+0x880/0x1b10
[ 5162.658195][ T44] ? io_schedule_timeout+0x150/0x150
[ 5162.658451][ T44] ? schedule+0x1ee/0x270
[ 5162.658638][ T44] ? __lock_release+0x5d/0x170
[ 5162.658917][ T44] schedule+0xe2/0x270
[ 5162.659102][ T44] schedule_preempt_disabled+0x18/0x30
[ 5162.659334][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5162.659578][ T44] ? __lock_acquire+0x449/0x7e0
[ 5162.659841][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5162.660109][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.660355][ T44] ? lock_acquire+0x104/0x160
[ 5162.660589][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5162.660856][ T44] down_write+0x1d6/0x200
[ 5162.661042][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5162.661331][ T44] ? find_held_lock+0x2b/0x80
[ 5162.661579][ T44] ? __create_object+0x5e/0xb0
[ 5162.661835][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 5162.662083][ T44] register_pernet_subsys+0x1a/0x40
[ 5162.662320][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5162.662555][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 5162.662823][ T44] do_one_initcall+0x8c/0x1d0
[ 5162.663073][ T44] ? trace_initcall_start+0x130/0x130
[ 5162.663307][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.663549][ T44] ? trace_kmalloc+0x26/0xd0
[ 5162.663800][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5162.664044][ T44] ? debug_objects_oom+0x160/0x160
[ 5162.664282][ T44] ? kasan_unpoison+0x27/0x50
[ 5162.664517][ T44] ? __asan_register_globals+0x5d/0x70
[ 5162.664764][ T44] do_init_module+0x27a/0x860
[ 5162.665016][ T44] ? free_module+0x2f0/0x2f0
[ 5162.665256][ T44] ? kfree+0x21d/0x540
[ 5162.665431][ T44] ? load_module+0x20c5/0x2dd0
[ 5162.665669][ T44] load_module+0x1f40/0x2dd0
[ 5162.665922][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5162.666218][ T44] ? kernel_read_file+0x3ed/0x550
[ 5162.666454][ T44] ? kernel_read_file+0x3c8/0x550
[ 5162.666689][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5162.666952][ T44] ? init_module_from_file+0xe9/0x150
[ 5162.667200][ T44] init_module_from_file+0xe9/0x150
[ 5162.667434][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5162.667682][ T44] ? idempotent_init_module+0x316/0x610
[ 5162.667924][ T44] ? __lock_release+0x5d/0x170
[ 5162.668163][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5162.668400][ T44] idempotent_init_module+0x331/0x610
[ 5162.668642][ T44] ? init_module_from_file+0x150/0x150
[ 5162.668899][ T44] ? cap_capable+0x94/0x230
[ 5162.669150][ T44] __x64_sys_finit_module+0xca/0x150
[ 5162.669380][ T44] ? do_syscall_64+0x85/0xfd0
[ 5162.669618][ T44] do_syscall_64+0xc1/0xfd0
[ 5162.669860][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5162.670157][ T44] RIP: 0033:0x7f3257c4992d
[ 5162.670405][ T44] RSP: 002b:00007ffe11740368 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5162.670789][ T44] RAX: ffffffffffffffda RBX: 000055a639e11ac0 RCX: 00007f3257c4992d
[ 5162.671148][ T44] RDX: 0000000000000000 RSI: 000055a62d638a2a RDI: 0000000000000005
[ 5162.671506][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe117404a0
[ 5162.671866][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055a62d638a2a
[ 5162.672228][ T44] R13: 000055a639e11b60 R14: 000055a639e11da0 R15: 0000000000000000
[ 5162.672593][ T44]
[ 5162.672795][ T44] INFO: task modprobe:524 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5162.673298][ T44] task:kworker/u16:0 state:R running task stack:25856 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5162.673894][ T44] Workqueue: netns cleanup_net
[ 5162.674145][ T44] Call Trace:
[ 5162.674324][ T44]
[ 5162.674450][ T44] ? update_curr+0x39f/0x500
[ 5162.674689][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5162.674949][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.675198][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.675434][ T44] ? trace_contention_end+0xd8/0x140
[ 5162.675677][ T44] ? __mutex_lock+0x19f/0x1190
[ 5162.675941][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5162.676214][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5162.676521][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5162.676894][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5162.677265][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5162.677620][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5162.677933][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5162.678239][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5162.678481][ T44] ? ops_undo_list+0x2bf/0x890
[ 5162.678727][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5162.678984][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5162.679228][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5162.679468][ T44] ? net_passive_dec+0x190/0x190
[ 5162.679707][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.679975][ T44] ? process_one_work+0xe35/0x1650
[ 5162.680229][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5162.680472][ T44] ? assign_work+0x168/0x240
[ 5162.680711][ T44] ? worker_thread+0x591/0xcf0
[ 5162.680981][ T44] ? rescuer_thread+0xd10/0xd10
[ 5162.681216][ T44] ? kthread+0x37b/0x5f0
[ 5162.681404][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.681634][ T44] ? ret_from_fork+0x1b/0x270
[ 5162.681875][ T44] ? __lock_release+0x5d/0x170
[ 5162.682114][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.682347][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.682581][ T44] ? ret_from_fork+0x1db/0x270
[ 5162.682821][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.683060][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5162.683310][ T44]
[ 5162.683535][ T44]
[ 5162.683535][ T44] Showing all locks held in the system:
[ 5162.684254][ T44] 4 locks held by kworker/u16:0/12:
[ 5162.684495][ T44] 1 lock held by khungtaskd/44:
[ 5162.684726][ T44] #0: ffffffffb9388540 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5162.685176][ T44] 1 lock held by modprobe/524:
[ 5162.685401][ T44] #0: ffffffffb9a80910 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5162.685874][ T44]
[ 5162.685993][ T44] =============================================
[ 5162.685993][ T44]
[ 5285.534887][ T44] INFO: task modprobe:524 blocked for more than 983 seconds.
[ 5285.535405][ T44] Not tainted 6.18.0-rc5-virtme #1
[ 5285.535615][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5285.536047][ T44] task:modprobe state:D stack:25664 pid:524 tgid:524 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5285.536566][ T44] Call Trace:
[ 5285.536771][ T44]
[ 5285.536902][ T44] __schedule+0x880/0x1b10
[ 5285.537144][ T44] ? io_schedule_timeout+0x150/0x150
[ 5285.537387][ T44] ? schedule+0x1ee/0x270
[ 5285.537554][ T44] ? __lock_release+0x5d/0x170
[ 5285.537803][ T44] schedule+0xe2/0x270
[ 5285.537981][ T44] schedule_preempt_disabled+0x18/0x30
[ 5285.538201][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5285.538449][ T44] ? __lock_acquire+0x449/0x7e0
[ 5285.538687][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5285.538936][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.539161][ T44] ? lock_acquire+0x104/0x160
[ 5285.539396][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5285.539630][ T44] down_write+0x1d6/0x200
[ 5285.539810][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5285.540106][ T44] ? find_held_lock+0x2b/0x80
[ 5285.540341][ T44] ? __create_object+0x5e/0xb0
[ 5285.540575][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 5285.540840][ T44] register_pernet_subsys+0x1a/0x40
[ 5285.541102][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5285.541338][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 5285.541567][ T44] do_one_initcall+0x8c/0x1d0
[ 5285.541818][ T44] ? trace_initcall_start+0x130/0x130
[ 5285.542052][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.542283][ T44] ? trace_kmalloc+0x26/0xd0
[ 5285.542513][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5285.542750][ T44] ? debug_objects_oom+0x160/0x160
[ 5285.542986][ T44] ? kasan_unpoison+0x27/0x50
[ 5285.543222][ T44] ? __asan_register_globals+0x5d/0x70
[ 5285.543477][ T44] do_init_module+0x27a/0x860
[ 5285.543720][ T44] ? free_module+0x2f0/0x2f0
[ 5285.543963][ T44] ? kfree+0x21d/0x540
[ 5285.544132][ T44] ? load_module+0x20c5/0x2dd0
[ 5285.544375][ T44] load_module+0x1f40/0x2dd0
[ 5285.544607][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5285.544910][ T44] ? kernel_read_file+0x3ed/0x550
[ 5285.545135][ T44] ? kernel_read_file+0x3c8/0x550
[ 5285.545379][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5285.545610][ T44] ? init_module_from_file+0xe9/0x150
[ 5285.545865][ T44] init_module_from_file+0xe9/0x150
[ 5285.546089][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5285.546332][ T44] ? idempotent_init_module+0x316/0x610
[ 5285.546559][ T44] ? __lock_release+0x5d/0x170
[ 5285.546804][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5285.547042][ T44] idempotent_init_module+0x331/0x610
[ 5285.547269][ T44] ? init_module_from_file+0x150/0x150
[ 5285.547510][ T44] ? cap_capable+0x94/0x230
[ 5285.547754][ T44] __x64_sys_finit_module+0xca/0x150
[ 5285.547985][ T44] ? do_syscall_64+0x85/0xfd0
[ 5285.548208][ T44] do_syscall_64+0xc1/0xfd0
[ 5285.548444][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5285.548747][ T44] RIP: 0033:0x7f3257c4992d
[ 5285.548990][ T44] RSP: 002b:00007ffe11740368 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5285.549332][ T44] RAX: ffffffffffffffda RBX: 000055a639e11ac0 RCX: 00007f3257c4992d
[ 5285.549680][ T44] RDX: 0000000000000000 RSI: 000055a62d638a2a RDI: 0000000000000005
[ 5285.550032][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe117404a0
[ 5285.550376][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055a62d638a2a
[ 5285.550743][ T44] R13: 000055a639e11b60 R14: 000055a639e11da0 R15: 0000000000000000
[ 5285.551101][ T44]
[ 5285.551279][ T44] INFO: task modprobe:524 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5285.551782][ T44] task:kworker/u16:0 state:R running task stack:25856 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5285.552338][ T44] Workqueue: netns cleanup_net
[ 5285.552574][ T44] Call Trace:
[ 5285.552758][ T44]
[ 5285.552889][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5285.553115][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5285.553377][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.553602][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.553846][ T44] ? trace_contention_end+0xd8/0x140
[ 5285.554072][ T44] ? __mutex_lock+0x19f/0x1190
[ 5285.554303][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5285.554536][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.554780][ T44] ? irqentry_exit+0x3b/0x80
[ 5285.555008][ T44] ? common_interrupt+0x9b/0xe0
[ 5285.555262][ T44] ? nf_ct_iterate_cleanup+0x82/0x340 [nf_conntrack]
[ 5285.555570][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5285.555938][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5285.556284][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5285.556636][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5285.556968][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5285.557257][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5285.557491][ T44] ? ops_undo_list+0x2bf/0x890
[ 5285.557725][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5285.557963][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5285.558194][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5285.558429][ T44] ? net_passive_dec+0x190/0x190
[ 5285.558666][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.558917][ T44] ? process_one_work+0xe35/0x1650
[ 5285.559149][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5285.559384][ T44] ? assign_work+0x168/0x240
[ 5285.559609][ T44] ? worker_thread+0x591/0xcf0
[ 5285.559861][ T44] ? rescuer_thread+0xd10/0xd10
[ 5285.560086][ T44] ? kthread+0x37b/0x5f0
[ 5285.560261][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.560496][ T44] ? ret_from_fork+0x1b/0x270
[ 5285.560747][ T44] ? __lock_release+0x5d/0x170
[ 5285.560980][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.561198][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.561436][ T44] ? ret_from_fork+0x1db/0x270
[ 5285.561654][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.561905][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5285.562140][ T44]
[ 5285.562338][ T44]
[ 5285.562338][ T44] Showing all locks held in the system:
[ 5285.562666][ T44] 5 locks held by kworker/u16:0/12:
[ 5285.562918][ T44] 1 lock held by khungtaskd/44:
[ 5285.563131][ T44] #0: ffffffffb9388540 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5285.563548][ T44] 1 lock held by modprobe/524:
[ 5285.563777][ T44] #0: ffffffffb9a80910 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5285.564239][ T44]
[ 5285.564357][ T44] =============================================
[ 5285.564357][ T44]
[ 5408.414876][ T44] INFO: task modprobe:524 blocked for more than 1105 seconds.
[ 5408.415408][ T44] Not tainted 6.18.0-rc5-virtme #1
[ 5408.415638][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5408.416026][ T44] task:modprobe state:D stack:25664 pid:524 tgid:524 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5408.416532][ T44] Call Trace:
[ 5408.416708][ T44]
[ 5408.416848][ T44] __schedule+0x880/0x1b10
[ 5408.417096][ T44] ? io_schedule_timeout+0x150/0x150
[ 5408.417351][ T44] ? schedule+0x1ee/0x270
[ 5408.417517][ T44] ? __lock_release+0x5d/0x170
[ 5408.417771][ T44] schedule+0xe2/0x270
[ 5408.417946][ T44] schedule_preempt_disabled+0x18/0x30
[ 5408.418165][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5408.418387][ T44] ? __lock_acquire+0x449/0x7e0
[ 5408.418605][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5408.418849][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.419072][ T44] ? lock_acquire+0x104/0x160
[ 5408.419287][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5408.419519][ T44] down_write+0x1d6/0x200
[ 5408.419685][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5408.419973][ T44] ? find_held_lock+0x2b/0x80
[ 5408.420198][ T44] ? __create_object+0x5e/0xb0
[ 5408.420422][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 5408.420659][ T44] register_pernet_subsys+0x1a/0x40
[ 5408.420887][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5408.421114][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 5408.421341][ T44] do_one_initcall+0x8c/0x1d0
[ 5408.421564][ T44] ? trace_initcall_start+0x130/0x130
[ 5408.421814][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.422035][ T44] ? trace_kmalloc+0x26/0xd0
[ 5408.422263][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5408.422481][ T44] ? debug_objects_oom+0x160/0x160
[ 5408.422704][ T44] ? kasan_unpoison+0x27/0x50
[ 5408.422931][ T44] ? __asan_register_globals+0x5d/0x70
[ 5408.423155][ T44] do_init_module+0x27a/0x860
[ 5408.423383][ T44] ? free_module+0x2f0/0x2f0
[ 5408.423600][ T44] ? kfree+0x21d/0x540
[ 5408.423780][ T44] ? load_module+0x20c5/0x2dd0
[ 5408.424006][ T44] load_module+0x1f40/0x2dd0
[ 5408.424235][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5408.424507][ T44] ? kernel_read_file+0x3ed/0x550
[ 5408.424737][ T44] ? kernel_read_file+0x3c8/0x550
[ 5408.424958][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5408.425182][ T44] ? init_module_from_file+0xe9/0x150
[ 5408.425400][ T44] init_module_from_file+0xe9/0x150
[ 5408.425628][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5408.425886][ T44] ? idempotent_init_module+0x316/0x610
[ 5408.426106][ T44] ? __lock_release+0x5d/0x170
[ 5408.426328][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5408.426547][ T44] idempotent_init_module+0x331/0x610
[ 5408.426776][ T44] ? init_module_from_file+0x150/0x150
[ 5408.427018][ T44] ? cap_capable+0x94/0x230
[ 5408.427249][ T44] __x64_sys_finit_module+0xca/0x150
[ 5408.427470][ T44] ? do_syscall_64+0x85/0xfd0
[ 5408.427693][ T44] do_syscall_64+0xc1/0xfd0
[ 5408.427920][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5408.428193][ T44] RIP: 0033:0x7f3257c4992d
[ 5408.428422][ T44] RSP: 002b:00007ffe11740368 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5408.428771][ T44] RAX: ffffffffffffffda RBX: 000055a639e11ac0 RCX: 00007f3257c4992d
[ 5408.429100][ T44] RDX: 0000000000000000 RSI: 000055a62d638a2a RDI: 0000000000000005
[ 5408.429432][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe117404a0
[ 5408.429780][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055a62d638a2a
[ 5408.430126][ T44] R13: 000055a639e11b60 R14: 000055a639e11da0 R15: 0000000000000000
[ 5408.430471][ T44]
[ 5408.430643][ T44] INFO: task modprobe:524 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5408.431115][ T44] task:kworker/u16:0 state:R running task stack:25856 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5408.431663][ T44] Workqueue: netns cleanup_net
[ 5408.431895][ T44] Call Trace:
[ 5408.432062][ T44]
[ 5408.432182][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5408.432404][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5408.432625][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.432857][ T44] ? trace_contention_end+0xd8/0x140
[ 5408.433077][ T44] ? __mutex_lock+0x19f/0x1190
[ 5408.433303][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5408.433555][ T44] ? irqentry_exit+0x3b/0x80
[ 5408.433802][ T44] ? lockdep_hardirqs_on+0x7c/0x110
[ 5408.434023][ T44] ? asm_common_interrupt+0x26/0x40
[ 5408.434254][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5408.434543][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5408.434896][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5408.435231][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5408.435568][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5408.435861][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5408.436141][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5408.436364][ T44] ? ops_undo_list+0x2bf/0x890
[ 5408.436596][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5408.436822][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5408.437049][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5408.437269][ T44] ? net_passive_dec+0x190/0x190
[ 5408.437493][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.437724][ T44] ? process_one_work+0xe35/0x1650
[ 5408.437980][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5408.438218][ T44] ? assign_work+0x168/0x240
[ 5408.438445][ T44] ? worker_thread+0x591/0xcf0
[ 5408.438679][ T44] ? rescuer_thread+0xd10/0xd10
[ 5408.438909][ T44] ? kthread+0x37b/0x5f0
[ 5408.439078][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.439296][ T44] ? ret_from_fork+0x1b/0x270
[ 5408.439516][ T44] ? __lock_release+0x5d/0x170
[ 5408.439742][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.439977][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.440199][ T44] ? ret_from_fork+0x1db/0x270
[ 5408.440415][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.440638][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5408.440877][ T44]
[ 5408.441090][ T44]
[ 5408.441090][ T44] Showing all locks held in the system:
[ 5408.441403][ T44] 5 locks held by kworker/u16:0/12:
[ 5408.441626][ T44] 1 lock held by khungtaskd/44:
[ 5408.442214][ T44] #0: ffffffffb9388540 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5408.442613][ T44] 1 lock held by modprobe/524:
[ 5408.442830][ T44] #0: ffffffffb9a80910 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5408.443262][ T44]
[ 5408.443369][ T44] =============================================
[ 5408.443369][ T44]
[ 5531.294904][ T44] INFO: task modprobe:524 blocked for more than 1228 seconds.
[ 5531.295411][ T44] Not tainted 6.18.0-rc5-virtme #1
[ 5531.295640][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5531.296048][ T44] task:modprobe state:D stack:25664 pid:524 tgid:524 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5531.296584][ T44] Call Trace:
[ 5531.296771][ T44]
[ 5531.296897][ T44] __schedule+0x880/0x1b10
[ 5531.297159][ T44] ? io_schedule_timeout+0x150/0x150
[ 5531.297406][ T44] ? schedule+0x1ee/0x270
[ 5531.297580][ T44] ? __lock_release+0x5d/0x170
[ 5531.297816][ T44] schedule+0xe2/0x270
[ 5531.297993][ T44] schedule_preempt_disabled+0x18/0x30
[ 5531.298235][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5531.298482][ T44] ? __lock_acquire+0x449/0x7e0
[ 5531.298700][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5531.298940][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.299174][ T44] ? lock_acquire+0x104/0x160
[ 5531.299415][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5531.299653][ T44] down_write+0x1d6/0x200
[ 5531.299830][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5531.300122][ T44] ? find_held_lock+0x2b/0x80
[ 5531.300375][ T44] ? __create_object+0x5e/0xb0
[ 5531.300606][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 5531.300846][ T44] register_pernet_subsys+0x1a/0x40
[ 5531.301078][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5531.301310][ T44] ? _sub_I_65535_1+0x200/0x200 [pktgen]
[ 5531.301534][ T44] do_one_initcall+0x8c/0x1d0
[ 5531.301775][ T44] ? trace_initcall_start+0x130/0x130
[ 5531.302000][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.302227][ T44] ? trace_kmalloc+0x26/0xd0
[ 5531.302458][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5531.302679][ T44] ? debug_objects_oom+0x160/0x160
[ 5531.302918][ T44] ? kasan_unpoison+0x27/0x50
[ 5531.303148][ T44] ? __asan_register_globals+0x5d/0x70
[ 5531.303390][ T44] do_init_module+0x27a/0x860
[ 5531.303621][ T44] ? free_module+0x2f0/0x2f0
[ 5531.303851][ T44] ? kfree+0x21d/0x540
[ 5531.304025][ T44] ? load_module+0x20c5/0x2dd0
[ 5531.304261][ T44] load_module+0x1f40/0x2dd0
[ 5531.304495][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5531.304779][ T44] ? kernel_read_file+0x3ed/0x550
[ 5531.305005][ T44] ? kernel_read_file+0x3c8/0x550
[ 5531.305248][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5531.305478][ T44] ? init_module_from_file+0xe9/0x150
[ 5531.305699][ T44] init_module_from_file+0xe9/0x150
[ 5531.305928][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5531.306174][ T44] ? idempotent_init_module+0x316/0x610
[ 5531.306405][ T44] ? __lock_release+0x5d/0x170
[ 5531.306628][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5531.306865][ T44] idempotent_init_module+0x331/0x610
[ 5531.307094][ T44] ? init_module_from_file+0x150/0x150
[ 5531.307332][ T44] ? cap_capable+0x94/0x230
[ 5531.307560][ T44] __x64_sys_finit_module+0xca/0x150
[ 5531.307786][ T44] ? do_syscall_64+0x85/0xfd0
[ 5531.308026][ T44] do_syscall_64+0xc1/0xfd0
[ 5531.308259][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5531.308543][ T44] RIP: 0033:0x7f3257c4992d
[ 5531.308787][ T44] RSP: 002b:00007ffe11740368 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5531.309131][ T44] RAX: ffffffffffffffda RBX: 000055a639e11ac0 RCX: 00007f3257c4992d
[ 5531.309480][ T44] RDX: 0000000000000000 RSI: 000055a62d638a2a RDI: 0000000000000005
[ 5531.309824][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe117404a0
[ 5531.310173][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055a62d638a2a
[ 5531.310516][ T44] R13: 000055a639e11b60 R14: 000055a639e11da0 R15: 0000000000000000
[ 5531.310876][ T44]
[ 5531.311059][ T44] INFO: task modprobe:524 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5531.311550][ T44] task:kworker/u16:0 state:R running task stack:25856 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5531.312110][ T44] Workqueue: netns cleanup_net
[ 5531.312354][ T44] Call Trace:
[ 5531.312526][ T44]
[ 5531.312644][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5531.312882][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5531.313119][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.313354][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.313578][ T44] ? trace_contention_end+0xd8/0x140
[ 5531.313806][ T44] ? __mutex_lock+0x19f/0x1190
[ 5531.314034][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5531.314272][ T44] ? irqentry_exit+0x3b/0x80
[ 5531.314489][ T44] ? common_interrupt+0x9b/0xe0
[ 5531.314713][ T44] ? asm_common_interrupt+0x26/0x40
[ 5531.314964][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5531.315274][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5531.315618][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5531.315964][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5531.316328][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5531.316629][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5531.316918][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5531.317159][ T44] ? ops_undo_list+0x2bf/0x890
[ 5531.317396][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5531.317616][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5531.317851][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5531.318081][ T44] ? net_passive_dec+0x190/0x190
[ 5531.318325][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.318549][ T44] ? process_one_work+0xe35/0x1650
[ 5531.318790][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5531.319023][ T44] ? assign_work+0x168/0x240
[ 5531.319264][ T44] ? worker_thread+0x591/0xcf0
[ 5531.319493][ T44] ? rescuer_thread+0xd10/0xd10
[ 5531.319713][ T44] ? kthread+0x37b/0x5f0
[ 5531.319890][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.320125][ T44] ? ret_from_fork+0x1b/0x270
[ 5531.320357][ T44] ? __lock_release+0x5d/0x170
[ 5531.320578][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.320806][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.321032][ T44] ? ret_from_fork+0x1db/0x270
[ 5531.321258][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.321478][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5531.321713][ T44]
[ 5531.321909][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings
[ 5531.322336][ T44]
[ 5531.322336][ T44] Showing all locks held in the system:
[ 5531.322659][ T44] 5 locks held by kworker/u16:0/12:
[ 5531.322894][ T44] 1 lock held by khungtaskd/44:
[ 5531.323118][ T44] #0: ffffffffb9388540 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5531.323542][ T44] 1 lock held by modprobe/524:
[ 5531.323770][ T44] #0: ffffffffb9a80910 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5531.324222][ T44]
[ 5531.324342][ T44] =============================================
[ 5531.324342][ T44]
WAIT TIMEOUT stderr
Ctrl-C stderr
Ctrl-C stderr