[ 4279.328912][T31611] pktgen: Packet Generator for packet performance testing. Version: 2.75
[ 4425.346710][ T44] INFO: task modprobe:31611 blocked for more than 122 seconds.
[ 4425.347395][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 4425.347680][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4425.348141][ T44] task:modprobe state:D stack:25664 pid:31611 tgid:31611 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4425.348702][ T44] Call Trace:
[ 4425.348879][ T44]
[ 4425.349007][ T44] __schedule+0x880/0x1b10
[ 4425.349265][ T44] ? io_schedule_timeout+0x150/0x150
[ 4425.349511][ T44] ? schedule+0x1ee/0x270
[ 4425.349704][ T44] ? __lock_release+0x5d/0x170
[ 4425.349949][ T44] schedule+0xe2/0x270
[ 4425.350121][ T44] schedule_preempt_disabled+0x18/0x30
[ 4425.350345][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4425.350581][ T44] ? __lock_acquire+0x449/0x7e0
[ 4425.350820][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4425.351052][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.351279][ T44] ? lock_acquire+0x104/0x160
[ 4425.351508][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4425.351770][ T44] down_write+0x1d6/0x200
[ 4425.351943][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4425.352217][ T44] ? find_held_lock+0x2b/0x80
[ 4425.352445][ T44] ? __create_object+0x5e/0xb0
[ 4425.352694][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4425.352929][ T44] register_pernet_subsys+0x1a/0x40
[ 4425.353164][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4425.353393][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4425.353640][ T44] do_one_initcall+0x8c/0x1d0
[ 4425.353868][ T44] ? trace_initcall_start+0x130/0x130
[ 4425.354092][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.354314][ T44] ? trace_kmalloc+0x26/0xd0
[ 4425.354544][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4425.355342][ T44] ? debug_objects_oom+0x160/0x160
[ 4425.355609][ T44] ? kasan_unpoison+0x27/0x50
[ 4425.355838][ T44] ? __asan_register_globals+0x5d/0x70
[ 4425.356063][ T44] do_init_module+0x27a/0x860
[ 4425.356299][ T44] ? free_module+0x2f0/0x2f0
[ 4425.356522][ T44] ? kfree+0x21d/0x540
[ 4425.356714][ T44] ? load_module+0x20c5/0x2dd0
[ 4425.356946][ T44] load_module+0x1f40/0x2dd0
[ 4425.357192][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4425.357472][ T44] ? kernel_read_file+0x3ed/0x550
[ 4425.357719][ T44] ? kernel_read_file+0x3c8/0x550
[ 4425.357948][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4425.358178][ T44] ? init_module_from_file+0xe9/0x150
[ 4425.358401][ T44] init_module_from_file+0xe9/0x150
[ 4425.358658][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4425.358909][ T44] ? idempotent_init_module+0x316/0x610
[ 4425.359135][ T44] ? __lock_release+0x5d/0x170
[ 4425.359364][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4425.359611][ T44] idempotent_init_module+0x331/0x610
[ 4425.359837][ T44] ? init_module_from_file+0x150/0x150
[ 4425.360074][ T44] ? cap_capable+0x94/0x230
[ 4425.360304][ T44] __x64_sys_finit_module+0xca/0x150
[ 4425.360544][ T44] ? do_syscall_64+0x85/0xfd0
[ 4425.360789][ T44] do_syscall_64+0xc1/0xfd0
[ 4425.361016][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4425.361293][ T44] RIP: 0033:0x7efc8d40c92d
[ 4425.361534][ T44] RSP: 002b:00007ffc9b2ac7d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4425.361895][ T44] RAX: ffffffffffffffda RBX: 0000562f4105aac0 RCX: 00007efc8d40c92d
[ 4425.362244][ T44] RDX: 0000000000000000 RSI: 0000562f1a4d0a2a RDI: 0000000000000005
[ 4425.362605][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc9b2ac910
[ 4425.362946][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562f1a4d0a2a
[ 4425.363283][ T44] R13: 0000562f4105ab60 R14: 0000562f4105ada0 R15: 0000000000000000
[ 4425.363667][ T44]
[ 4425.363846][ T44] INFO: task modprobe:31611 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4425.364326][ T44] task:kworker/u16:0 state:R running task stack:24304 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4425.364908][ T44] Workqueue: netns cleanup_net
[ 4425.365145][ T44] Call Trace:
[ 4425.365326][ T44]
[ 4425.365442][ T44] ? __mutex_lock+0x19f/0x1190
[ 4425.365699][ T44] ? _raw_spin_lock_nested+0x39/0x50
[ 4425.365922][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4425.366151][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.366377][ T44] ? trace_irq_disable.constprop.0+0xd0/0x130
[ 4425.366675][ T44] ? irqentry_exit+0x3b/0x80
[ 4425.366897][ T44] ? common_interrupt+0x9b/0xe0
[ 4425.367130][ T44] ? asm_common_interrupt+0x26/0x40
[ 4425.367365][ T44] ? nf_ct_iterate_cleanup+0x9b/0x340 [nf_conntrack]
[ 4425.367681][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4425.368028][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4425.368368][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4425.368747][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4425.369039][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4425.369323][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4425.369562][ T44] ? ops_undo_list+0x2bf/0x890
[ 4425.369804][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4425.370026][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4425.370257][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4425.370493][ T44] ? net_passive_dec+0x190/0x190
[ 4425.370735][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.370965][ T44] ? process_one_work+0xe35/0x1650
[ 4425.371201][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4425.371431][ T44] ? assign_work+0x168/0x240
[ 4425.371679][ T44] ? worker_thread+0x591/0xcf0
[ 4425.371911][ T44] ? rescuer_thread+0xd10/0xd10
[ 4425.372151][ T44] ? kthread+0x37b/0x5f0
[ 4425.372324][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4425.372556][ T44] ? ret_from_fork+0x1b/0x270
[ 4425.372793][ T44] ? __lock_release+0x5d/0x170
[ 4425.373020][ T44] ? rcu_is_watching+0x12/0xb0
[ 4425.373246][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4425.373471][ T44] ? ret_from_fork+0x1db/0x270
[ 4425.373713][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4425.373937][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4425.374180][ T44]
[ 4425.374358][ T44]
[ 4425.374358][ T44] Showing all locks held in the system:
[ 4425.374704][ T44] 4 locks held by kworker/u16:0/12:
[ 4425.374949][ T44] 1 lock held by khungtaskd/44:
[ 4425.375166][ T44] #0: ffffffff91188580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4425.375583][ T44] 1 lock held by modprobe/31611:
[ 4425.375818][ T44] #0: ffffffff91880690 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4425.376257][ T44]
[ 4425.376368][ T44] =============================================
[ 4425.376368][ T44]
[ 4548.226708][ T44] INFO: task modprobe:31611 blocked for more than 245 seconds.
[ 4548.227154][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 4548.227370][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4548.227791][ T44] task:modprobe state:D stack:25664 pid:31611 tgid:31611 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4548.228319][ T44] Call Trace:
[ 4548.228490][ T44]
[ 4548.228627][ T44] __schedule+0x880/0x1b10
[ 4548.228871][ T44] ? io_schedule_timeout+0x150/0x150
[ 4548.229109][ T44] ? schedule+0x1ee/0x270
[ 4548.229280][ T44] ? __lock_release+0x5d/0x170
[ 4548.229512][ T44] schedule+0xe2/0x270
[ 4548.229694][ T44] schedule_preempt_disabled+0x18/0x30
[ 4548.229923][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4548.230150][ T44] ? __lock_acquire+0x449/0x7e0
[ 4548.230374][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4548.230616][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.230845][ T44] ? lock_acquire+0x104/0x160
[ 4548.231069][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4548.231304][ T44] down_write+0x1d6/0x200
[ 4548.231485][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4548.231772][ T44] ? find_held_lock+0x2b/0x80
[ 4548.231999][ T44] ? __create_object+0x5e/0xb0
[ 4548.232229][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4548.232459][ T44] register_pernet_subsys+0x1a/0x40
[ 4548.232694][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4548.232924][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4548.233158][ T44] do_one_initcall+0x8c/0x1d0
[ 4548.233383][ T44] ? trace_initcall_start+0x130/0x130
[ 4548.233623][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.233850][ T44] ? trace_kmalloc+0x26/0xd0
[ 4548.234074][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4548.234299][ T44] ? debug_objects_oom+0x160/0x160
[ 4548.234531][ T44] ? kasan_unpoison+0x27/0x50
[ 4548.234764][ T44] ? __asan_register_globals+0x5d/0x70
[ 4548.235001][ T44] do_init_module+0x27a/0x860
[ 4548.235234][ T44] ? free_module+0x2f0/0x2f0
[ 4548.235456][ T44] ? kfree+0x21d/0x540
[ 4548.235635][ T44] ? load_module+0x20c5/0x2dd0
[ 4548.235867][ T44] load_module+0x1f40/0x2dd0
[ 4548.236103][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4548.236391][ T44] ? kernel_read_file+0x3ed/0x550
[ 4548.236639][ T44] ? kernel_read_file+0x3c8/0x550
[ 4548.236869][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4548.237098][ T44] ? init_module_from_file+0xe9/0x150
[ 4548.237322][ T44] init_module_from_file+0xe9/0x150
[ 4548.237546][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4548.237802][ T44] ? idempotent_init_module+0x316/0x610
[ 4548.238032][ T44] ? __lock_release+0x5d/0x170
[ 4548.238267][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4548.238495][ T44] idempotent_init_module+0x331/0x610
[ 4548.238730][ T44] ? init_module_from_file+0x150/0x150
[ 4548.238967][ T44] ? cap_capable+0x94/0x230
[ 4548.239208][ T44] __x64_sys_finit_module+0xca/0x150
[ 4548.239434][ T44] ? do_syscall_64+0x85/0xfd0
[ 4548.239679][ T44] do_syscall_64+0xc1/0xfd0
[ 4548.239917][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4548.240207][ T44] RIP: 0033:0x7efc8d40c92d
[ 4548.240441][ T44] RSP: 002b:00007ffc9b2ac7d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4548.240793][ T44] RAX: ffffffffffffffda RBX: 0000562f4105aac0 RCX: 00007efc8d40c92d
[ 4548.241132][ T44] RDX: 0000000000000000 RSI: 0000562f1a4d0a2a RDI: 0000000000000005
[ 4548.241478][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc9b2ac910
[ 4548.241824][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562f1a4d0a2a
[ 4548.242158][ T44] R13: 0000562f4105ab60 R14: 0000562f4105ada0 R15: 0000000000000000
[ 4548.242510][ T44]
[ 4548.242700][ T44] INFO: task modprobe:31611 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4548.243186][ T44] task:kworker/u16:0 state:R running task stack:24304 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4548.243747][ T44] Workqueue: netns cleanup_net
[ 4548.243981][ T44] Call Trace:
[ 4548.244151][ T44]
[ 4548.244272][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 4548.244507][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 4548.244742][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.244972][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.245195][ T44] ? trace_contention_end+0xd8/0x140
[ 4548.245418][ T44] ? __mutex_lock+0x19f/0x1190
[ 4548.245654][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4548.245887][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.246109][ T44] ? trace_irq_disable.constprop.0+0xd0/0x130
[ 4548.246401][ T44] ? common_interrupt+0x9b/0xe0
[ 4548.246634][ T44] ? lockdep_hardirqs_on+0x7c/0x110
[ 4548.246858][ T44] ? asm_common_interrupt+0x26/0x40
[ 4548.247095][ T44] ? nf_ct_iterate_cleanup+0x92/0x340 [nf_conntrack]
[ 4548.247385][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4548.247739][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4548.248098][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4548.248442][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4548.248745][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4548.249031][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4548.249264][ T44] ? ops_undo_list+0x2bf/0x890
[ 4548.249498][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4548.249742][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4548.249975][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4548.250200][ T44] ? net_passive_dec+0x190/0x190
[ 4548.250434][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.250677][ T44] ? process_one_work+0xe35/0x1650
[ 4548.250914][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4548.251147][ T44] ? assign_work+0x168/0x240
[ 4548.251386][ T44] ? worker_thread+0x591/0xcf0
[ 4548.251628][ T44] ? rescuer_thread+0xd10/0xd10
[ 4548.251855][ T44] ? kthread+0x37b/0x5f0
[ 4548.252027][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.252249][ T44] ? ret_from_fork+0x1b/0x270
[ 4548.252477][ T44] ? __lock_release+0x5d/0x170
[ 4548.252718][ T44] ? rcu_is_watching+0x12/0xb0
[ 4548.252944][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.253178][ T44] ? ret_from_fork+0x1db/0x270
[ 4548.253403][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4548.253637][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4548.253879][ T44]
[ 4548.254061][ T44]
[ 4548.254061][ T44] Showing all locks held in the system:
[ 4548.254385][ T44] 5 locks held by kworker/u16:0/12:
[ 4548.254627][ T44] 1 lock held by khungtaskd/44:
[ 4548.254840][ T44] #0: ffffffff91188580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4548.255264][ T44] 1 lock held by modprobe/31611:
[ 4548.255483][ T44] #0: ffffffff91880690 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4548.255933][ T44]
[ 4548.256043][ T44] =============================================
[ 4548.256043][ T44]
[ 4671.106678][ T44] INFO: task modprobe:31611 blocked for more than 368 seconds.
[ 4671.107147][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 4671.107366][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4671.107763][ T44] task:modprobe state:D stack:25664 pid:31611 tgid:31611 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4671.108265][ T44] Call Trace:
[ 4671.108431][ T44]
[ 4671.108555][ T44] __schedule+0x880/0x1b10
[ 4671.108815][ T44] ? io_schedule_timeout+0x150/0x150
[ 4671.109058][ T44] ? schedule+0x1ee/0x270
[ 4671.109234][ T44] ? __lock_release+0x5d/0x170
[ 4671.109474][ T44] schedule+0xe2/0x270
[ 4671.109654][ T44] schedule_preempt_disabled+0x18/0x30
[ 4671.109882][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4671.110112][ T44] ? __lock_acquire+0x449/0x7e0
[ 4671.110332][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4671.110573][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.110807][ T44] ? lock_acquire+0x104/0x160
[ 4671.111027][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4671.111259][ T44] down_write+0x1d6/0x200
[ 4671.111427][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4671.111707][ T44] ? find_held_lock+0x2b/0x80
[ 4671.111932][ T44] ? __create_object+0x5e/0xb0
[ 4671.112163][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4671.112393][ T44] register_pernet_subsys+0x1a/0x40
[ 4671.112621][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4671.112846][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4671.113066][ T44] do_one_initcall+0x8c/0x1d0
[ 4671.113290][ T44] ? trace_initcall_start+0x130/0x130
[ 4671.113510][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.113750][ T44] ? trace_kmalloc+0x26/0xd0
[ 4671.113971][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4671.114190][ T44] ? debug_objects_oom+0x160/0x160
[ 4671.114414][ T44] ? kasan_unpoison+0x27/0x50
[ 4671.114644][ T44] ? __asan_register_globals+0x5d/0x70
[ 4671.114869][ T44] do_init_module+0x27a/0x860
[ 4671.115098][ T44] ? free_module+0x2f0/0x2f0
[ 4671.115316][ T44] ? kfree+0x21d/0x540
[ 4671.115489][ T44] ? load_module+0x20c5/0x2dd0
[ 4671.115722][ T44] load_module+0x1f40/0x2dd0
[ 4671.115955][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4671.116228][ T44] ? kernel_read_file+0x3ed/0x550
[ 4671.116452][ T44] ? kernel_read_file+0x3c8/0x550
[ 4671.116683][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4671.116911][ T44] ? init_module_from_file+0xe9/0x150
[ 4671.117141][ T44] init_module_from_file+0xe9/0x150
[ 4671.117362][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4671.117608][ T44] ? idempotent_init_module+0x316/0x610
[ 4671.117829][ T44] ? __lock_release+0x5d/0x170
[ 4671.118048][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4671.118270][ T44] idempotent_init_module+0x331/0x610
[ 4671.118492][ T44] ? init_module_from_file+0x150/0x150
[ 4671.118737][ T44] ? cap_capable+0x94/0x230
[ 4671.118966][ T44] __x64_sys_finit_module+0xca/0x150
[ 4671.119188][ T44] ? do_syscall_64+0x85/0xfd0
[ 4671.119412][ T44] do_syscall_64+0xc1/0xfd0
[ 4671.119644][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4671.119917][ T44] RIP: 0033:0x7efc8d40c92d
[ 4671.120148][ T44] RSP: 002b:00007ffc9b2ac7d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4671.120488][ T44] RAX: ffffffffffffffda RBX: 0000562f4105aac0 RCX: 00007efc8d40c92d
[ 4671.120827][ T44] RDX: 0000000000000000 RSI: 0000562f1a4d0a2a RDI: 0000000000000005
[ 4671.121157][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc9b2ac910
[ 4671.121482][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562f1a4d0a2a
[ 4671.121826][ T44] R13: 0000562f4105ab60 R14: 0000562f4105ada0 R15: 0000000000000000
[ 4671.122173][ T44]
[ 4671.122343][ T44] INFO: task modprobe:31611 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4671.122818][ T44] task:kworker/u16:0 state:R running task stack:24304 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4671.123361][ T44] Workqueue: netns cleanup_net
[ 4671.123586][ T44] Call Trace:
[ 4671.123759][ T44]
[ 4671.123872][ T44] ? __mutex_lock+0x19f/0x1190
[ 4671.124095][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4671.124328][ T44] ? irqentry_exit+0x3b/0x80
[ 4671.124546][ T44] ? common_interrupt+0x9b/0xe0
[ 4671.124775][ T44] ? lockdep_hardirqs_on+0x7c/0x110
[ 4671.124999][ T44] ? asm_common_interrupt+0x26/0x40
[ 4671.125230][ T44] ? nf_ct_iterate_cleanup+0x89/0x340 [nf_conntrack]
[ 4671.125518][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4671.125867][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4671.126202][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4671.126544][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4671.126835][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4671.127120][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4671.127346][ T44] ? ops_undo_list+0x2bf/0x890
[ 4671.127571][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4671.127796][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4671.128032][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4671.128253][ T44] ? net_passive_dec+0x190/0x190
[ 4671.128479][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.128711][ T44] ? process_one_work+0xe35/0x1650
[ 4671.128943][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4671.129170][ T44] ? assign_work+0x168/0x240
[ 4671.129392][ T44] ? worker_thread+0x591/0xcf0
[ 4671.129629][ T44] ? rescuer_thread+0xd10/0xd10
[ 4671.129855][ T44] ? kthread+0x37b/0x5f0
[ 4671.130026][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.130242][ T44] ? ret_from_fork+0x1b/0x270
[ 4671.130461][ T44] ? __lock_release+0x5d/0x170
[ 4671.130690][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.130909][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.131128][ T44] ? ret_from_fork+0x1db/0x270
[ 4671.131343][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.131566][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4671.131808][ T44]
[ 4671.131984][ T44]
[ 4671.131984][ T44] Showing all locks held in the system:
[ 4671.132295][ T44] 5 locks held by kworker/u16:0/12:
[ 4671.132517][ T44] 1 lock held by khungtaskd/44:
[ 4671.132736][ T44] #0: ffffffff91188580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4671.133135][ T44] 1 lock held by modprobe/31611:
[ 4671.133355][ T44] #0: ffffffff91880690 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4671.133795][ T44]
[ 4671.133902][ T44] =============================================
[ 4671.133902][ T44]
[ 4793.986669][ T44] INFO: task modprobe:31611 blocked for more than 491 seconds.
[ 4793.987143][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 4793.987370][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4793.987771][ T44] task:modprobe state:D stack:25664 pid:31611 tgid:31611 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4793.988272][ T44] Call Trace:
[ 4793.988439][ T44]
[ 4793.988559][ T44] __schedule+0x880/0x1b10
[ 4793.988810][ T44] ? io_schedule_timeout+0x150/0x150
[ 4793.989047][ T44] ? schedule+0x1ee/0x270
[ 4793.989226][ T44] ? __lock_release+0x5d/0x170
[ 4793.989455][ T44] schedule+0xe2/0x270
[ 4793.989636][ T44] schedule_preempt_disabled+0x18/0x30
[ 4793.989858][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4793.990081][ T44] ? __lock_acquire+0x449/0x7e0
[ 4793.990305][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4793.990532][ T44] ? rcu_is_watching+0x12/0xb0
[ 4793.990767][ T44] ? lock_acquire+0x104/0x160
[ 4793.990994][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4793.991223][ T44] down_write+0x1d6/0x200
[ 4793.991390][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4793.991670][ T44] ? find_held_lock+0x2b/0x80
[ 4793.991891][ T44] ? __create_object+0x5e/0xb0
[ 4793.992114][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4793.992341][ T44] register_pernet_subsys+0x1a/0x40
[ 4793.992569][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4793.992805][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4793.993031][ T44] do_one_initcall+0x8c/0x1d0
[ 4793.993253][ T44] ? trace_initcall_start+0x130/0x130
[ 4793.993472][ T44] ? rcu_is_watching+0x12/0xb0
[ 4793.993701][ T44] ? trace_kmalloc+0x26/0xd0
[ 4793.993921][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4793.994148][ T44] ? debug_objects_oom+0x160/0x160
[ 4793.994372][ T44] ? kasan_unpoison+0x27/0x50
[ 4793.994603][ T44] ? __asan_register_globals+0x5d/0x70
[ 4793.994828][ T44] do_init_module+0x27a/0x860
[ 4793.995056][ T44] ? free_module+0x2f0/0x2f0
[ 4793.995273][ T44] ? kfree+0x21d/0x540
[ 4793.995439][ T44] ? load_module+0x20c5/0x2dd0
[ 4793.995673][ T44] load_module+0x1f40/0x2dd0
[ 4793.995914][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4793.996185][ T44] ? kernel_read_file+0x3ed/0x550
[ 4793.996415][ T44] ? kernel_read_file+0x3c8/0x550
[ 4793.996653][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4793.996881][ T44] ? init_module_from_file+0xe9/0x150
[ 4793.997100][ T44] init_module_from_file+0xe9/0x150
[ 4793.997320][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4793.997563][ T44] ? idempotent_init_module+0x316/0x610
[ 4793.997792][ T44] ? __lock_release+0x5d/0x170
[ 4793.998018][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4793.998241][ T44] idempotent_init_module+0x331/0x610
[ 4793.998464][ T44] ? init_module_from_file+0x150/0x150
[ 4793.998712][ T44] ? cap_capable+0x94/0x230
[ 4793.998944][ T44] __x64_sys_finit_module+0xca/0x150
[ 4793.999164][ T44] ? do_syscall_64+0x85/0xfd0
[ 4793.999385][ T44] do_syscall_64+0xc1/0xfd0
[ 4793.999616][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4793.999892][ T44] RIP: 0033:0x7efc8d40c92d
[ 4794.000120][ T44] RSP: 002b:00007ffc9b2ac7d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4794.000454][ T44] RAX: ffffffffffffffda RBX: 0000562f4105aac0 RCX: 00007efc8d40c92d
[ 4794.000800][ T44] RDX: 0000000000000000 RSI: 0000562f1a4d0a2a RDI: 0000000000000005
[ 4794.001133][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc9b2ac910
[ 4794.001463][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562f1a4d0a2a
[ 4794.001804][ T44] R13: 0000562f4105ab60 R14: 0000562f4105ada0 R15: 0000000000000000
[ 4794.002158][ T44]
[ 4794.002327][ T44] INFO: task modprobe:31611 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4794.002806][ T44] task:kworker/u16:0 state:R running task stack:24304 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4794.003347][ T44] Workqueue: netns cleanup_net
[ 4794.003578][ T44] Call Trace:
[ 4794.003751][ T44]
[ 4794.003869][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 4794.004091][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 4794.004312][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.004537][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.004766][ T44] ? trace_contention_end+0xd8/0x140
[ 4794.004987][ T44] ? __mutex_lock+0x19f/0x1190
[ 4794.005216][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4794.005441][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.005695][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4794.005980][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4794.006318][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4794.006669][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4794.007018][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4794.007310][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4794.007590][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4794.007824][ T44] ? ops_undo_list+0x2bf/0x890
[ 4794.008052][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4794.008271][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4794.008508][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4794.008738][ T44] ? net_passive_dec+0x190/0x190
[ 4794.008963][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.009186][ T44] ? process_one_work+0xe35/0x1650
[ 4794.009416][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4794.009654][ T44] ? assign_work+0x168/0x240
[ 4794.009877][ T44] ? worker_thread+0x591/0xcf0
[ 4794.010105][ T44] ? rescuer_thread+0xd10/0xd10
[ 4794.010331][ T44] ? kthread+0x37b/0x5f0
[ 4794.010500][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4794.010727][ T44] ? ret_from_fork+0x1b/0x270
[ 4794.010951][ T44] ? __lock_release+0x5d/0x170
[ 4794.011172][ T44] ? rcu_is_watching+0x12/0xb0
[ 4794.011393][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4794.011621][ T44] ? ret_from_fork+0x1db/0x270
[ 4794.011840][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4794.012066][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4794.012302][ T44]
[ 4794.012482][ T44]
[ 4794.012482][ T44] Showing all locks held in the system:
[ 4794.012804][ T44] 4 locks held by kworker/u16:0/12:
[ 4794.013027][ T44] 1 lock held by khungtaskd/44:
[ 4794.013237][ T44] #0: ffffffff91188580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4794.013644][ T44] 1 lock held by modprobe/31611:
[ 4794.013861][ T44] #0: ffffffff91880690 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4794.014292][ T44]
[ 4794.014399][ T44] =============================================
[ 4794.014399][ T44]
[ 4916.866661][ T44] INFO: task modprobe:31611 blocked for more than 614 seconds.
[ 4916.867061][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 4916.867276][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4916.867711][ T44] task:modprobe state:D stack:25664 pid:31611 tgid:31611 ppid:1 task_flags:0x400100 flags:0x00080003
[ 4916.868203][ T44] Call Trace:
[ 4916.868368][ T44]
[ 4916.868485][ T44] __schedule+0x880/0x1b10
[ 4916.868749][ T44] ? io_schedule_timeout+0x150/0x150
[ 4916.868985][ T44] ? schedule+0x1ee/0x270
[ 4916.869150][ T44] ? __lock_release+0x5d/0x170
[ 4916.869384][ T44] schedule+0xe2/0x270
[ 4916.869554][ T44] schedule_preempt_disabled+0x18/0x30
[ 4916.869786][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 4916.870012][ T44] ? __lock_acquire+0x449/0x7e0
[ 4916.870229][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 4916.870457][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.870690][ T44] ? lock_acquire+0x104/0x160
[ 4916.870908][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4916.871143][ T44] down_write+0x1d6/0x200
[ 4916.871311][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 4916.871581][ T44] ? find_held_lock+0x2b/0x80
[ 4916.871814][ T44] ? __create_object+0x5e/0xb0
[ 4916.872042][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4916.872269][ T44] register_pernet_subsys+0x1a/0x40
[ 4916.872490][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4916.872746][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 4916.872971][ T44] do_one_initcall+0x8c/0x1d0
[ 4916.873193][ T44] ? trace_initcall_start+0x130/0x130
[ 4916.873413][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.873641][ T44] ? trace_kmalloc+0x26/0xd0
[ 4916.873862][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 4916.874080][ T44] ? debug_objects_oom+0x160/0x160
[ 4916.874309][ T44] ? kasan_unpoison+0x27/0x50
[ 4916.874529][ T44] ? __asan_register_globals+0x5d/0x70
[ 4916.874761][ T44] do_init_module+0x27a/0x860
[ 4916.874989][ T44] ? free_module+0x2f0/0x2f0
[ 4916.875206][ T44] ? kfree+0x21d/0x540
[ 4916.875371][ T44] ? load_module+0x20c5/0x2dd0
[ 4916.875606][ T44] load_module+0x1f40/0x2dd0
[ 4916.875844][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4916.876127][ T44] ? kernel_read_file+0x3ed/0x550
[ 4916.876350][ T44] ? kernel_read_file+0x3c8/0x550
[ 4916.876573][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4916.876823][ T44] ? init_module_from_file+0xe9/0x150
[ 4916.877044][ T44] init_module_from_file+0xe9/0x150
[ 4916.877264][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4916.877508][ T44] ? idempotent_init_module+0x316/0x610
[ 4916.877736][ T44] ? __lock_release+0x5d/0x170
[ 4916.877960][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4916.878181][ T44] idempotent_init_module+0x331/0x610
[ 4916.878404][ T44] ? init_module_from_file+0x150/0x150
[ 4916.878643][ T44] ? cap_capable+0x94/0x230
[ 4916.878870][ T44] __x64_sys_finit_module+0xca/0x150
[ 4916.879095][ T44] ? do_syscall_64+0x85/0xfd0
[ 4916.879317][ T44] do_syscall_64+0xc1/0xfd0
[ 4916.879539][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4916.879819][ T44] RIP: 0033:0x7efc8d40c92d
[ 4916.880046][ T44] RSP: 002b:00007ffc9b2ac7d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4916.880382][ T44] RAX: ffffffffffffffda RBX: 0000562f4105aac0 RCX: 00007efc8d40c92d
[ 4916.880743][ T44] RDX: 0000000000000000 RSI: 0000562f1a4d0a2a RDI: 0000000000000005
[ 4916.881077][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc9b2ac910
[ 4916.881407][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562f1a4d0a2a
[ 4916.881746][ T44] R13: 0000562f4105ab60 R14: 0000562f4105ada0 R15: 0000000000000000
[ 4916.882098][ T44]
[ 4916.882267][ T44] INFO: task modprobe:31611 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4916.882743][ T44] task:kworker/u16:0 state:R running task stack:24304 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 4916.883283][ T44] Workqueue: netns cleanup_net
[ 4916.883508][ T44] Call Trace:
[ 4916.883685][ T44]
[ 4916.883798][ T44] ? __mutex_lock+0x19f/0x1190
[ 4916.884020][ T44] ? __schedule+0x888/0x1b10
[ 4916.884239][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4916.884463][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.884711][ T44] ? irqentry_exit+0x3b/0x80
[ 4916.884930][ T44] ? common_interrupt+0x9b/0xe0
[ 4916.885151][ T44] ? asm_common_interrupt+0x26/0x40
[ 4916.885389][ T44] ? nf_ct_iterate_cleanup+0x80/0x340 [nf_conntrack]
[ 4916.885685][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4916.886031][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4916.886364][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4916.886711][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4916.887004][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4916.887282][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 4916.887507][ T44] ? ops_undo_list+0x2bf/0x890
[ 4916.887740][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4916.887962][ T44] ? cleanup_net+0x2d6/0x8b0
[ 4916.888189][ T44] ? cleanup_net+0x3b2/0x8b0
[ 4916.888415][ T44] ? net_passive_dec+0x190/0x190
[ 4916.888660][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.888891][ T44] ? process_one_work+0xe35/0x1650
[ 4916.889122][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4916.889349][ T44] ? assign_work+0x168/0x240
[ 4916.889572][ T44] ? worker_thread+0x591/0xcf0
[ 4916.889807][ T44] ? rescuer_thread+0xd10/0xd10
[ 4916.890028][ T44] ? kthread+0x37b/0x5f0
[ 4916.890197][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.890423][ T44] ? ret_from_fork+0x1b/0x270
[ 4916.890650][ T44] ? __lock_release+0x5d/0x170
[ 4916.890871][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.891091][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.891310][ T44] ? ret_from_fork+0x1db/0x270
[ 4916.891528][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.891755][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4916.891990][ T44]
[ 4916.892190][ T44]
[ 4916.892190][ T44] Showing all locks held in the system:
[ 4916.892510][ T44] 5 locks held by kworker/u16:0/12:
[ 4916.893017][ T44] 1 lock held by khungtaskd/44:
[ 4916.893228][ T44] #0: ffffffff91188580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4916.893634][ T44] 1 lock held by modprobe/31611:
[ 4916.893845][ T44] #0: ffffffff91880690 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4916.894282][ T44]
[ 4916.894389][ T44] =============================================
[ 4916.894389][ T44]
[ 5039.746663][ T44] INFO: task modprobe:31611 blocked for more than 737 seconds.
[ 5039.747134][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5039.747343][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5039.747733][ T44] task:modprobe state:D stack:25664 pid:31611 tgid:31611 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5039.748237][ T44] Call Trace:
[ 5039.748409][ T44]
[ 5039.748528][ T44] __schedule+0x880/0x1b10
[ 5039.748777][ T44] ? io_schedule_timeout+0x150/0x150
[ 5039.749014][ T44] ? schedule+0x1ee/0x270
[ 5039.749182][ T44] ? __lock_release+0x5d/0x170
[ 5039.749425][ T44] schedule+0xe2/0x270
[ 5039.749607][ T44] schedule_preempt_disabled+0x18/0x30
[ 5039.749830][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5039.750052][ T44] ? __lock_acquire+0x449/0x7e0
[ 5039.750273][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5039.750502][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.750738][ T44] ? lock_acquire+0x104/0x160
[ 5039.750965][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5039.751192][ T44] down_write+0x1d6/0x200
[ 5039.751357][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5039.751643][ T44] ? find_held_lock+0x2b/0x80
[ 5039.751869][ T44] ? __create_object+0x5e/0xb0
[ 5039.752095][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5039.752322][ T44] register_pernet_subsys+0x1a/0x40
[ 5039.752548][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5039.752784][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5039.753006][ T44] do_one_initcall+0x8c/0x1d0
[ 5039.753230][ T44] ? trace_initcall_start+0x130/0x130
[ 5039.753448][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.753677][ T44] ? trace_kmalloc+0x26/0xd0
[ 5039.753896][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5039.754114][ T44] ? debug_objects_oom+0x160/0x160
[ 5039.754346][ T44] ? kasan_unpoison+0x27/0x50
[ 5039.754565][ T44] ? __asan_register_globals+0x5d/0x70
[ 5039.754797][ T44] do_init_module+0x27a/0x860
[ 5039.755033][ T44] ? free_module+0x2f0/0x2f0
[ 5039.755257][ T44] ? kfree+0x21d/0x540
[ 5039.755422][ T44] ? load_module+0x20c5/0x2dd0
[ 5039.755657][ T44] load_module+0x1f40/0x2dd0
[ 5039.755896][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5039.756170][ T44] ? kernel_read_file+0x3ed/0x550
[ 5039.756394][ T44] ? kernel_read_file+0x3c8/0x550
[ 5039.756623][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5039.756851][ T44] ? init_module_from_file+0xe9/0x150
[ 5039.757070][ T44] init_module_from_file+0xe9/0x150
[ 5039.757291][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5039.757529][ T44] ? idempotent_init_module+0x316/0x610
[ 5039.757758][ T44] ? __lock_release+0x5d/0x170
[ 5039.757981][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5039.758202][ T44] idempotent_init_module+0x331/0x610
[ 5039.758425][ T44] ? init_module_from_file+0x150/0x150
[ 5039.758666][ T44] ? cap_capable+0x94/0x230
[ 5039.758894][ T44] __x64_sys_finit_module+0xca/0x150
[ 5039.759121][ T44] ? do_syscall_64+0x85/0xfd0
[ 5039.759346][ T44] do_syscall_64+0xc1/0xfd0
[ 5039.759570][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5039.759852][ T44] RIP: 0033:0x7efc8d40c92d
[ 5039.760085][ T44] RSP: 002b:00007ffc9b2ac7d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5039.760417][ T44] RAX: ffffffffffffffda RBX: 0000562f4105aac0 RCX: 00007efc8d40c92d
[ 5039.760762][ T44] RDX: 0000000000000000 RSI: 0000562f1a4d0a2a RDI: 0000000000000005
[ 5039.761094][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc9b2ac910
[ 5039.761423][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562f1a4d0a2a
[ 5039.761761][ T44] R13: 0000562f4105ab60 R14: 0000562f4105ada0 R15: 0000000000000000
[ 5039.762114][ T44]
[ 5039.762282][ T44] INFO: task modprobe:31611 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5039.762759][ T44] task:kworker/u16:0 state:R running task stack:24304 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5039.763295][ T44] Workqueue: netns cleanup_net
[ 5039.763519][ T44] Call Trace:
[ 5039.763696][ T44]
[ 5039.763808][ T44] ? __mutex_lock+0x19f/0x1190
[ 5039.764031][ T44] ? __schedule+0x888/0x1b10
[ 5039.764247][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5039.764471][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.764700][ T44] ? irqentry_exit+0x3b/0x80
[ 5039.764919][ T44] ? common_interrupt+0x9b/0xe0
[ 5039.765143][ T44] ? asm_common_interrupt+0x26/0x40
[ 5039.765381][ T44] ? nf_ct_iterate_cleanup+0x92/0x340 [nf_conntrack]
[ 5039.765672][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5039.765956][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5039.766292][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5039.766637][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5039.766983][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5039.767270][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5039.767550][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5039.767781][ T44] ? ops_undo_list+0x2bf/0x890
[ 5039.768007][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5039.768225][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5039.768452][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5039.768686][ T44] ? net_passive_dec+0x190/0x190
[ 5039.768911][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.769133][ T44] ? process_one_work+0xe35/0x1650
[ 5039.769363][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5039.769590][ T44] ? assign_work+0x168/0x240
[ 5039.769823][ T44] ? worker_thread+0x591/0xcf0
[ 5039.770052][ T44] ? rescuer_thread+0xd10/0xd10
[ 5039.770278][ T44] ? kthread+0x37b/0x5f0
[ 5039.770447][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.770672][ T44] ? ret_from_fork+0x1b/0x270
[ 5039.770893][ T44] ? __lock_release+0x5d/0x170
[ 5039.771113][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.771332][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.771552][ T44] ? ret_from_fork+0x1db/0x270
[ 5039.771780][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.771999][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5039.772241][ T44]
[ 5039.772420][ T44]
[ 5039.772420][ T44] Showing all locks held in the system:
[ 5039.772745][ T44] 4 locks held by kworker/u16:0/12:
[ 5039.772964][ T44] 1 lock held by khungtaskd/44:
[ 5039.773172][ T44] #0: ffffffff91188580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5039.773564][ T44] 1 lock held by modprobe/31611:
[ 5039.773789][ T44] #0: ffffffff91880690 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5039.774221][ T44]
[ 5039.774327][ T44] =============================================
[ 5039.774327][ T44]
[ 5162.626667][ T44] INFO: task modprobe:31611 blocked for more than 860 seconds.
[ 5162.627146][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5162.627357][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5162.627743][ T44] task:modprobe state:D stack:25664 pid:31611 tgid:31611 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5162.628240][ T44] Call Trace:
[ 5162.628407][ T44]
[ 5162.628525][ T44] __schedule+0x880/0x1b10
[ 5162.628779][ T44] ? io_schedule_timeout+0x150/0x150
[ 5162.629019][ T44] ? schedule+0x1ee/0x270
[ 5162.629198][ T44] ? __lock_release+0x5d/0x170
[ 5162.629427][ T44] schedule+0xe2/0x270
[ 5162.629618][ T44] schedule_preempt_disabled+0x18/0x30
[ 5162.629839][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5162.630060][ T44] ? __lock_acquire+0x449/0x7e0
[ 5162.630278][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5162.630506][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.630739][ T44] ? lock_acquire+0x104/0x160
[ 5162.630956][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5162.631192][ T44] down_write+0x1d6/0x200
[ 5162.631359][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5162.631639][ T44] ? find_held_lock+0x2b/0x80
[ 5162.631861][ T44] ? __create_object+0x5e/0xb0
[ 5162.632086][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5162.632311][ T44] register_pernet_subsys+0x1a/0x40
[ 5162.632531][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5162.632772][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5162.632993][ T44] do_one_initcall+0x8c/0x1d0
[ 5162.633218][ T44] ? trace_initcall_start+0x130/0x130
[ 5162.633436][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.633667][ T44] ? trace_kmalloc+0x26/0xd0
[ 5162.633887][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5162.634106][ T44] ? debug_objects_oom+0x160/0x160
[ 5162.634341][ T44] ? kasan_unpoison+0x27/0x50
[ 5162.634561][ T44] ? __asan_register_globals+0x5d/0x70
[ 5162.634797][ T44] do_init_module+0x27a/0x860
[ 5162.635023][ T44] ? free_module+0x2f0/0x2f0
[ 5162.635241][ T44] ? kfree+0x21d/0x540
[ 5162.635405][ T44] ? load_module+0x20c5/0x2dd0
[ 5162.635639][ T44] load_module+0x1f40/0x2dd0
[ 5162.635870][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5162.636149][ T44] ? kernel_read_file+0x3ed/0x550
[ 5162.636374][ T44] ? kernel_read_file+0x3c8/0x550
[ 5162.636604][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5162.636831][ T44] ? init_module_from_file+0xe9/0x150
[ 5162.637048][ T44] init_module_from_file+0xe9/0x150
[ 5162.637269][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5162.637504][ T44] ? idempotent_init_module+0x316/0x610
[ 5162.637738][ T44] ? __lock_release+0x5d/0x170
[ 5162.637960][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5162.638181][ T44] idempotent_init_module+0x331/0x610
[ 5162.638404][ T44] ? init_module_from_file+0x150/0x150
[ 5162.638644][ T44] ? cap_capable+0x94/0x230
[ 5162.638871][ T44] __x64_sys_finit_module+0xca/0x150
[ 5162.639095][ T44] ? do_syscall_64+0x85/0xfd0
[ 5162.639318][ T44] do_syscall_64+0xc1/0xfd0
[ 5162.639541][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5162.639821][ T44] RIP: 0033:0x7efc8d40c92d
[ 5162.640052][ T44] RSP: 002b:00007ffc9b2ac7d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5162.640382][ T44] RAX: ffffffffffffffda RBX: 0000562f4105aac0 RCX: 00007efc8d40c92d
[ 5162.640726][ T44] RDX: 0000000000000000 RSI: 0000562f1a4d0a2a RDI: 0000000000000005
[ 5162.641057][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc9b2ac910
[ 5162.641388][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562f1a4d0a2a
[ 5162.641724][ T44] R13: 0000562f4105ab60 R14: 0000562f4105ada0 R15: 0000000000000000
[ 5162.642071][ T44]
[ 5162.642246][ T44] INFO: task modprobe:31611 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5162.642718][ T44] task:kworker/u16:0 state:R running task stack:24304 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5162.643257][ T44] Workqueue: netns cleanup_net
[ 5162.643479][ T44] Call Trace:
[ 5162.643652][ T44]
[ 5162.643778][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5162.644001][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5162.644222][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.644452][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.644681][ T44] ? trace_contention_end+0xd8/0x140
[ 5162.644902][ T44] ? __mutex_lock+0x19f/0x1190
[ 5162.645121][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5162.645354][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.645601][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5162.645886][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5162.646222][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5162.646556][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5162.646901][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5162.647192][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5162.647470][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5162.647702][ T44] ? ops_undo_list+0x2bf/0x890
[ 5162.647928][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5162.648146][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5162.648415][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5162.648647][ T44] ? net_passive_dec+0x190/0x190
[ 5162.648878][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.649101][ T44] ? process_one_work+0xe35/0x1650
[ 5162.649330][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5162.649558][ T44] ? assign_work+0x168/0x240
[ 5162.649789][ T44] ? worker_thread+0x591/0xcf0
[ 5162.650016][ T44] ? rescuer_thread+0xd10/0xd10
[ 5162.650236][ T44] ? kthread+0x37b/0x5f0
[ 5162.650411][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.650637][ T44] ? ret_from_fork+0x1b/0x270
[ 5162.650858][ T44] ? __lock_release+0x5d/0x170
[ 5162.651079][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.651300][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.651522][ T44] ? ret_from_fork+0x1db/0x270
[ 5162.651748][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.651967][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5162.652202][ T44]
[ 5162.652392][ T44]
[ 5162.652392][ T44] Showing all locks held in the system:
[ 5162.652710][ T44] 4 locks held by kworker/u16:0/12:
[ 5162.652930][ T44] 1 lock held by khungtaskd/44:
[ 5162.653143][ T44] #0: ffffffff91188580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5162.653537][ T44] 1 lock held by modprobe/31611:
[ 5162.653756][ T44] #0: ffffffff91880690 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5162.654197][ T44]
[ 5162.654304][ T44] =============================================
[ 5162.654304][ T44]
[ 5285.506684][ T44] INFO: task modprobe:31611 blocked for more than 983 seconds.
[ 5285.507134][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5285.507369][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5285.507768][ T44] task:modprobe state:D stack:25664 pid:31611 tgid:31611 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5285.508278][ T44] Call Trace:
[ 5285.508451][ T44]
[ 5285.508574][ T44] __schedule+0x880/0x1b10
[ 5285.508840][ T44] ? io_schedule_timeout+0x150/0x150
[ 5285.509076][ T44] ? schedule+0x1ee/0x270
[ 5285.509244][ T44] ? __lock_release+0x5d/0x170
[ 5285.509474][ T44] schedule+0xe2/0x270
[ 5285.509660][ T44] schedule_preempt_disabled+0x18/0x30
[ 5285.509886][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5285.510114][ T44] ? __lock_acquire+0x449/0x7e0
[ 5285.510355][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5285.510587][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.510830][ T44] ? lock_acquire+0x104/0x160
[ 5285.511053][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5285.511288][ T44] down_write+0x1d6/0x200
[ 5285.511456][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5285.511741][ T44] ? find_held_lock+0x2b/0x80
[ 5285.511979][ T44] ? __create_object+0x5e/0xb0
[ 5285.512206][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5285.512438][ T44] register_pernet_subsys+0x1a/0x40
[ 5285.512676][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5285.512903][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5285.513124][ T44] do_one_initcall+0x8c/0x1d0
[ 5285.513346][ T44] ? trace_initcall_start+0x130/0x130
[ 5285.513573][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.513815][ T44] ? trace_kmalloc+0x26/0xd0
[ 5285.514037][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5285.514257][ T44] ? debug_objects_oom+0x160/0x160
[ 5285.514482][ T44] ? kasan_unpoison+0x27/0x50
[ 5285.514718][ T44] ? __asan_register_globals+0x5d/0x70
[ 5285.514945][ T44] do_init_module+0x27a/0x860
[ 5285.515173][ T44] ? free_module+0x2f0/0x2f0
[ 5285.515398][ T44] ? kfree+0x21d/0x540
[ 5285.515564][ T44] ? load_module+0x20c5/0x2dd0
[ 5285.515804][ T44] load_module+0x1f40/0x2dd0
[ 5285.516038][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5285.516309][ T44] ? kernel_read_file+0x3ed/0x550
[ 5285.516534][ T44] ? kernel_read_file+0x3c8/0x550
[ 5285.516767][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5285.517002][ T44] ? init_module_from_file+0xe9/0x150
[ 5285.517228][ T44] init_module_from_file+0xe9/0x150
[ 5285.517448][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5285.517696][ T44] ? idempotent_init_module+0x316/0x610
[ 5285.517915][ T44] ? __lock_release+0x5d/0x170
[ 5285.518140][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5285.518363][ T44] idempotent_init_module+0x331/0x610
[ 5285.518606][ T44] ? init_module_from_file+0x150/0x150
[ 5285.518841][ T44] ? cap_capable+0x94/0x230
[ 5285.519068][ T44] __x64_sys_finit_module+0xca/0x150
[ 5285.519291][ T44] ? do_syscall_64+0x85/0xfd0
[ 5285.519512][ T44] do_syscall_64+0xc1/0xfd0
[ 5285.519744][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5285.520015][ T44] RIP: 0033:0x7efc8d40c92d
[ 5285.520255][ T44] RSP: 002b:00007ffc9b2ac7d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5285.520601][ T44] RAX: ffffffffffffffda RBX: 0000562f4105aac0 RCX: 00007efc8d40c92d
[ 5285.520935][ T44] RDX: 0000000000000000 RSI: 0000562f1a4d0a2a RDI: 0000000000000005
[ 5285.521265][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc9b2ac910
[ 5285.521606][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562f1a4d0a2a
[ 5285.521937][ T44] R13: 0000562f4105ab60 R14: 0000562f4105ada0 R15: 0000000000000000
[ 5285.522283][ T44]
[ 5285.522461][ T44] INFO: task modprobe:31611 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5285.522940][ T44] task:kworker/u16:0 state:R running task stack:24304 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5285.523488][ T44] Workqueue: netns cleanup_net
[ 5285.523735][ T44] Call Trace:
[ 5285.523903][ T44]
[ 5285.524015][ T44] ? __mutex_lock+0x19f/0x1190
[ 5285.524240][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5285.524465][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.524717][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5285.525014][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5285.525351][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5285.525699][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5285.526038][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5285.526325][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5285.526625][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5285.526851][ T44] ? ops_undo_list+0x2bf/0x890
[ 5285.527077][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5285.527296][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5285.527526][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5285.527766][ T44] ? net_passive_dec+0x190/0x190
[ 5285.527998][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.528233][ T44] ? process_one_work+0xe35/0x1650
[ 5285.528464][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5285.528702][ T44] ? assign_work+0x168/0x240
[ 5285.528926][ T44] ? worker_thread+0x591/0xcf0
[ 5285.529156][ T44] ? rescuer_thread+0xd10/0xd10
[ 5285.529377][ T44] ? kthread+0x37b/0x5f0
[ 5285.529547][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.529773][ T44] ? ret_from_fork+0x1b/0x270
[ 5285.530001][ T44] ? __lock_release+0x5d/0x170
[ 5285.530221][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.530441][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.530672][ T44] ? ret_from_fork+0x1db/0x270
[ 5285.530891][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.531112][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5285.531345][ T44]
[ 5285.531540][ T44]
[ 5285.531540][ T44] Showing all locks held in the system:
[ 5285.531894][ T44] 4 locks held by kworker/u16:0/12:
[ 5285.532118][ T44] 1 lock held by khungtaskd/44:
[ 5285.532333][ T44] #0: ffffffff91188580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5285.532761][ T44] 1 lock held by modprobe/31611:
[ 5285.532976][ T44] #0: ffffffff91880690 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5285.533430][ T44]
[ 5285.533539][ T44] =============================================
[ 5285.533539][ T44]
[ 5408.386692][ T44] INFO: task modprobe:31611 blocked for more than 1105 seconds.
[ 5408.387212][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5408.387445][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5408.387868][ T44] task:modprobe state:D stack:25664 pid:31611 tgid:31611 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5408.388363][ T44] Call Trace:
[ 5408.388530][ T44]
[ 5408.388665][ T44] __schedule+0x880/0x1b10
[ 5408.388902][ T44] ? io_schedule_timeout+0x150/0x150
[ 5408.389135][ T44] ? schedule+0x1ee/0x270
[ 5408.389302][ T44] ? __lock_release+0x5d/0x170
[ 5408.389534][ T44] schedule+0xe2/0x270
[ 5408.389750][ T44] schedule_preempt_disabled+0x18/0x30
[ 5408.389973][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5408.390196][ T44] ? __lock_acquire+0x449/0x7e0
[ 5408.390421][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5408.390664][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.390889][ T44] ? lock_acquire+0x104/0x160
[ 5408.391118][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5408.391349][ T44] down_write+0x1d6/0x200
[ 5408.391514][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5408.391799][ T44] ? find_held_lock+0x2b/0x80
[ 5408.392026][ T44] ? __create_object+0x5e/0xb0
[ 5408.392251][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5408.392478][ T44] register_pernet_subsys+0x1a/0x40
[ 5408.392720][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5408.392955][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5408.393179][ T44] do_one_initcall+0x8c/0x1d0
[ 5408.393403][ T44] ? trace_initcall_start+0x130/0x130
[ 5408.393636][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.393856][ T44] ? trace_kmalloc+0x26/0xd0
[ 5408.394077][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5408.394302][ T44] ? debug_objects_oom+0x160/0x160
[ 5408.394525][ T44] ? kasan_unpoison+0x27/0x50
[ 5408.394753][ T44] ? __asan_register_globals+0x5d/0x70
[ 5408.394977][ T44] do_init_module+0x27a/0x860
[ 5408.395204][ T44] ? free_module+0x2f0/0x2f0
[ 5408.395425][ T44] ? kfree+0x21d/0x540
[ 5408.395600][ T44] ? load_module+0x20c5/0x2dd0
[ 5408.395831][ T44] load_module+0x1f40/0x2dd0
[ 5408.396071][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5408.396345][ T44] ? kernel_read_file+0x3ed/0x550
[ 5408.396568][ T44] ? kernel_read_file+0x3c8/0x550
[ 5408.396799][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5408.397029][ T44] ? init_module_from_file+0xe9/0x150
[ 5408.397246][ T44] init_module_from_file+0xe9/0x150
[ 5408.397467][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5408.397725][ T44] ? idempotent_init_module+0x316/0x610
[ 5408.397946][ T44] ? __lock_release+0x5d/0x170
[ 5408.398171][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5408.398391][ T44] idempotent_init_module+0x331/0x610
[ 5408.398622][ T44] ? init_module_from_file+0x150/0x150
[ 5408.398856][ T44] ? cap_capable+0x94/0x230
[ 5408.399086][ T44] __x64_sys_finit_module+0xca/0x150
[ 5408.399314][ T44] ? do_syscall_64+0x85/0xfd0
[ 5408.399536][ T44] do_syscall_64+0xc1/0xfd0
[ 5408.399768][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5408.400045][ T44] RIP: 0033:0x7efc8d40c92d
[ 5408.400276][ T44] RSP: 002b:00007ffc9b2ac7d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5408.400617][ T44] RAX: ffffffffffffffda RBX: 0000562f4105aac0 RCX: 00007efc8d40c92d
[ 5408.400957][ T44] RDX: 0000000000000000 RSI: 0000562f1a4d0a2a RDI: 0000000000000005
[ 5408.401287][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc9b2ac910
[ 5408.401625][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562f1a4d0a2a
[ 5408.401956][ T44] R13: 0000562f4105ab60 R14: 0000562f4105ada0 R15: 0000000000000000
[ 5408.402311][ T44]
[ 5408.402480][ T44] INFO: task modprobe:31611 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5408.402966][ T44] task:kworker/u16:0 state:R running task stack:24304 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5408.403509][ T44] Workqueue: netns cleanup_net
[ 5408.403754][ T44] Call Trace:
[ 5408.403920][ T44]
[ 5408.404038][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5408.404262][ T44] ? common_interrupt+0x9b/0xe0
[ 5408.404483][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5408.404717][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.404943][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.405164][ T44] ? trace_contention_end+0xd8/0x140
[ 5408.405385][ T44] ? __mutex_lock+0x19f/0x1190
[ 5408.405621][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5408.405847][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.406066][ T44] ? trace_irq_disable.constprop.0+0xd0/0x130
[ 5408.406343][ T44] ? common_interrupt+0x9b/0xe0
[ 5408.406562][ T44] ? asm_common_interrupt+0x26/0x40
[ 5408.406803][ T44] ? nf_ct_iterate_cleanup+0x6a/0x340 [nf_conntrack]
[ 5408.407095][ T44] ? __might_resched+0x2f/0x5a0
[ 5408.407318][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5408.407666][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5408.408001][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5408.408338][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5408.408634][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5408.408924][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5408.409146][ T44] ? ops_undo_list+0x2bf/0x890
[ 5408.409371][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5408.409601][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5408.409830][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5408.410054][ T44] ? net_passive_dec+0x190/0x190
[ 5408.410279][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.410514][ T44] ? process_one_work+0xe35/0x1650
[ 5408.410756][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5408.410985][ T44] ? assign_work+0x168/0x240
[ 5408.411209][ T44] ? worker_thread+0x591/0xcf0
[ 5408.411438][ T44] ? rescuer_thread+0xd10/0xd10
[ 5408.411669][ T44] ? kthread+0x37b/0x5f0
[ 5408.411839][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.412061][ T44] ? ret_from_fork+0x1b/0x270
[ 5408.412288][ T44] ? __lock_release+0x5d/0x170
[ 5408.412510][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.412741][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.412968][ T44] ? ret_from_fork+0x1db/0x270
[ 5408.413186][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.413405][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5408.413654][ T44]
[ 5408.413856][ T44]
[ 5408.413856][ T44] Showing all locks held in the system:
[ 5408.414180][ T44] 5 locks held by kworker/u16:0/12:
[ 5408.414401][ T44] 1 lock held by khungtaskd/44:
[ 5408.414765][ T44] #0: ffffffff91188580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5408.415165][ T44] 1 lock held by modprobe/31611:
[ 5408.415376][ T44] #0: ffffffff91880690 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5408.415830][ T44]
[ 5408.415939][ T44] =============================================
[ 5408.415939][ T44]
[ 5531.266657][ T44] INFO: task modprobe:31611 blocked for more than 1228 seconds.
[ 5531.267050][ T44] Not tainted 6.18.0-rc6-virtme #1
[ 5531.267263][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5531.267654][ T44] task:modprobe state:D stack:25664 pid:31611 tgid:31611 ppid:1 task_flags:0x400100 flags:0x00080003
[ 5531.268142][ T44] Call Trace:
[ 5531.268305][ T44]
[ 5531.268424][ T44] __schedule+0x880/0x1b10
[ 5531.268673][ T44] ? io_schedule_timeout+0x150/0x150
[ 5531.268916][ T44] ? schedule+0x1ee/0x270
[ 5531.269085][ T44] ? __lock_release+0x5d/0x170
[ 5531.269312][ T44] schedule+0xe2/0x270
[ 5531.269481][ T44] schedule_preempt_disabled+0x18/0x30
[ 5531.269732][ T44] rwsem_down_write_slowpath+0x3c5/0xc60
[ 5531.269962][ T44] ? __lock_acquire+0x449/0x7e0
[ 5531.270190][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80
[ 5531.270435][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.270672][ T44] ? lock_acquire+0x104/0x160
[ 5531.270891][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5531.271119][ T44] down_write+0x1d6/0x200
[ 5531.271286][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60
[ 5531.271556][ T44] ? find_held_lock+0x2b/0x80
[ 5531.271792][ T44] ? __create_object+0x5e/0xb0
[ 5531.272018][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5531.272253][ T44] register_pernet_subsys+0x1a/0x40
[ 5531.272484][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5531.272722][ T44] ? _sub_I_65535_1+0x230/0x230 [pktgen]
[ 5531.272946][ T44] do_one_initcall+0x8c/0x1d0
[ 5531.273167][ T44] ? trace_initcall_start+0x130/0x130
[ 5531.273386][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.273633][ T44] ? trace_kmalloc+0x26/0xd0
[ 5531.273865][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690
[ 5531.274083][ T44] ? debug_objects_oom+0x160/0x160
[ 5531.274303][ T44] ? kasan_unpoison+0x27/0x50
[ 5531.274522][ T44] ? __asan_register_globals+0x5d/0x70
[ 5531.274758][ T44] do_init_module+0x27a/0x860
[ 5531.274987][ T44] ? free_module+0x2f0/0x2f0
[ 5531.275203][ T44] ? kfree+0x21d/0x540
[ 5531.275379][ T44] ? load_module+0x20c5/0x2dd0
[ 5531.275614][ T44] load_module+0x1f40/0x2dd0
[ 5531.275851][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5531.276122][ T44] ? kernel_read_file+0x3ed/0x550
[ 5531.276342][ T44] ? kernel_read_file+0x3c8/0x550
[ 5531.276564][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5531.276806][ T44] ? init_module_from_file+0xe9/0x150
[ 5531.277030][ T44] init_module_from_file+0xe9/0x150
[ 5531.277255][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5531.277492][ T44] ? idempotent_init_module+0x316/0x610
[ 5531.277732][ T44] ? __lock_release+0x5d/0x170
[ 5531.277961][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5531.278183][ T44] idempotent_init_module+0x331/0x610
[ 5531.278405][ T44] ? init_module_from_file+0x150/0x150
[ 5531.278654][ T44] ? cap_capable+0x94/0x230
[ 5531.278885][ T44] __x64_sys_finit_module+0xca/0x150
[ 5531.279106][ T44] ? do_syscall_64+0x85/0xfd0
[ 5531.279327][ T44] do_syscall_64+0xc1/0xfd0
[ 5531.279570][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5531.279854][ T44] RIP: 0033:0x7efc8d40c92d
[ 5531.280084][ T44] RSP: 002b:00007ffc9b2ac7d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5531.280425][ T44] RAX: ffffffffffffffda RBX: 0000562f4105aac0 RCX: 00007efc8d40c92d
[ 5531.280762][ T44] RDX: 0000000000000000 RSI: 0000562f1a4d0a2a RDI: 0000000000000005
[ 5531.281094][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc9b2ac910
[ 5531.281422][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 0000562f1a4d0a2a
[ 5531.281780][ T44] R13: 0000562f4105ab60 R14: 0000562f4105ada0 R15: 0000000000000000
[ 5531.282129][ T44]
[ 5531.282306][ T44] INFO: task modprobe:31611 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5531.282782][ T44] task:kworker/u16:0 state:R running task stack:24304 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 5531.283325][ T44] Workqueue: netns cleanup_net
[ 5531.283550][ T44] Call Trace:
[ 5531.283721][ T44]
[ 5531.283834][ T44] ? __mutex_lock+0x19f/0x1190
[ 5531.284060][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5531.284289][ T44] ? irqentry_exit+0x3b/0x80
[ 5531.284505][ T44] ? common_interrupt+0x9b/0xe0
[ 5531.284729][ T44] ? lockdep_hardirqs_on+0x7c/0x110
[ 5531.284958][ T44] ? asm_common_interrupt+0x26/0x40
[ 5531.285188][ T44] ? nf_ct_iterate_cleanup+0x9b/0x340 [nf_conntrack]
[ 5531.285473][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5531.285833][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5531.286168][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5531.286513][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5531.286809][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5531.287092][ T44] ? _raw_spin_unlock+0x2d/0x50
[ 5531.287314][ T44] ? ops_undo_list+0x2bf/0x890
[ 5531.287538][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5531.287762][ T44] ? cleanup_net+0x2d6/0x8b0
[ 5531.287990][ T44] ? cleanup_net+0x3b2/0x8b0
[ 5531.288214][ T44] ? net_passive_dec+0x190/0x190
[ 5531.288438][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.288670][ T44] ? process_one_work+0xe35/0x1650
[ 5531.288901][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5531.289132][ T44] ? assign_work+0x168/0x240
[ 5531.289358][ T44] ? worker_thread+0x591/0xcf0
[ 5531.289585][ T44] ? rescuer_thread+0xd10/0xd10
[ 5531.289829][ T44] ? kthread+0x37b/0x5f0
[ 5531.290009][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.290227][ T44] ? ret_from_fork+0x1b/0x270
[ 5531.290445][ T44] ? __lock_release+0x5d/0x170
[ 5531.290671][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.290891][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.291115][ T44] ? ret_from_fork+0x1db/0x270
[ 5531.291331][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.291548][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5531.291795][ T44]
[ 5531.291960][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings
[ 5531.292375][ T44]
[ 5531.292375][ T44] Showing all locks held in the system:
[ 5531.293103][ T44] 4 locks held by kworker/u16:0/12:
[ 5531.293326][ T44] 1 lock held by khungtaskd/44:
[ 5531.293536][ T44] #0: ffffffff91188580 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5531.293944][ T44] 1 lock held by modprobe/31611:
[ 5531.294157][ T44] #0: ffffffff91880690 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5531.294601][ T44]
[ 5531.294709][ T44] =============================================
[ 5531.294709][ T44]
WAIT TIMEOUT stderr
Ctrl-C stderr
Ctrl-C stderr