[ 4441.912611][T30759] pktgen: Packet Generator for packet performance testing. Version: 2.75
[ 4671.059001][ T44] INFO: task modprobe:30759 blocked for more than 122 seconds.
[ 4671.059629][ T44] Not tainted 6.17.0-rc6-virtme #1
[ 4671.059872][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4671.060312][ T44] task:modprobe state:D stack:25712 pid:30759 tgid:30759 ppid:1 task_flags:0x400100 flags:0x00004006
[ 4671.060893][ T44] Call Trace:
[ 4671.061068][ T44]
[ 4671.061192][ T44] __schedule+0x880/0x1b10
[ 4671.061448][ T44] ? io_schedule_timeout+0x150/0x150
[ 4671.061699][ T44] ? schedule+0x1ee/0x270
[ 4671.061863][ T44] ? __lock_release+0x5d/0x170
[ 4671.062106][ T44] schedule+0xe2/0x270
[ 4671.062275][ T44] schedule_preempt_disabled+0x18/0x30
[ 4671.062559][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 4671.062801][ T44] ? __lock_acquire+0x449/0x7e0
[ 4671.063041][ T44] ? down_read+0x4a0/0x4a0
[ 4671.063275][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.063510][ T44] ? lock_acquire+0x104/0x160
[ 4671.063731][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4671.063989][ T44] down_write+0x1d6/0x200
[ 4671.064167][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 4671.064447][ T44] ? find_held_lock+0x2b/0x80
[ 4671.064665][ T44] ? __create_object+0x5e/0xb0
[ 4671.064900][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 4671.065246][ T44] register_pernet_subsys+0x1a/0x40
[ 4671.065476][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4671.065715][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 4671.066074][ T44] do_one_initcall+0x8c/0x1d0
[ 4671.066300][ T44] ? trace_initcall_level+0x130/0x130
[ 4671.066522][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.067264][ T44] ? trace_kmalloc+0x26/0xd0
[ 4671.067491][ T44] ? __kmalloc_cache_noprof+0x15f/0x360
[ 4671.067720][ T44] ? debug_objects_oom+0x160/0x160
[ 4671.067954][ T44] ? kasan_unpoison+0x27/0x50
[ 4671.068193][ T44] ? __asan_register_globals+0x5d/0x70
[ 4671.068418][ T44] do_init_module+0x27a/0x860
[ 4671.068649][ T44] ? free_module+0x2f0/0x2f0
[ 4671.068882][ T44] ? kfree+0x144/0x320
[ 4671.069065][ T44] ? find_vm_area+0x12/0x50
[ 4671.069293][ T44] load_module+0x1f40/0x2dd0
[ 4671.069529][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4671.069809][ T44] ? kernel_read_file+0x3ed/0x550
[ 4671.070044][ T44] ? kernel_read_file+0x3c8/0x550
[ 4671.070269][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4671.070506][ T44] ? init_module_from_file+0xe9/0x150
[ 4671.070726][ T44] init_module_from_file+0xe9/0x150
[ 4671.070968][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4671.071207][ T44] ? idempotent_init_module+0x316/0x610
[ 4671.071435][ T44] ? __lock_release+0x5d/0x170
[ 4671.071663][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4671.071893][ T44] idempotent_init_module+0x331/0x610
[ 4671.072116][ T44] ? init_module_from_file+0x150/0x150
[ 4671.072348][ T44] ? cap_capable+0x94/0x230
[ 4671.072578][ T44] __x64_sys_finit_module+0xca/0x150
[ 4671.072800][ T44] ? do_syscall_64+0x85/0x300
[ 4671.073040][ T44] do_syscall_64+0xc1/0x300
[ 4671.073266][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4671.073540][ T44] RIP: 0033:0x7feb3d6c9a0d
[ 4671.073779][ T44] RSP: 002b:00007ffc2b159f28 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4671.074126][ T44] RAX: ffffffffffffffda RBX: 000055b5fe50aac0 RCX: 00007feb3d6c9a0d
[ 4671.074460][ T44] RDX: 0000000000000000 RSI: 000055b5e7733a2a RDI: 0000000000000005
[ 4671.074807][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2b15a060
[ 4671.075148][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055b5e7733a2a
[ 4671.075485][ T44] R13: 000055b5fe50ab60 R14: 000055b5fe50ada0 R15: 0000000000000000
[ 4671.075842][ T44]
[ 4671.076034][ T44] INFO: task modprobe:30759 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4671.076516][ T44] task:kworker/u16:0 state:R running task stack:26080 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00004000
[ 4671.077075][ T44] Workqueue: netns cleanup_net
[ 4671.077310][ T44] Call Trace:
[ 4671.077481][ T44]
[ 4671.077609][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 4671.077846][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 4671.078080][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.078307][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.078528][ T44] ? trace_contention_end+0xd8/0x140
[ 4671.078748][ T44] ? __mutex_lock+0x19f/0x11a0
[ 4671.078982][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4671.079211][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4671.079507][ T44] ? ww_mutex_lock+0x160/0x160
[ 4671.079743][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4671.080086][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4671.080368][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4671.080712][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4671.081063][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4671.081407][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4671.081694][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4671.081993][ T44] ? ops_undo_list+0x2bf/0x890
[ 4671.082221][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4671.082441][ T44] ? cleanup_net+0x2c5/0x890
[ 4671.082683][ T44] ? cleanup_net+0x3a1/0x890
[ 4671.082910][ T44] ? net_passive_dec+0x190/0x190
[ 4671.083133][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.083357][ T44] ? process_one_work+0xe35/0x1650
[ 4671.083592][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4671.083821][ T44] ? assign_work+0x168/0x240
[ 4671.084052][ T44] ? worker_thread+0x591/0xcf0
[ 4671.084289][ T44] ? rescuer_thread+0xd10/0xd10
[ 4671.084519][ T44] ? kthread+0x37b/0x5f0
[ 4671.084692][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.084922][ T44] ? ret_from_fork+0x1b/0x270
[ 4671.085147][ T44] ? __lock_release+0x5d/0x170
[ 4671.085370][ T44] ? rcu_is_watching+0x12/0xb0
[ 4671.085605][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.085860][ T44] ? ret_from_fork+0x1db/0x270
[ 4671.086154][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4671.086383][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4671.086621][ T44]
[ 4671.086801][ T44]
[ 4671.086801][ T44] Showing all locks held in the system:
[ 4671.087123][ T44] 4 locks held by kworker/u16:0/12:
[ 4671.087357][ T44] 1 lock held by khungtaskd/44:
[ 4671.087569][ T44] #0: ffffffffb4f83f80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4671.087985][ T44] 3 locks held by kworker/2:1/21467:
[ 4671.088207][ T44] 1 lock held by modprobe/30759:
[ 4671.088422][ T44] #0: ffffffffb56704f0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4671.088852][ T44]
[ 4671.088972][ T44] =============================================
[ 4671.088972][ T44]
[ 4793.938983][ T44] INFO: task modprobe:30759 blocked for more than 245 seconds.
[ 4793.939421][ T44] Not tainted 6.17.0-rc6-virtme #1
[ 4793.939628][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4793.940049][ T44] task:modprobe state:D stack:25712 pid:30759 tgid:30759 ppid:1 task_flags:0x400100 flags:0x00004006
[ 4793.940559][ T44] Call Trace:
[ 4793.940728][ T44]
[ 4793.940853][ T44] __schedule+0x880/0x1b10
[ 4793.941119][ T44] ? io_schedule_timeout+0x150/0x150
[ 4793.941366][ T44] ? schedule+0x1ee/0x270
[ 4793.941532][ T44] ? __lock_release+0x5d/0x170
[ 4793.941760][ T44] schedule+0xe2/0x270
[ 4793.941937][ T44] schedule_preempt_disabled+0x18/0x30
[ 4793.942160][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 4793.942395][ T44] ? __lock_acquire+0x449/0x7e0
[ 4793.942626][ T44] ? down_read+0x4a0/0x4a0
[ 4793.942858][ T44] ? rcu_is_watching+0x12/0xb0
[ 4793.943091][ T44] ? lock_acquire+0x104/0x160
[ 4793.943324][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4793.943554][ T44] down_write+0x1d6/0x200
[ 4793.943721][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 4793.944004][ T44] ? find_held_lock+0x2b/0x80
[ 4793.944222][ T44] ? __create_object+0x5e/0xb0
[ 4793.944465][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 4793.944826][ T44] register_pernet_subsys+0x1a/0x40
[ 4793.945058][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4793.945293][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 4793.945639][ T44] do_one_initcall+0x8c/0x1d0
[ 4793.945863][ T44] ? trace_initcall_level+0x130/0x130
[ 4793.946121][ T44] ? rcu_is_watching+0x12/0xb0
[ 4793.946356][ T44] ? trace_kmalloc+0x26/0xd0
[ 4793.946580][ T44] ? __kmalloc_cache_noprof+0x15f/0x360
[ 4793.946802][ T44] ? debug_objects_oom+0x160/0x160
[ 4793.947034][ T44] ? kasan_unpoison+0x27/0x50
[ 4793.947262][ T44] ? __asan_register_globals+0x5d/0x70
[ 4793.947516][ T44] do_init_module+0x27a/0x860
[ 4793.947747][ T44] ? free_module+0x2f0/0x2f0
[ 4793.947990][ T44] ? kfree+0x144/0x320
[ 4793.948164][ T44] ? find_vm_area+0x12/0x50
[ 4793.948409][ T44] load_module+0x1f40/0x2dd0
[ 4793.948643][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4793.948923][ T44] ? kernel_read_file+0x3ed/0x550
[ 4793.949151][ T44] ? kernel_read_file+0x3c8/0x550
[ 4793.949378][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4793.949624][ T44] ? init_module_from_file+0xe9/0x150
[ 4793.949852][ T44] init_module_from_file+0xe9/0x150
[ 4793.950082][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4793.950318][ T44] ? idempotent_init_module+0x316/0x610
[ 4793.950545][ T44] ? __lock_release+0x5d/0x170
[ 4793.950768][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4793.950998][ T44] idempotent_init_module+0x331/0x610
[ 4793.951232][ T44] ? init_module_from_file+0x150/0x150
[ 4793.951472][ T44] ? cap_capable+0x94/0x230
[ 4793.951701][ T44] __x64_sys_finit_module+0xca/0x150
[ 4793.951930][ T44] ? do_syscall_64+0x85/0x300
[ 4793.952153][ T44] do_syscall_64+0xc1/0x300
[ 4793.952374][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4793.952657][ T44] RIP: 0033:0x7feb3d6c9a0d
[ 4793.952902][ T44] RSP: 002b:00007ffc2b159f28 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4793.953238][ T44] RAX: ffffffffffffffda RBX: 000055b5fe50aac0 RCX: 00007feb3d6c9a0d
[ 4793.953578][ T44] RDX: 0000000000000000 RSI: 000055b5e7733a2a RDI: 0000000000000005
[ 4793.953931][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2b15a060
[ 4793.954268][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055b5e7733a2a
[ 4793.954607][ T44] R13: 000055b5fe50ab60 R14: 000055b5fe50ada0 R15: 0000000000000000
[ 4793.954967][ T44]
[ 4793.955139][ T44] INFO: task modprobe:30759 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4793.955613][ T44] task:kworker/u16:0 state:R running task stack:26080 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00004000
[ 4793.956178][ T44] Workqueue: netns cleanup_net
[ 4793.956404][ T44] Call Trace:
[ 4793.956575][ T44]
[ 4793.956693][ T44] ? __mutex_lock+0x19f/0x11a0
[ 4793.956929][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4793.957155][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4793.957471][ T44] ? ww_mutex_lock+0x160/0x160
[ 4793.957710][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4793.958073][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4793.958356][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4793.958641][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4793.958994][ T44] ? nf_conntrack_cleanup_net_list+0x247/0x4b0 [nf_conntrack]
[ 4793.959339][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4793.959683][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4793.960030][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4793.960314][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4793.960606][ T44] ? ops_undo_list+0x2bf/0x890
[ 4793.960849][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4793.961077][ T44] ? cleanup_net+0x2c5/0x890
[ 4793.961306][ T44] ? cleanup_net+0x3a1/0x890
[ 4793.961531][ T44] ? net_passive_dec+0x190/0x190
[ 4793.961765][ T44] ? rcu_is_watching+0x12/0xb0
[ 4793.962012][ T44] ? process_one_work+0xe35/0x1650
[ 4793.962247][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4793.962481][ T44] ? assign_work+0x168/0x240
[ 4793.962705][ T44] ? worker_thread+0x591/0xcf0
[ 4793.962950][ T44] ? rescuer_thread+0xd10/0xd10
[ 4793.963174][ T44] ? kthread+0x37b/0x5f0
[ 4793.963344][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4793.963564][ T44] ? ret_from_fork+0x1b/0x270
[ 4793.963794][ T44] ? __lock_release+0x5d/0x170
[ 4793.964022][ T44] ? rcu_is_watching+0x12/0xb0
[ 4793.964253][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4793.964474][ T44] ? ret_from_fork+0x1db/0x270
[ 4793.964699][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4793.964939][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4793.965174][ T44]
[ 4793.965350][ T44]
[ 4793.965350][ T44] Showing all locks held in the system:
[ 4793.965658][ T44] 4 locks held by kworker/u16:0/12:
[ 4793.965898][ T44] 1 lock held by khungtaskd/44:
[ 4793.966113][ T44] #0: ffffffffb4f83f80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4793.966513][ T44] 3 locks held by kworker/2:1/21467:
[ 4793.966735][ T44] 1 lock held by modprobe/30759:
[ 4793.966962][ T44] #0: ffffffffb56704f0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4793.967392][ T44]
[ 4793.967500][ T44] =============================================
[ 4793.967500][ T44]
[ 4916.817950][ T44] INFO: task modprobe:30759 blocked for more than 368 seconds.
[ 4916.818378][ T44] Not tainted 6.17.0-rc6-virtme #1
[ 4916.818597][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 4916.818988][ T44] task:modprobe state:D stack:25712 pid:30759 tgid:30759 ppid:1 task_flags:0x400100 flags:0x00004006
[ 4916.819499][ T44] Call Trace:
[ 4916.819669][ T44]
[ 4916.819791][ T44] __schedule+0x880/0x1b10
[ 4916.820042][ T44] ? io_schedule_timeout+0x150/0x150
[ 4916.820277][ T44] ? schedule+0x1ee/0x270
[ 4916.820441][ T44] ? __lock_release+0x5d/0x170
[ 4916.820674][ T44] schedule+0xe2/0x270
[ 4916.820843][ T44] schedule_preempt_disabled+0x18/0x30
[ 4916.821078][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 4916.821300][ T44] ? __lock_acquire+0x449/0x7e0
[ 4916.821523][ T44] ? down_read+0x4a0/0x4a0
[ 4916.821754][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.821988][ T44] ? lock_acquire+0x104/0x160
[ 4916.822207][ T44] ? register_pernet_subsys+0x1a/0x40
[ 4916.822433][ T44] down_write+0x1d6/0x200
[ 4916.822599][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 4916.822890][ T44] ? find_held_lock+0x2b/0x80
[ 4916.823112][ T44] ? __create_object+0x5e/0xb0
[ 4916.823333][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 4916.823666][ T44] register_pernet_subsys+0x1a/0x40
[ 4916.823904][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 4916.824132][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 4916.824474][ T44] do_one_initcall+0x8c/0x1d0
[ 4916.824698][ T44] ? trace_initcall_level+0x130/0x130
[ 4916.824929][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.825150][ T44] ? trace_kmalloc+0x26/0xd0
[ 4916.825369][ T44] ? __kmalloc_cache_noprof+0x15f/0x360
[ 4916.825586][ T44] ? debug_objects_oom+0x160/0x160
[ 4916.825810][ T44] ? kasan_unpoison+0x27/0x50
[ 4916.826039][ T44] ? __asan_register_globals+0x5d/0x70
[ 4916.826269][ T44] do_init_module+0x27a/0x860
[ 4916.826496][ T44] ? free_module+0x2f0/0x2f0
[ 4916.826717][ T44] ? kfree+0x144/0x320
[ 4916.826896][ T44] ? find_vm_area+0x12/0x50
[ 4916.827126][ T44] load_module+0x1f40/0x2dd0
[ 4916.827360][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 4916.827635][ T44] ? kernel_read_file+0x3ed/0x550
[ 4916.827884][ T44] ? kernel_read_file+0x3c8/0x550
[ 4916.828110][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 4916.828337][ T44] ? init_module_from_file+0xe9/0x150
[ 4916.828556][ T44] init_module_from_file+0xe9/0x150
[ 4916.828780][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 4916.829021][ T44] ? idempotent_init_module+0x316/0x610
[ 4916.829241][ T44] ? __lock_release+0x5d/0x170
[ 4916.829472][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 4916.829694][ T44] idempotent_init_module+0x331/0x610
[ 4916.829925][ T44] ? init_module_from_file+0x150/0x150
[ 4916.830157][ T44] ? cap_capable+0x94/0x230
[ 4916.830385][ T44] __x64_sys_finit_module+0xca/0x150
[ 4916.830604][ T44] ? do_syscall_64+0x85/0x300
[ 4916.830832][ T44] do_syscall_64+0xc1/0x300
[ 4916.831067][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 4916.831341][ T44] RIP: 0033:0x7feb3d6c9a0d
[ 4916.831579][ T44] RSP: 002b:00007ffc2b159f28 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 4916.831922][ T44] RAX: ffffffffffffffda RBX: 000055b5fe50aac0 RCX: 00007feb3d6c9a0d
[ 4916.832250][ T44] RDX: 0000000000000000 RSI: 000055b5e7733a2a RDI: 0000000000000005
[ 4916.832587][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2b15a060
[ 4916.832929][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055b5e7733a2a
[ 4916.833263][ T44] R13: 000055b5fe50ab60 R14: 000055b5fe50ada0 R15: 0000000000000000
[ 4916.833605][ T44]
[ 4916.833780][ T44] INFO: task modprobe:30759 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 4916.834263][ T44] task:kworker/u16:0 state:R running task stack:26080 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00004000
[ 4916.834803][ T44] Workqueue: netns cleanup_net
[ 4916.835040][ T44] Call Trace:
[ 4916.835207][ T44]
[ 4916.835326][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 4916.835562][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 4916.835786][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.836020][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.836239][ T44] ? trace_contention_end+0xd8/0x140
[ 4916.836461][ T44] ? __mutex_lock+0x19f/0x11a0
[ 4916.836682][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 4916.836913][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4916.837210][ T44] ? ww_mutex_lock+0x160/0x160
[ 4916.837444][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4916.837726][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 4916.838016][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 4916.838358][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 4916.838694][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 4916.839048][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 4916.839332][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 4916.839625][ T44] ? ops_undo_list+0x2bf/0x890
[ 4916.839850][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 4916.840076][ T44] ? cleanup_net+0x2c5/0x890
[ 4916.840302][ T44] ? cleanup_net+0x3a1/0x890
[ 4916.840530][ T44] ? net_passive_dec+0x190/0x190
[ 4916.840749][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.840990][ T44] ? process_one_work+0xe35/0x1650
[ 4916.841224][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 4916.841453][ T44] ? assign_work+0x168/0x240
[ 4916.841678][ T44] ? worker_thread+0x591/0xcf0
[ 4916.841913][ T44] ? rescuer_thread+0xd10/0xd10
[ 4916.842138][ T44] ? kthread+0x37b/0x5f0
[ 4916.842312][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.842532][ T44] ? ret_from_fork+0x1b/0x270
[ 4916.842756][ T44] ? __lock_release+0x5d/0x170
[ 4916.842987][ T44] ? rcu_is_watching+0x12/0xb0
[ 4916.843207][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.843428][ T44] ? ret_from_fork+0x1db/0x270
[ 4916.843646][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 4916.843871][ T44] ? ret_from_fork_asm+0x11/0x20
[ 4916.844120][ T44]
[ 4916.844295][ T44]
[ 4916.844295][ T44] Showing all locks held in the system:
[ 4916.844603][ T44] 4 locks held by kworker/u16:0/12:
[ 4916.844821][ T44] 1 lock held by khungtaskd/44:
[ 4916.845037][ T44] #0: ffffffffb4f83f80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 4916.845421][ T44] 3 locks held by kworker/2:1/21467:
[ 4916.845641][ T44] 1 lock held by modprobe/30759:
[ 4916.845850][ T44] #0: ffffffffb56704f0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 4916.846281][ T44]
[ 4916.846387][ T44] =============================================
[ 4916.846387][ T44]
[ 5039.697962][ T44] INFO: task modprobe:30759 blocked for more than 491 seconds.
[ 5039.698381][ T44] Not tainted 6.17.0-rc6-virtme #1
[ 5039.698594][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5039.699005][ T44] task:modprobe state:D stack:25712 pid:30759 tgid:30759 ppid:1 task_flags:0x400100 flags:0x00004006
[ 5039.699508][ T44] Call Trace:
[ 5039.699676][ T44]
[ 5039.699808][ T44] __schedule+0x880/0x1b10
[ 5039.700064][ T44] ? io_schedule_timeout+0x150/0x150
[ 5039.700306][ T44] ? schedule+0x1ee/0x270
[ 5039.700471][ T44] ? __lock_release+0x5d/0x170
[ 5039.700706][ T44] schedule+0xe2/0x270
[ 5039.700890][ T44] schedule_preempt_disabled+0x18/0x30
[ 5039.701108][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 5039.701336][ T44] ? __lock_acquire+0x449/0x7e0
[ 5039.701562][ T44] ? down_read+0x4a0/0x4a0
[ 5039.701799][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.702033][ T44] ? lock_acquire+0x104/0x160
[ 5039.702251][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5039.702479][ T44] down_write+0x1d6/0x200
[ 5039.702654][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 5039.702951][ T44] ? find_held_lock+0x2b/0x80
[ 5039.703173][ T44] ? __create_object+0x5e/0xb0
[ 5039.703397][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 5039.703745][ T44] register_pernet_subsys+0x1a/0x40
[ 5039.703986][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5039.704214][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 5039.704544][ T44] do_one_initcall+0x8c/0x1d0
[ 5039.704779][ T44] ? trace_initcall_level+0x130/0x130
[ 5039.705008][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.705235][ T44] ? trace_kmalloc+0x26/0xd0
[ 5039.705454][ T44] ? __kmalloc_cache_noprof+0x15f/0x360
[ 5039.705671][ T44] ? debug_objects_oom+0x160/0x160
[ 5039.705909][ T44] ? kasan_unpoison+0x27/0x50
[ 5039.706131][ T44] ? __asan_register_globals+0x5d/0x70
[ 5039.706352][ T44] do_init_module+0x27a/0x860
[ 5039.706577][ T44] ? free_module+0x2f0/0x2f0
[ 5039.706812][ T44] ? kfree+0x144/0x320
[ 5039.706985][ T44] ? find_vm_area+0x12/0x50
[ 5039.707213][ T44] load_module+0x1f40/0x2dd0
[ 5039.707455][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5039.707728][ T44] ? kernel_read_file+0x3ed/0x550
[ 5039.707963][ T44] ? kernel_read_file+0x3c8/0x550
[ 5039.708184][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5039.708411][ T44] ? init_module_from_file+0xe9/0x150
[ 5039.708640][ T44] init_module_from_file+0xe9/0x150
[ 5039.708870][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5039.709120][ T44] ? idempotent_init_module+0x316/0x610
[ 5039.709339][ T44] ? __lock_release+0x5d/0x170
[ 5039.709567][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5039.709790][ T44] idempotent_init_module+0x331/0x610
[ 5039.710030][ T44] ? init_module_from_file+0x150/0x150
[ 5039.710260][ T44] ? cap_capable+0x94/0x230
[ 5039.710485][ T44] __x64_sys_finit_module+0xca/0x150
[ 5039.710703][ T44] ? do_syscall_64+0x85/0x300
[ 5039.710941][ T44] do_syscall_64+0xc1/0x300
[ 5039.711169][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5039.711440][ T44] RIP: 0033:0x7feb3d6c9a0d
[ 5039.711669][ T44] RSP: 002b:00007ffc2b159f28 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5039.712018][ T44] RAX: ffffffffffffffda RBX: 000055b5fe50aac0 RCX: 00007feb3d6c9a0d
[ 5039.712348][ T44] RDX: 0000000000000000 RSI: 000055b5e7733a2a RDI: 0000000000000005
[ 5039.712683][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2b15a060
[ 5039.713035][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055b5e7733a2a
[ 5039.713372][ T44] R13: 000055b5fe50ab60 R14: 000055b5fe50ada0 R15: 0000000000000000
[ 5039.713720][ T44]
[ 5039.713907][ T44] INFO: task modprobe:30759 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5039.714382][ T44] task:kworker/u16:0 state:R running task stack:26080 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00004000
[ 5039.714938][ T44] Workqueue: netns cleanup_net
[ 5039.715162][ T44] Call Trace:
[ 5039.715326][ T44]
[ 5039.715435][ T44] ? __mutex_lock+0x19f/0x11a0
[ 5039.715657][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5039.715894][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5039.716183][ T44] ? ww_mutex_lock+0x160/0x160
[ 5039.716427][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5039.716708][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5039.717001][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5039.717340][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5039.717677][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5039.718035][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5039.718321][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5039.718615][ T44] ? ops_undo_list+0x2bf/0x890
[ 5039.718845][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5039.719071][ T44] ? cleanup_net+0x2c5/0x890
[ 5039.719301][ T44] ? cleanup_net+0x3a1/0x890
[ 5039.719527][ T44] ? net_passive_dec+0x190/0x190
[ 5039.719752][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.719988][ T44] ? process_one_work+0xe35/0x1650
[ 5039.720221][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5039.720448][ T44] ? assign_work+0x168/0x240
[ 5039.720681][ T44] ? worker_thread+0x591/0xcf0
[ 5039.720928][ T44] ? rescuer_thread+0xd10/0xd10
[ 5039.721156][ T44] ? kthread+0x37b/0x5f0
[ 5039.721330][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.721547][ T44] ? ret_from_fork+0x1b/0x270
[ 5039.721773][ T44] ? __lock_release+0x5d/0x170
[ 5039.722008][ T44] ? rcu_is_watching+0x12/0xb0
[ 5039.722231][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.722450][ T44] ? ret_from_fork+0x1db/0x270
[ 5039.722668][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5039.722902][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5039.723161][ T44]
[ 5039.723341][ T44]
[ 5039.723341][ T44] Showing all locks held in the system:
[ 5039.723649][ T44] 4 locks held by kworker/u16:0/12:
[ 5039.723885][ T44] 1 lock held by khungtaskd/44:
[ 5039.724095][ T44] #0: ffffffffb4f83f80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5039.724487][ T44] 2 locks held by kworker/2:1/21467:
[ 5039.724713][ T44] 1 lock held by modprobe/30759:
[ 5039.724938][ T44] #0: ffffffffb56704f0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5039.725364][ T44]
[ 5039.725469][ T44] =============================================
[ 5039.725469][ T44]
[ 5162.577965][ T44] INFO: task modprobe:30759 blocked for more than 614 seconds.
[ 5162.578384][ T44] Not tainted 6.17.0-rc6-virtme #1
[ 5162.578592][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5162.578988][ T44] task:modprobe state:D stack:25712 pid:30759 tgid:30759 ppid:1 task_flags:0x400100 flags:0x00004006
[ 5162.579503][ T44] Call Trace:
[ 5162.579670][ T44]
[ 5162.579790][ T44] __schedule+0x880/0x1b10
[ 5162.580035][ T44] ? io_schedule_timeout+0x150/0x150
[ 5162.580278][ T44] ? schedule+0x1ee/0x270
[ 5162.580448][ T44] ? __lock_release+0x5d/0x170
[ 5162.580681][ T44] schedule+0xe2/0x270
[ 5162.580849][ T44] schedule_preempt_disabled+0x18/0x30
[ 5162.581084][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 5162.581320][ T44] ? __lock_acquire+0x449/0x7e0
[ 5162.581543][ T44] ? down_read+0x4a0/0x4a0
[ 5162.581771][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.582008][ T44] ? lock_acquire+0x104/0x160
[ 5162.582245][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5162.582483][ T44] down_write+0x1d6/0x200
[ 5162.582690][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 5162.582975][ T44] ? find_held_lock+0x2b/0x80
[ 5162.583195][ T44] ? __create_object+0x5e/0xb0
[ 5162.583434][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 5162.583777][ T44] register_pernet_subsys+0x1a/0x40
[ 5162.584007][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5162.584235][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 5162.584599][ T44] do_one_initcall+0x8c/0x1d0
[ 5162.584826][ T44] ? trace_initcall_level+0x130/0x130
[ 5162.585058][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.585279][ T44] ? trace_kmalloc+0x26/0xd0
[ 5162.585511][ T44] ? __kmalloc_cache_noprof+0x15f/0x360
[ 5162.585729][ T44] ? debug_objects_oom+0x160/0x160
[ 5162.585961][ T44] ? kasan_unpoison+0x27/0x50
[ 5162.586190][ T44] ? __asan_register_globals+0x5d/0x70
[ 5162.586423][ T44] do_init_module+0x27a/0x860
[ 5162.586652][ T44] ? free_module+0x2f0/0x2f0
[ 5162.586884][ T44] ? kfree+0x144/0x320
[ 5162.587051][ T44] ? find_vm_area+0x12/0x50
[ 5162.587275][ T44] load_module+0x1f40/0x2dd0
[ 5162.587522][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5162.587803][ T44] ? kernel_read_file+0x3ed/0x550
[ 5162.588040][ T44] ? kernel_read_file+0x3c8/0x550
[ 5162.588264][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5162.588504][ T44] ? init_module_from_file+0xe9/0x150
[ 5162.588722][ T44] init_module_from_file+0xe9/0x150
[ 5162.588951][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5162.589186][ T44] ? idempotent_init_module+0x316/0x610
[ 5162.589421][ T44] ? __lock_release+0x5d/0x170
[ 5162.589646][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5162.589869][ T44] idempotent_init_module+0x331/0x610
[ 5162.590101][ T44] ? init_module_from_file+0x150/0x150
[ 5162.590331][ T44] ? cap_capable+0x94/0x230
[ 5162.590584][ T44] __x64_sys_finit_module+0xca/0x150
[ 5162.590806][ T44] ? do_syscall_64+0x85/0x300
[ 5162.591044][ T44] do_syscall_64+0xc1/0x300
[ 5162.591266][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5162.591551][ T44] RIP: 0033:0x7feb3d6c9a0d
[ 5162.591783][ T44] RSP: 002b:00007ffc2b159f28 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5162.592138][ T44] RAX: ffffffffffffffda RBX: 000055b5fe50aac0 RCX: 00007feb3d6c9a0d
[ 5162.592479][ T44] RDX: 0000000000000000 RSI: 000055b5e7733a2a RDI: 0000000000000005
[ 5162.592821][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2b15a060
[ 5162.593161][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055b5e7733a2a
[ 5162.593506][ T44] R13: 000055b5fe50ab60 R14: 000055b5fe50ada0 R15: 0000000000000000
[ 5162.593853][ T44]
[ 5162.594032][ T44] INFO: task modprobe:30759 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5162.594517][ T44] task:kworker/u16:0 state:R running task stack:26080 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00004000
[ 5162.595080][ T44] Workqueue: netns cleanup_net
[ 5162.595306][ T44] Call Trace:
[ 5162.595471][ T44]
[ 5162.595594][ T44] ? __mutex_lock+0x19f/0x11a0
[ 5162.595833][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5162.596066][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5162.596355][ T44] ? ww_mutex_lock+0x160/0x160
[ 5162.596602][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5162.596897][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5162.597236][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5162.597587][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5162.597945][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5162.598231][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5162.598525][ T44] ? ops_undo_list+0x2bf/0x890
[ 5162.598764][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5162.599003][ T44] ? cleanup_net+0x2c5/0x890
[ 5162.599230][ T44] ? cleanup_net+0x3a1/0x890
[ 5162.599455][ T44] ? net_passive_dec+0x190/0x190
[ 5162.599690][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.599929][ T44] ? process_one_work+0xe35/0x1650
[ 5162.600161][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5162.600389][ T44] ? assign_work+0x168/0x240
[ 5162.600617][ T44] ? worker_thread+0x591/0xcf0
[ 5162.600869][ T44] ? rescuer_thread+0xd10/0xd10
[ 5162.601100][ T44] ? kthread+0x37b/0x5f0
[ 5162.601268][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.601490][ T44] ? ret_from_fork+0x1b/0x270
[ 5162.601725][ T44] ? __lock_release+0x5d/0x170
[ 5162.601957][ T44] ? rcu_is_watching+0x12/0xb0
[ 5162.602183][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.602406][ T44] ? ret_from_fork+0x1db/0x270
[ 5162.602633][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5162.602870][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5162.603113][ T44]
[ 5162.603298][ T44]
[ 5162.603298][ T44] Showing all locks held in the system:
[ 5162.603606][ T44] 4 locks held by kworker/u16:0/12:
[ 5162.603845][ T44] 1 lock held by khungtaskd/44:
[ 5162.604065][ T44] #0: ffffffffb4f83f80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5162.604465][ T44] 3 locks held by kworker/2:1/21467:
[ 5162.604683][ T44] 1 lock held by modprobe/30759:
[ 5162.604914][ T44] #0: ffffffffb56704f0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5162.605344][ T44]
[ 5162.605450][ T44] =============================================
[ 5162.605450][ T44]
[ 5285.457941][ T44] INFO: task modprobe:30759 blocked for more than 737 seconds.
[ 5285.458399][ T44] Not tainted 6.17.0-rc6-virtme #1
[ 5285.458613][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5285.458991][ T44] task:modprobe state:D stack:25712 pid:30759 tgid:30759 ppid:1 task_flags:0x400100 flags:0x00004006
[ 5285.459483][ T44] Call Trace:
[ 5285.459651][ T44]
[ 5285.459772][ T44] __schedule+0x880/0x1b10
[ 5285.460032][ T44] ? io_schedule_timeout+0x150/0x150
[ 5285.460266][ T44] ? schedule+0x1ee/0x270
[ 5285.460430][ T44] ? __lock_release+0x5d/0x170
[ 5285.460659][ T44] schedule+0xe2/0x270
[ 5285.460825][ T44] schedule_preempt_disabled+0x18/0x30
[ 5285.461063][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 5285.461301][ T44] ? __lock_acquire+0x449/0x7e0
[ 5285.461524][ T44] ? down_read+0x4a0/0x4a0
[ 5285.461752][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.461984][ T44] ? lock_acquire+0x104/0x160
[ 5285.462201][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5285.462428][ T44] down_write+0x1d6/0x200
[ 5285.462605][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 5285.462886][ T44] ? find_held_lock+0x2b/0x80
[ 5285.463106][ T44] ? __create_object+0x5e/0xb0
[ 5285.463330][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 5285.463676][ T44] register_pernet_subsys+0x1a/0x40
[ 5285.463904][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5285.464132][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 5285.464472][ T44] do_one_initcall+0x8c/0x1d0
[ 5285.464697][ T44] ? trace_initcall_level+0x130/0x130
[ 5285.464928][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.465151][ T44] ? trace_kmalloc+0x26/0xd0
[ 5285.465375][ T44] ? __kmalloc_cache_noprof+0x15f/0x360
[ 5285.465592][ T44] ? debug_objects_oom+0x160/0x160
[ 5285.465811][ T44] ? kasan_unpoison+0x27/0x50
[ 5285.466047][ T44] ? __asan_register_globals+0x5d/0x70
[ 5285.466269][ T44] do_init_module+0x27a/0x860
[ 5285.466496][ T44] ? free_module+0x2f0/0x2f0
[ 5285.466715][ T44] ? kfree+0x144/0x320
[ 5285.466887][ T44] ? find_vm_area+0x12/0x50
[ 5285.467113][ T44] load_module+0x1f40/0x2dd0
[ 5285.467344][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5285.467622][ T44] ? kernel_read_file+0x3ed/0x550
[ 5285.467846][ T44] ? kernel_read_file+0x3c8/0x550
[ 5285.468075][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5285.468302][ T44] ? init_module_from_file+0xe9/0x150
[ 5285.468521][ T44] init_module_from_file+0xe9/0x150
[ 5285.468740][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5285.468983][ T44] ? idempotent_init_module+0x316/0x610
[ 5285.469209][ T44] ? __lock_release+0x5d/0x170
[ 5285.469437][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5285.469657][ T44] idempotent_init_module+0x331/0x610
[ 5285.469889][ T44] ? init_module_from_file+0x150/0x150
[ 5285.470121][ T44] ? cap_capable+0x94/0x230
[ 5285.470348][ T44] __x64_sys_finit_module+0xca/0x150
[ 5285.470566][ T44] ? do_syscall_64+0x85/0x300
[ 5285.470797][ T44] do_syscall_64+0xc1/0x300
[ 5285.471026][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5285.471303][ T44] RIP: 0033:0x7feb3d6c9a0d
[ 5285.471531][ T44] RSP: 002b:00007ffc2b159f28 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5285.471864][ T44] RAX: ffffffffffffffda RBX: 000055b5fe50aac0 RCX: 00007feb3d6c9a0d
[ 5285.472201][ T44] RDX: 0000000000000000 RSI: 000055b5e7733a2a RDI: 0000000000000005
[ 5285.472538][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2b15a060
[ 5285.472866][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055b5e7733a2a
[ 5285.473203][ T44] R13: 000055b5fe50ab60 R14: 000055b5fe50ada0 R15: 0000000000000000
[ 5285.473545][ T44]
[ 5285.473716][ T44] INFO: task modprobe:30759 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5285.474190][ T44] task:kworker/u16:0 state:R running task stack:26080 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00004000
[ 5285.474730][ T44] Workqueue: netns cleanup_net
[ 5285.474960][ T44] Call Trace:
[ 5285.475125][ T44]
[ 5285.475238][ T44] ? __mutex_lock+0x19f/0x11a0
[ 5285.475468][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5285.475692][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5285.475986][ T44] ? ww_mutex_lock+0x160/0x160
[ 5285.476222][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5285.476503][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5285.476785][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5285.477139][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5285.477475][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5285.477810][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5285.478101][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5285.478392][ T44] ? ops_undo_list+0x2bf/0x890
[ 5285.478621][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5285.478839][ T44] ? cleanup_net+0x2c5/0x890
[ 5285.479070][ T44] ? cleanup_net+0x3a1/0x890
[ 5285.479292][ T44] ? net_passive_dec+0x190/0x190
[ 5285.479516][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.479740][ T44] ? process_one_work+0xe35/0x1650
[ 5285.479978][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5285.480210][ T44] ? assign_work+0x168/0x240
[ 5285.480441][ T44] ? worker_thread+0x591/0xcf0
[ 5285.480670][ T44] ? rescuer_thread+0xd10/0xd10
[ 5285.480902][ T44] ? kthread+0x37b/0x5f0
[ 5285.481071][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.481294][ T44] ? ret_from_fork+0x1b/0x270
[ 5285.481515][ T44] ? __lock_release+0x5d/0x170
[ 5285.481740][ T44] ? rcu_is_watching+0x12/0xb0
[ 5285.481973][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.482194][ T44] ? ret_from_fork+0x1db/0x270
[ 5285.482413][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5285.482633][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5285.482867][ T44]
[ 5285.483055][ T44]
[ 5285.483055][ T44] Showing all locks held in the system:
[ 5285.483366][ T44] 4 locks held by kworker/u16:0/12:
[ 5285.483583][ T44] 1 lock held by khungtaskd/44:
[ 5285.483799][ T44] #0: ffffffffb4f83f80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5285.484199][ T44] 3 locks held by kworker/2:1/21467:
[ 5285.484417][ T44] 1 lock held by modprobe/30759:
[ 5285.484622][ T44] #0: ffffffffb56704f0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5285.485056][ T44]
[ 5285.485162][ T44] =============================================
[ 5285.485162][ T44]
[ 5408.338090][ T44] INFO: task modprobe:30759 blocked for more than 860 seconds.
[ 5408.338760][ T44] Not tainted 6.17.0-rc6-virtme #1
[ 5408.339002][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5408.339358][ T44] task:modprobe state:D stack:25712 pid:30759 tgid:30759 ppid:1 task_flags:0x400100 flags:0x00004006
[ 5408.339846][ T44] Call Trace:
[ 5408.340027][ T44]
[ 5408.340148][ T44] __schedule+0x880/0x1b10
[ 5408.340383][ T44] ? io_schedule_timeout+0x150/0x150
[ 5408.340630][ T44] ? schedule+0x1ee/0x270
[ 5408.340797][ T44] ? __lock_release+0x5d/0x170
[ 5408.341037][ T44] schedule+0xe2/0x270
[ 5408.341208][ T44] schedule_preempt_disabled+0x18/0x30
[ 5408.341433][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 5408.341657][ T44] ? __lock_acquire+0x449/0x7e0
[ 5408.341886][ T44] ? down_read+0x4a0/0x4a0
[ 5408.342120][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.342346][ T44] ? lock_acquire+0x104/0x160
[ 5408.342567][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5408.342801][ T44] down_write+0x1d6/0x200
[ 5408.342980][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 5408.343252][ T44] ? find_held_lock+0x2b/0x80
[ 5408.343471][ T44] ? __create_object+0x5e/0xb0
[ 5408.343693][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 5408.344048][ T44] register_pernet_subsys+0x1a/0x40
[ 5408.344268][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5408.344492][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 5408.344827][ T44] do_one_initcall+0x8c/0x1d0
[ 5408.345056][ T44] ? trace_initcall_level+0x130/0x130
[ 5408.345275][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.345493][ T44] ? trace_kmalloc+0x26/0xd0
[ 5408.345716][ T44] ? __kmalloc_cache_noprof+0x15f/0x360
[ 5408.345940][ T44] ? debug_objects_oom+0x160/0x160
[ 5408.346160][ T44] ? kasan_unpoison+0x27/0x50
[ 5408.346378][ T44] ? __asan_register_globals+0x5d/0x70
[ 5408.346600][ T44] do_init_module+0x27a/0x860
[ 5408.346828][ T44] ? free_module+0x2f0/0x2f0
[ 5408.347054][ T44] ? kfree+0x144/0x320
[ 5408.347222][ T44] ? find_vm_area+0x12/0x50
[ 5408.347446][ T44] load_module+0x1f40/0x2dd0
[ 5408.347675][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5408.347956][ T44] ? kernel_read_file+0x3ed/0x550
[ 5408.348179][ T44] ? kernel_read_file+0x3c8/0x550
[ 5408.348399][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5408.348625][ T44] ? init_module_from_file+0xe9/0x150
[ 5408.348847][ T44] init_module_from_file+0xe9/0x150
[ 5408.349085][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5408.349321][ T44] ? idempotent_init_module+0x316/0x610
[ 5408.349538][ T44] ? __lock_release+0x5d/0x170
[ 5408.349766][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5408.349997][ T44] idempotent_init_module+0x331/0x610
[ 5408.350220][ T44] ? init_module_from_file+0x150/0x150
[ 5408.350463][ T44] ? cap_capable+0x94/0x230
[ 5408.350690][ T44] __x64_sys_finit_module+0xca/0x150
[ 5408.350936][ T44] ? do_syscall_64+0x85/0x300
[ 5408.351158][ T44] do_syscall_64+0xc1/0x300
[ 5408.351380][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5408.351648][ T44] RIP: 0033:0x7feb3d6c9a0d
[ 5408.351884][ T44] RSP: 002b:00007ffc2b159f28 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5408.352222][ T44] RAX: ffffffffffffffda RBX: 000055b5fe50aac0 RCX: 00007feb3d6c9a0d
[ 5408.352554][ T44] RDX: 0000000000000000 RSI: 000055b5e7733a2a RDI: 0000000000000005
[ 5408.352890][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2b15a060
[ 5408.353217][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055b5e7733a2a
[ 5408.353551][ T44] R13: 000055b5fe50ab60 R14: 000055b5fe50ada0 R15: 0000000000000000
[ 5408.353905][ T44]
[ 5408.354074][ T44] INFO: task modprobe:30759 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5408.354535][ T44] task:kworker/u16:0 state:R running task stack:26080 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00004000
[ 5408.355079][ T44] Workqueue: netns cleanup_net
[ 5408.355302][ T44] Call Trace:
[ 5408.355465][ T44]
[ 5408.355582][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5408.355806][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5408.356038][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.356263][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.356483][ T44] ? trace_contention_end+0xd8/0x140
[ 5408.356708][ T44] ? __mutex_lock+0x19f/0x11a0
[ 5408.356943][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5408.357166][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5408.357452][ T44] ? ww_mutex_lock+0x160/0x160
[ 5408.357688][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5408.357980][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5408.358266][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5408.358603][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5408.358945][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5408.359282][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5408.359565][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5408.359858][ T44] ? ops_undo_list+0x2bf/0x890
[ 5408.360095][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5408.360312][ T44] ? cleanup_net+0x2c5/0x890
[ 5408.360548][ T44] ? cleanup_net+0x3a1/0x890
[ 5408.360769][ T44] ? net_passive_dec+0x190/0x190
[ 5408.361002][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.361226][ T44] ? process_one_work+0xe35/0x1650
[ 5408.361455][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5408.361685][ T44] ? assign_work+0x168/0x240
[ 5408.361917][ T44] ? worker_thread+0x591/0xcf0
[ 5408.362148][ T44] ? rescuer_thread+0xd10/0xd10
[ 5408.362369][ T44] ? kthread+0x37b/0x5f0
[ 5408.362535][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.362753][ T44] ? ret_from_fork+0x1b/0x270
[ 5408.362984][ T44] ? __lock_release+0x5d/0x170
[ 5408.363208][ T44] ? rcu_is_watching+0x12/0xb0
[ 5408.363435][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.363656][ T44] ? ret_from_fork+0x1db/0x270
[ 5408.363871][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5408.364103][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5408.364337][ T44]
[ 5408.364519][ T44]
[ 5408.364519][ T44] Showing all locks held in the system:
[ 5408.364827][ T44] 4 locks held by kworker/u16:0/12:
[ 5408.365059][ T44] 1 lock held by khungtaskd/44:
[ 5408.365268][ T44] #0: ffffffffb4f83f80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5408.365648][ T44] 3 locks held by kworker/2:1/21467:
[ 5408.365863][ T44] 1 lock held by modprobe/30759:
[ 5408.366080][ T44] #0: ffffffffb56704f0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5408.366504][ T44]
[ 5408.366614][ T44] =============================================
[ 5408.366614][ T44]
[ 5531.217943][ T44] INFO: task modprobe:30759 blocked for more than 983 seconds.
[ 5531.218381][ T44] Not tainted 6.17.0-rc6-virtme #1
[ 5531.218591][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5531.218971][ T44] task:modprobe state:D stack:25712 pid:30759 tgid:30759 ppid:1 task_flags:0x400100 flags:0x00004006
[ 5531.219465][ T44] Call Trace:
[ 5531.219636][ T44]
[ 5531.219774][ T44] __schedule+0x880/0x1b10
[ 5531.220034][ T44] ? io_schedule_timeout+0x150/0x150
[ 5531.220271][ T44] ? schedule+0x1ee/0x270
[ 5531.220437][ T44] ? __lock_release+0x5d/0x170
[ 5531.220677][ T44] schedule+0xe2/0x270
[ 5531.220846][ T44] schedule_preempt_disabled+0x18/0x30
[ 5531.221084][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 5531.221307][ T44] ? __lock_acquire+0x449/0x7e0
[ 5531.221526][ T44] ? down_read+0x4a0/0x4a0
[ 5531.221754][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.221988][ T44] ? lock_acquire+0x104/0x160
[ 5531.222209][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5531.222443][ T44] down_write+0x1d6/0x200
[ 5531.222610][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 5531.222895][ T44] ? find_held_lock+0x2b/0x80
[ 5531.223120][ T44] ? __create_object+0x5e/0xb0
[ 5531.223344][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 5531.223686][ T44] register_pernet_subsys+0x1a/0x40
[ 5531.223940][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5531.224167][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 5531.224497][ T44] do_one_initcall+0x8c/0x1d0
[ 5531.224717][ T44] ? trace_initcall_level+0x130/0x130
[ 5531.224947][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.225169][ T44] ? trace_kmalloc+0x26/0xd0
[ 5531.225386][ T44] ? __kmalloc_cache_noprof+0x15f/0x360
[ 5531.225611][ T44] ? debug_objects_oom+0x160/0x160
[ 5531.225830][ T44] ? kasan_unpoison+0x27/0x50
[ 5531.226071][ T44] ? __asan_register_globals+0x5d/0x70
[ 5531.226295][ T44] do_init_module+0x27a/0x860
[ 5531.226520][ T44] ? free_module+0x2f0/0x2f0
[ 5531.226738][ T44] ? kfree+0x144/0x320
[ 5531.226910][ T44] ? find_vm_area+0x12/0x50
[ 5531.227136][ T44] load_module+0x1f40/0x2dd0
[ 5531.227369][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5531.227642][ T44] ? kernel_read_file+0x3ed/0x550
[ 5531.227865][ T44] ? kernel_read_file+0x3c8/0x550
[ 5531.228111][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5531.228338][ T44] ? init_module_from_file+0xe9/0x150
[ 5531.228559][ T44] init_module_from_file+0xe9/0x150
[ 5531.228781][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5531.229027][ T44] ? idempotent_init_module+0x316/0x610
[ 5531.229246][ T44] ? __lock_release+0x5d/0x170
[ 5531.229471][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5531.229696][ T44] idempotent_init_module+0x331/0x610
[ 5531.229928][ T44] ? init_module_from_file+0x150/0x150
[ 5531.230159][ T44] ? cap_capable+0x94/0x230
[ 5531.230386][ T44] __x64_sys_finit_module+0xca/0x150
[ 5531.230607][ T44] ? do_syscall_64+0x85/0x300
[ 5531.230832][ T44] do_syscall_64+0xc1/0x300
[ 5531.231061][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5531.231333][ T44] RIP: 0033:0x7feb3d6c9a0d
[ 5531.231564][ T44] RSP: 002b:00007ffc2b159f28 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5531.231915][ T44] RAX: ffffffffffffffda RBX: 000055b5fe50aac0 RCX: 00007feb3d6c9a0d
[ 5531.232251][ T44] RDX: 0000000000000000 RSI: 000055b5e7733a2a RDI: 0000000000000005
[ 5531.232578][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2b15a060
[ 5531.232914][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055b5e7733a2a
[ 5531.233245][ T44] R13: 000055b5fe50ab60 R14: 000055b5fe50ada0 R15: 0000000000000000
[ 5531.233592][ T44]
[ 5531.233761][ T44] INFO: task modprobe:30759 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5531.234233][ T44] task:kworker/u16:0 state:R running task stack:26080 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00004000
[ 5531.234769][ T44] Workqueue: netns cleanup_net
[ 5531.235011][ T44] Call Trace:
[ 5531.235180][ T44]
[ 5531.235293][ T44] ? __mutex_lock+0x19f/0x11a0
[ 5531.235516][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5531.235740][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5531.236049][ T44] ? ww_mutex_lock+0x160/0x160
[ 5531.236289][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5531.236570][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5531.236855][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5531.237201][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5531.237538][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5531.237886][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5531.238168][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5531.238462][ T44] ? ops_undo_list+0x2bf/0x890
[ 5531.238686][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5531.238910][ T44] ? cleanup_net+0x2c5/0x890
[ 5531.239138][ T44] ? cleanup_net+0x3a1/0x890
[ 5531.239360][ T44] ? net_passive_dec+0x190/0x190
[ 5531.239581][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.239807][ T44] ? process_one_work+0xe35/0x1650
[ 5531.240065][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5531.240292][ T44] ? assign_work+0x168/0x240
[ 5531.240514][ T44] ? worker_thread+0x591/0xcf0
[ 5531.240739][ T44] ? rescuer_thread+0xd10/0xd10
[ 5531.240969][ T44] ? kthread+0x37b/0x5f0
[ 5531.241136][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.241356][ T44] ? ret_from_fork+0x1b/0x270
[ 5531.241574][ T44] ? __lock_release+0x5d/0x170
[ 5531.241799][ T44] ? rcu_is_watching+0x12/0xb0
[ 5531.242026][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.242248][ T44] ? ret_from_fork+0x1db/0x270
[ 5531.242466][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5531.242684][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5531.242924][ T44]
[ 5531.243123][ T44]
[ 5531.243123][ T44] Showing all locks held in the system:
[ 5531.243430][ T44] 4 locks held by kworker/u16:0/12:
[ 5531.243651][ T44] 1 lock held by khungtaskd/44:
[ 5531.243859][ T44] #0: ffffffffb4f83f80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5531.244503][ T44] 3 locks held by kworker/2:1/21467:
[ 5531.244717][ T44] 1 lock held by modprobe/30759:
[ 5531.244931][ T44] #0: ffffffffb56704f0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5531.245366][ T44]
[ 5531.245469][ T44] =============================================
[ 5531.245469][ T44]
[ 5654.098005][ T44] INFO: task modprobe:30759 blocked for more than 1105 seconds.
[ 5654.098696][ T44] Not tainted 6.17.0-rc6-virtme #1
[ 5654.098952][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5654.099310][ T44] task:modprobe state:D stack:25712 pid:30759 tgid:30759 ppid:1 task_flags:0x400100 flags:0x00004006
[ 5654.099826][ T44] Call Trace:
[ 5654.100014][ T44]
[ 5654.100138][ T44] __schedule+0x880/0x1b10
[ 5654.100381][ T44] ? io_schedule_timeout+0x150/0x150
[ 5654.100625][ T44] ? schedule+0x1ee/0x270
[ 5654.100811][ T44] ? __lock_release+0x5d/0x170
[ 5654.101067][ T44] schedule+0xe2/0x270
[ 5654.101249][ T44] schedule_preempt_disabled+0x18/0x30
[ 5654.101476][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 5654.101702][ T44] ? __lock_acquire+0x449/0x7e0
[ 5654.101942][ T44] ? down_read+0x4a0/0x4a0
[ 5654.102171][ T44] ? rcu_is_watching+0x12/0xb0
[ 5654.102399][ T44] ? lock_acquire+0x104/0x160
[ 5654.102620][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5654.102862][ T44] down_write+0x1d6/0x200
[ 5654.103044][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 5654.103318][ T44] ? find_held_lock+0x2b/0x80
[ 5654.103547][ T44] ? __create_object+0x5e/0xb0
[ 5654.103776][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 5654.104127][ T44] register_pernet_subsys+0x1a/0x40
[ 5654.104349][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5654.104591][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 5654.104944][ T44] do_one_initcall+0x8c/0x1d0
[ 5654.105168][ T44] ? trace_initcall_level+0x130/0x130
[ 5654.105392][ T44] ? rcu_is_watching+0x12/0xb0
[ 5654.105617][ T44] ? trace_kmalloc+0x26/0xd0
[ 5654.105853][ T44] ? __kmalloc_cache_noprof+0x15f/0x360
[ 5654.106083][ T44] ? debug_objects_oom+0x160/0x160
[ 5654.106308][ T44] ? kasan_unpoison+0x27/0x50
[ 5654.106539][ T44] ? __asan_register_globals+0x5d/0x70
[ 5654.106771][ T44] do_init_module+0x27a/0x860
[ 5654.107009][ T44] ? free_module+0x2f0/0x2f0
[ 5654.107231][ T44] ? kfree+0x144/0x320
[ 5654.107403][ T44] ? find_vm_area+0x12/0x50
[ 5654.107630][ T44] load_module+0x1f40/0x2dd0
[ 5654.107872][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5654.108162][ T44] ? kernel_read_file+0x3ed/0x550
[ 5654.108393][ T44] ? kernel_read_file+0x3c8/0x550
[ 5654.108617][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5654.108855][ T44] ? init_module_from_file+0xe9/0x150
[ 5654.109092][ T44] init_module_from_file+0xe9/0x150
[ 5654.109312][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5654.109556][ T44] ? idempotent_init_module+0x316/0x610
[ 5654.109788][ T44] ? __lock_release+0x5d/0x170
[ 5654.110023][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5654.110243][ T44] idempotent_init_module+0x331/0x610
[ 5654.110474][ T44] ? init_module_from_file+0x150/0x150
[ 5654.110705][ T44] ? cap_capable+0x94/0x230
[ 5654.110948][ T44] __x64_sys_finit_module+0xca/0x150
[ 5654.111172][ T44] ? do_syscall_64+0x85/0x300
[ 5654.111399][ T44] do_syscall_64+0xc1/0x300
[ 5654.111620][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5654.111910][ T44] RIP: 0033:0x7feb3d6c9a0d
[ 5654.112137][ T44] RSP: 002b:00007ffc2b159f28 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5654.112479][ T44] RAX: ffffffffffffffda RBX: 000055b5fe50aac0 RCX: 00007feb3d6c9a0d
[ 5654.112826][ T44] RDX: 0000000000000000 RSI: 000055b5e7733a2a RDI: 0000000000000005
[ 5654.113162][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2b15a060
[ 5654.113497][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055b5e7733a2a
[ 5654.113833][ T44] R13: 000055b5fe50ab60 R14: 000055b5fe50ada0 R15: 0000000000000000
[ 5654.114186][ T44]
[ 5654.114359][ T44] INFO: task modprobe:30759 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5654.114861][ T44] task:kworker/u16:0 state:R running task stack:26080 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00004000
[ 5654.115416][ T44] Workqueue: netns cleanup_net
[ 5654.115639][ T44] Call Trace:
[ 5654.115816][ T44]
[ 5654.115947][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5654.116171][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5654.116394][ T44] ? rcu_is_watching+0x12/0xb0
[ 5654.116619][ T44] ? rcu_is_watching+0x12/0xb0
[ 5654.116850][ T44] ? trace_contention_end+0xd8/0x140
[ 5654.117083][ T44] ? __mutex_lock+0x19f/0x11a0
[ 5654.117309][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5654.117547][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5654.117846][ T44] ? ww_mutex_lock+0x160/0x160
[ 5654.118186][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5654.118484][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5654.118771][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5654.119131][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5654.119482][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5654.119828][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5654.120124][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5654.120425][ T44] ? ops_undo_list+0x2bf/0x890
[ 5654.120652][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5654.120888][ T44] ? cleanup_net+0x2c5/0x890
[ 5654.121117][ T44] ? cleanup_net+0x3a1/0x890
[ 5654.121338][ T44] ? net_passive_dec+0x190/0x190
[ 5654.121568][ T44] ? rcu_is_watching+0x12/0xb0
[ 5654.121800][ T44] ? process_one_work+0xe35/0x1650
[ 5654.122042][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5654.122271][ T44] ? assign_work+0x168/0x240
[ 5654.122499][ T44] ? worker_thread+0x591/0xcf0
[ 5654.122732][ T44] ? rescuer_thread+0xd10/0xd10
[ 5654.122974][ T44] ? kthread+0x37b/0x5f0
[ 5654.123145][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5654.123366][ T44] ? ret_from_fork+0x1b/0x270
[ 5654.123592][ T44] ? __lock_release+0x5d/0x170
[ 5654.123822][ T44] ? rcu_is_watching+0x12/0xb0
[ 5654.124052][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5654.124277][ T44] ? ret_from_fork+0x1db/0x270
[ 5654.124505][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5654.124729][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5654.124979][ T44]
[ 5654.125167][ T44]
[ 5654.125167][ T44] Showing all locks held in the system:
[ 5654.125486][ T44] 4 locks held by kworker/u16:0/12:
[ 5654.125704][ T44] 1 lock held by khungtaskd/44:
[ 5654.125932][ T44] #0: ffffffffb4f83f80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5654.126323][ T44] 3 locks held by kworker/2:1/21467:
[ 5654.126547][ T44] 1 lock held by modprobe/30759:
[ 5654.126762][ T44] #0: ffffffffb56704f0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5654.127203][ T44]
[ 5654.127309][ T44] =============================================
[ 5654.127309][ T44]
[ 5776.978003][ T44] INFO: task modprobe:30759 blocked for more than 1228 seconds.
[ 5776.978716][ T44] Not tainted 6.17.0-rc6-virtme #1
[ 5776.978959][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 5776.979330][ T44] task:modprobe state:D stack:25712 pid:30759 tgid:30759 ppid:1 task_flags:0x400100 flags:0x00004006
[ 5776.979834][ T44] Call Trace:
[ 5776.980014][ T44]
[ 5776.980133][ T44] __schedule+0x880/0x1b10
[ 5776.980376][ T44] ? io_schedule_timeout+0x150/0x150
[ 5776.980618][ T44] ? schedule+0x1ee/0x270
[ 5776.980798][ T44] ? __lock_release+0x5d/0x170
[ 5776.981063][ T44] schedule+0xe2/0x270
[ 5776.981235][ T44] schedule_preempt_disabled+0x18/0x30
[ 5776.981464][ T44] rwsem_down_write_slowpath+0x3c5/0xcb0
[ 5776.981688][ T44] ? __lock_acquire+0x449/0x7e0
[ 5776.981931][ T44] ? down_read+0x4a0/0x4a0
[ 5776.982160][ T44] ? rcu_is_watching+0x12/0xb0
[ 5776.982388][ T44] ? lock_acquire+0x104/0x160
[ 5776.982606][ T44] ? register_pernet_subsys+0x1a/0x40
[ 5776.982850][ T44] down_write+0x1d6/0x200
[ 5776.983029][ T44] ? rwsem_down_write_slowpath+0xcb0/0xcb0
[ 5776.983300][ T44] ? find_held_lock+0x2b/0x80
[ 5776.983530][ T44] ? __create_object+0x5e/0xb0
[ 5776.983769][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 5776.984119][ T44] register_pernet_subsys+0x1a/0x40
[ 5776.984340][ T44] pg_init+0x2c/0x1000 [pktgen]
[ 5776.984582][ T44] ? nf_conntrack_standalone_fini+0xaf0/0xaf0 [nf_conntrack]
[ 5776.984956][ T44] do_one_initcall+0x8c/0x1d0
[ 5776.985180][ T44] ? trace_initcall_level+0x130/0x130
[ 5776.985413][ T44] ? rcu_is_watching+0x12/0xb0
[ 5776.985635][ T44] ? trace_kmalloc+0x26/0xd0
[ 5776.985867][ T44] ? __kmalloc_cache_noprof+0x15f/0x360
[ 5776.986095][ T44] ? debug_objects_oom+0x160/0x160
[ 5776.986322][ T44] ? kasan_unpoison+0x27/0x50
[ 5776.986550][ T44] ? __asan_register_globals+0x5d/0x70
[ 5776.986776][ T44] do_init_module+0x27a/0x860
[ 5776.987010][ T44] ? free_module+0x2f0/0x2f0
[ 5776.987231][ T44] ? kfree+0x144/0x320
[ 5776.987404][ T44] ? find_vm_area+0x12/0x50
[ 5776.987630][ T44] load_module+0x1f40/0x2dd0
[ 5776.987884][ T44] ? layout_and_allocate.constprop.0+0x630/0x630
[ 5776.988166][ T44] ? kernel_read_file+0x3ed/0x550
[ 5776.988397][ T44] ? kernel_read_file+0x3c8/0x550
[ 5776.988622][ T44] ? __ia32_sys_fsconfig+0x150/0x150
[ 5776.988857][ T44] ? init_module_from_file+0xe9/0x150
[ 5776.989110][ T44] init_module_from_file+0xe9/0x150
[ 5776.989334][ T44] ? __do_sys_init_module+0x1e0/0x1e0
[ 5776.989582][ T44] ? idempotent_init_module+0x316/0x610
[ 5776.989810][ T44] ? __lock_release+0x5d/0x170
[ 5776.990046][ T44] ? do_raw_spin_unlock+0x58/0x220
[ 5776.990270][ T44] idempotent_init_module+0x331/0x610
[ 5776.990499][ T44] ? init_module_from_file+0x150/0x150
[ 5776.990730][ T44] ? cap_capable+0x94/0x230
[ 5776.990974][ T44] __x64_sys_finit_module+0xca/0x150
[ 5776.991199][ T44] ? do_syscall_64+0x85/0x300
[ 5776.991433][ T44] do_syscall_64+0xc1/0x300
[ 5776.991658][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 5776.991957][ T44] RIP: 0033:0x7feb3d6c9a0d
[ 5776.992185][ T44] RSP: 002b:00007ffc2b159f28 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 5776.992528][ T44] RAX: ffffffffffffffda RBX: 000055b5fe50aac0 RCX: 00007feb3d6c9a0d
[ 5776.992869][ T44] RDX: 0000000000000000 RSI: 000055b5e7733a2a RDI: 0000000000000005
[ 5776.993227][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffc2b15a060
[ 5776.993563][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055b5e7733a2a
[ 5776.993910][ T44] R13: 000055b5fe50ab60 R14: 000055b5fe50ada0 R15: 0000000000000000
[ 5776.994262][ T44]
[ 5776.994442][ T44] INFO: task modprobe:30759 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 5776.994931][ T44] task:kworker/u16:0 state:R running task stack:26080 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00004000
[ 5776.995482][ T44] Workqueue: netns cleanup_net
[ 5776.995712][ T44] Call Trace:
[ 5776.995890][ T44]
[ 5776.996011][ T44] ? __mutex_trylock_common+0xf9/0x260
[ 5776.996235][ T44] ? __mutex_handoff+0x2b0/0x2b0
[ 5776.996465][ T44] ? rcu_is_watching+0x12/0xb0
[ 5776.996689][ T44] ? rcu_is_watching+0x12/0xb0
[ 5776.996943][ T44] ? trace_contention_end+0xd8/0x140
[ 5776.997164][ T44] ? __mutex_lock+0x19f/0x11a0
[ 5776.997396][ T44] ? trace_sched_exit_tp+0xcd/0x130
[ 5776.997626][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5776.997934][ T44] ? irqentry_exit+0x3b/0x80
[ 5776.998182][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5776.998472][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack]
[ 5776.998758][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack]
[ 5776.999114][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack]
[ 5776.999459][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack]
[ 5776.999804][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 5777.000099][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack]
[ 5777.000398][ T44] ? ops_undo_list+0x2bf/0x890
[ 5777.000625][ T44] ? rtnl_net_dumpid_one+0x270/0x270
[ 5777.000856][ T44] ? cleanup_net+0x2c5/0x890
[ 5777.001111][ T44] ? cleanup_net+0x3a1/0x890
[ 5777.001333][ T44] ? net_passive_dec+0x190/0x190
[ 5777.001564][ T44] ? rcu_is_watching+0x12/0xb0
[ 5777.001798][ T44] ? process_one_work+0xe35/0x1650
[ 5777.002042][ T44] ? pwq_dec_nr_in_flight+0x550/0x550
[ 5777.002271][ T44] ? assign_work+0x168/0x240
[ 5777.002506][ T44] ? worker_thread+0x591/0xcf0
[ 5777.002736][ T44] ? rescuer_thread+0xd10/0xd10
[ 5777.002978][ T44] ? kthread+0x37b/0x5f0
[ 5777.003147][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5777.003370][ T44] ? ret_from_fork+0x1b/0x270
[ 5777.003595][ T44] ? __lock_release+0x5d/0x170
[ 5777.003825][ T44] ? rcu_is_watching+0x12/0xb0
[ 5777.004054][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5777.004280][ T44] ? ret_from_fork+0x1db/0x270
[ 5777.004505][ T44] ? kthread_is_per_cpu+0xc0/0xc0
[ 5777.004723][ T44] ? ret_from_fork_asm+0x11/0x20
[ 5777.004988][ T44]
[ 5777.005157][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings
[ 5777.005558][ T44]
[ 5777.005558][ T44] Showing all locks held in the system:
[ 5777.006180][ T44] 4 locks held by kworker/u16:0/12:
[ 5777.006418][ T44] 1 lock held by khungtaskd/44:
[ 5777.006626][ T44] #0: ffffffffb4f83f80 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260
[ 5777.007029][ T44] 3 locks held by kworker/2:1/21467:
[ 5777.007245][ T44] 1 lock held by modprobe/30759:
[ 5777.007462][ T44] #0: ffffffffb56704f0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40
[ 5777.007920][ T44]
[ 5777.008025][ T44] =============================================
[ 5777.008025][ T44]
WAIT TIMEOUT stderr
Ctrl-C stderr
Ctrl-C stderr