[ 4425.292943][ T44] INFO: task modprobe:21119 blocked for more than 122 seconds. [ 4425.293516][ T44] Not tainted 6.18.0-rc3-virtme #1 [ 4425.293731][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4425.294155][ T44] task:modprobe state:D stack:25664 pid:21119 tgid:21119 ppid:408 task_flags:0x400100 flags:0x00080001 [ 4425.294682][ T44] Call Trace: [ 4425.294869][ T44] [ 4425.295000][ T44] __schedule+0x880/0x1b10 [ 4425.295264][ T44] ? io_schedule_timeout+0x150/0x150 [ 4425.295519][ T44] ? schedule+0x1ee/0x270 [ 4425.295688][ T44] ? __lock_release+0x5d/0x170 [ 4425.295954][ T44] schedule+0xe2/0x270 [ 4425.296140][ T44] schedule_preempt_disabled+0x18/0x30 [ 4425.296437][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4425.296666][ T44] ? __lock_acquire+0x449/0x7e0 [ 4425.296902][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4425.297137][ T44] ? rcu_is_watching+0x12/0xb0 [ 4425.297364][ T44] ? lock_acquire+0x104/0x160 [ 4425.297586][ T44] ? register_pernet_subsys+0x1a/0x40 [ 4425.297821][ T44] down_write+0x1d6/0x200 [ 4425.298010][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4425.298301][ T44] ? find_held_lock+0x2b/0x80 [ 4425.298531][ T44] ? __create_object+0x5e/0xb0 [ 4425.298755][ T44] ? __lock_release+0x5d/0x170 [ 4425.298996][ T44] ? _sub_I_65535_1+0x230/0x230 [vxlan] [ 4425.299236][ T44] register_pernet_subsys+0x1a/0x40 [ 4425.299463][ T44] vxlan_init_module+0x17/0x1000 [vxlan] [ 4425.299702][ T44] do_one_initcall+0x8c/0x1d0 [ 4425.299958][ T44] ? trace_initcall_start+0x130/0x130 [ 4425.300679][ T44] ? rcu_is_watching+0x12/0xb0 [ 4425.300918][ T44] ? trace_kmalloc+0x26/0xd0 [ 4425.301145][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690 [ 4425.301365][ T44] ? debug_objects_oom+0x160/0x160 [ 4425.301598][ T44] ? kasan_unpoison+0x27/0x50 [ 4425.301835][ T44] ? __asan_register_globals+0x5d/0x70 [ 4425.302071][ T44] do_init_module+0x27a/0x860 [ 4425.302304][ T44] ? free_module+0x2f0/0x2f0 [ 4425.302531][ T44] ? kfree+0x21d/0x540 [ 4425.302701][ T44] ? load_module+0x20c5/0x2dd0 [ 4425.302940][ T44] load_module+0x1f40/0x2dd0 [ 4425.303176][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4425.303456][ T44] ? kernel_read_file+0x3ed/0x550 [ 4425.303690][ T44] ? kernel_read_file+0x3c8/0x550 [ 4425.303942][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4425.304171][ T44] ? init_module_from_file+0xe9/0x150 [ 4425.304395][ T44] init_module_from_file+0xe9/0x150 [ 4425.304621][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4425.304868][ T44] ? idempotent_init_module+0x316/0x610 [ 4425.305097][ T44] ? __lock_release+0x5d/0x170 [ 4425.305324][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4425.305551][ T44] idempotent_init_module+0x331/0x610 [ 4425.305779][ T44] ? init_module_from_file+0x150/0x150 [ 4425.306022][ T44] ? cap_capable+0x94/0x230 [ 4425.306255][ T44] __x64_sys_finit_module+0xca/0x150 [ 4425.306478][ T44] ? do_syscall_64+0x85/0xfd0 [ 4425.306714][ T44] do_syscall_64+0xc1/0xfd0 [ 4425.306948][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4425.307228][ T44] RIP: 0033:0x7f855ecf892d [ 4425.307465][ T44] RSP: 002b:00007ffe70794088 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4425.307806][ T44] RAX: ffffffffffffffda RBX: 000055ecef050c30 RCX: 00007f855ecf892d [ 4425.308203][ T44] RDX: 0000000000000000 RSI: 000055ecbbcaca2a RDI: 0000000000000000 [ 4425.308551][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe707941c0 [ 4425.308901][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055ecbbcaca2a [ 4425.309237][ T44] R13: 000055ecef050f50 R14: 000055ecef050fa0 R15: 000055ecef050c9e [ 4425.309594][ T44] [ 4425.309771][ T44] INFO: task modprobe:21119 blocked on an rw-semaphore likely owned by task kworker/u16:0:12 [ 4425.310264][ T44] task:kworker/u16:0 state:R running task stack:24688 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 4425.310820][ T44] Workqueue: netns cleanup_net [ 4425.311061][ T44] Call Trace: [ 4425.311233][ T44] [ 4425.311354][ T44] ? trace_sched_exit_tp+0xcd/0x130 [ 4425.311632][ T44] ? irqentry_exit+0x3b/0x80 [ 4425.311884][ T44] ? lockdep_hardirqs_on+0x7c/0x110 [ 4425.312122][ T44] ? nf_ct_iterate_cleanup+0x80/0x340 [nf_conntrack] [ 4425.312416][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack] [ 4425.312765][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack] [ 4425.313115][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack] [ 4425.313466][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 4425.313758][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 4425.314051][ T44] ? _raw_spin_unlock+0x2d/0x50 [ 4425.314279][ T44] ? ops_undo_list+0x2bf/0x890 [ 4425.314510][ T44] ? rtnl_net_dumpid_one+0x270/0x270 [ 4425.314731][ T44] ? cleanup_net+0x2d6/0x8b0 [ 4425.314977][ T44] ? cleanup_net+0x3b2/0x8b0 [ 4425.315200][ T44] ? net_passive_dec+0x190/0x190 [ 4425.315426][ T44] ? rcu_is_watching+0x12/0xb0 [ 4425.315655][ T44] ? process_one_work+0xe35/0x1650 [ 4425.315911][ T44] ? pwq_dec_nr_in_flight+0x550/0x550 [ 4425.316144][ T44] ? assign_work+0x168/0x240 [ 4425.316368][ T44] ? worker_thread+0x591/0xcf0 [ 4425.316605][ T44] ? rescuer_thread+0xd10/0xd10 [ 4425.316830][ T44] ? kthread+0x37b/0x5f0 [ 4425.317012][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4425.317234][ T44] ? ret_from_fork+0x1b/0x270 [ 4425.317456][ T44] ? __lock_release+0x5d/0x170 [ 4425.317679][ T44] ? rcu_is_watching+0x12/0xb0 [ 4425.317908][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4425.318172][ T44] ? ret_from_fork+0x1db/0x270 [ 4425.318398][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4425.318630][ T44] ? ret_from_fork_asm+0x11/0x20 [ 4425.318874][ T44] [ 4425.319072][ T44] [ 4425.319072][ T44] Showing all locks held in the system: [ 4425.319396][ T44] 4 locks held by kworker/u16:0/12: [ 4425.319627][ T44] 1 lock held by khungtaskd/44: [ 4425.320270][ T44] #0: ffffffffac1881c0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4425.320678][ T44] 2 locks held by kworker/u19:0/408: [ 4425.320899][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1650 [ 4425.321331][ T44] #1: ffffc900008bfd30 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xded/0x1650 [ 4425.321831][ T44] 1 lock held by modprobe/21119: [ 4425.322052][ T44] #0: ffffffffac87ff50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4425.322495][ T44] [ 4425.322606][ T44] ============================================= [ 4425.322606][ T44] [ 4548.173962][ T44] INFO: task modprobe:21119 blocked for more than 245 seconds. [ 4548.174454][ T44] Not tainted 6.18.0-rc3-virtme #1 [ 4548.174668][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4548.175096][ T44] task:modprobe state:D stack:25664 pid:21119 tgid:21119 ppid:408 task_flags:0x400100 flags:0x00080001 [ 4548.175634][ T44] Call Trace: [ 4548.175803][ T44] [ 4548.175935][ T44] __schedule+0x880/0x1b10 [ 4548.176181][ T44] ? io_schedule_timeout+0x150/0x150 [ 4548.176421][ T44] ? schedule+0x1ee/0x270 [ 4548.176589][ T44] ? __lock_release+0x5d/0x170 [ 4548.176821][ T44] schedule+0xe2/0x270 [ 4548.177003][ T44] schedule_preempt_disabled+0x18/0x30 [ 4548.177227][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4548.177487][ T44] ? __lock_acquire+0x449/0x7e0 [ 4548.177711][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4548.177952][ T44] ? rcu_is_watching+0x12/0xb0 [ 4548.178180][ T44] ? lock_acquire+0x104/0x160 [ 4548.178400][ T44] ? register_pernet_subsys+0x1a/0x40 [ 4548.178634][ T44] down_write+0x1d6/0x200 [ 4548.178805][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4548.179095][ T44] ? find_held_lock+0x2b/0x80 [ 4548.179324][ T44] ? __create_object+0x5e/0xb0 [ 4548.179549][ T44] ? __lock_release+0x5d/0x170 [ 4548.179775][ T44] ? _sub_I_65535_1+0x230/0x230 [vxlan] [ 4548.180030][ T44] register_pernet_subsys+0x1a/0x40 [ 4548.180255][ T44] vxlan_init_module+0x17/0x1000 [vxlan] [ 4548.180488][ T44] do_one_initcall+0x8c/0x1d0 [ 4548.180721][ T44] ? trace_initcall_start+0x130/0x130 [ 4548.180977][ T44] ? rcu_is_watching+0x12/0xb0 [ 4548.181201][ T44] ? trace_kmalloc+0x26/0xd0 [ 4548.181423][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690 [ 4548.181649][ T44] ? debug_objects_oom+0x160/0x160 [ 4548.181887][ T44] ? kasan_unpoison+0x27/0x50 [ 4548.182114][ T44] ? __asan_register_globals+0x5d/0x70 [ 4548.182350][ T44] do_init_module+0x27a/0x860 [ 4548.182581][ T44] ? free_module+0x2f0/0x2f0 [ 4548.182803][ T44] ? kfree+0x21d/0x540 [ 4548.182980][ T44] ? load_module+0x20c5/0x2dd0 [ 4548.183211][ T44] load_module+0x1f40/0x2dd0 [ 4548.183446][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4548.183720][ T44] ? kernel_read_file+0x3ed/0x550 [ 4548.183953][ T44] ? kernel_read_file+0x3c8/0x550 [ 4548.184187][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4548.184415][ T44] ? init_module_from_file+0xe9/0x150 [ 4548.184639][ T44] init_module_from_file+0xe9/0x150 [ 4548.184868][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4548.185106][ T44] ? idempotent_init_module+0x316/0x610 [ 4548.185325][ T44] ? __lock_release+0x5d/0x170 [ 4548.185552][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4548.185782][ T44] idempotent_init_module+0x331/0x610 [ 4548.186023][ T44] ? init_module_from_file+0x150/0x150 [ 4548.186259][ T44] ? cap_capable+0x94/0x230 [ 4548.186492][ T44] __x64_sys_finit_module+0xca/0x150 [ 4548.186716][ T44] ? do_syscall_64+0x85/0xfd0 [ 4548.186950][ T44] do_syscall_64+0xc1/0xfd0 [ 4548.187177][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4548.187491][ T44] RIP: 0033:0x7f855ecf892d [ 4548.187724][ T44] RSP: 002b:00007ffe70794088 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4548.188071][ T44] RAX: ffffffffffffffda RBX: 000055ecef050c30 RCX: 00007f855ecf892d [ 4548.188406][ T44] RDX: 0000000000000000 RSI: 000055ecbbcaca2a RDI: 0000000000000000 [ 4548.188741][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe707941c0 [ 4548.189131][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055ecbbcaca2a [ 4548.189469][ T44] R13: 000055ecef050f50 R14: 000055ecef050fa0 R15: 000055ecef050c9e [ 4548.189821][ T44] [ 4548.190004][ T44] INFO: task modprobe:21119 blocked on an rw-semaphore likely owned by task kworker/u16:0:12 [ 4548.190529][ T44] task:kworker/u16:0 state:R running task stack:24688 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 4548.191091][ T44] Workqueue: netns cleanup_net [ 4548.191326][ T44] Call Trace: [ 4548.191497][ T44] [ 4548.191611][ T44] ? __mutex_lock+0x19f/0x1190 [ 4548.191851][ T44] ? trace_sched_exit_tp+0xcd/0x130 [ 4548.192090][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 4548.192381][ T44] ? ww_mutex_lock+0x160/0x160 [ 4548.192629][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 4548.192924][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 4548.193211][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack] [ 4548.193557][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack] [ 4548.193915][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack] [ 4548.194261][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 4548.194554][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 4548.194841][ T44] ? _raw_spin_unlock+0x2d/0x50 [ 4548.195079][ T44] ? ops_undo_list+0x2bf/0x890 [ 4548.195317][ T44] ? rtnl_net_dumpid_one+0x270/0x270 [ 4548.195544][ T44] ? cleanup_net+0x2d6/0x8b0 [ 4548.195776][ T44] ? cleanup_net+0x3b2/0x8b0 [ 4548.196010][ T44] ? net_passive_dec+0x190/0x190 [ 4548.196240][ T44] ? rcu_is_watching+0x12/0xb0 [ 4548.196468][ T44] ? process_one_work+0xe35/0x1650 [ 4548.196705][ T44] ? pwq_dec_nr_in_flight+0x550/0x550 [ 4548.196943][ T44] ? assign_work+0x168/0x240 [ 4548.197176][ T44] ? worker_thread+0x591/0xcf0 [ 4548.197431][ T44] ? rescuer_thread+0xd10/0xd10 [ 4548.197659][ T44] ? kthread+0x37b/0x5f0 [ 4548.197830][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4548.198059][ T44] ? ret_from_fork+0x1b/0x270 [ 4548.198285][ T44] ? __lock_release+0x5d/0x170 [ 4548.198510][ T44] ? rcu_is_watching+0x12/0xb0 [ 4548.198733][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4548.198994][ T44] ? ret_from_fork+0x1db/0x270 [ 4548.199215][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4548.199436][ T44] ? ret_from_fork_asm+0x11/0x20 [ 4548.199676][ T44] [ 4548.199863][ T44] [ 4548.199863][ T44] Showing all locks held in the system: [ 4548.200185][ T44] 4 locks held by kworker/u16:0/12: [ 4548.200413][ T44] 1 lock held by khungtaskd/44: [ 4548.200625][ T44] #0: ffffffffac1881c0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4548.201175][ T44] 2 locks held by kworker/u19:0/408: [ 4548.201393][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1650 [ 4548.201822][ T44] #1: ffffc900008bfd30 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xded/0x1650 [ 4548.202334][ T44] 1 lock held by modprobe/21119: [ 4548.202550][ T44] #0: ffffffffac87ff50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4548.202987][ T44] [ 4548.203094][ T44] ============================================= [ 4548.203094][ T44] [ 4671.052933][ T44] INFO: task modprobe:21119 blocked for more than 368 seconds. [ 4671.053429][ T44] Not tainted 6.18.0-rc3-virtme #1 [ 4671.053659][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4671.054057][ T44] task:modprobe state:D stack:25664 pid:21119 tgid:21119 ppid:408 task_flags:0x400100 flags:0x00080001 [ 4671.054585][ T44] Call Trace: [ 4671.054755][ T44] [ 4671.054895][ T44] __schedule+0x880/0x1b10 [ 4671.055146][ T44] ? io_schedule_timeout+0x150/0x150 [ 4671.055393][ T44] ? schedule+0x1ee/0x270 [ 4671.055563][ T44] ? __lock_release+0x5d/0x170 [ 4671.055799][ T44] schedule+0xe2/0x270 [ 4671.055999][ T44] schedule_preempt_disabled+0x18/0x30 [ 4671.056232][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4671.056458][ T44] ? __lock_acquire+0x449/0x7e0 [ 4671.056688][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4671.056950][ T44] ? rcu_is_watching+0x12/0xb0 [ 4671.057185][ T44] ? lock_acquire+0x104/0x160 [ 4671.057407][ T44] ? register_pernet_subsys+0x1a/0x40 [ 4671.057641][ T44] down_write+0x1d6/0x200 [ 4671.057811][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4671.058102][ T44] ? find_held_lock+0x2b/0x80 [ 4671.058335][ T44] ? __create_object+0x5e/0xb0 [ 4671.058573][ T44] ? __lock_release+0x5d/0x170 [ 4671.058800][ T44] ? _sub_I_65535_1+0x230/0x230 [vxlan] [ 4671.059053][ T44] register_pernet_subsys+0x1a/0x40 [ 4671.059286][ T44] vxlan_init_module+0x17/0x1000 [vxlan] [ 4671.059518][ T44] do_one_initcall+0x8c/0x1d0 [ 4671.059745][ T44] ? trace_initcall_start+0x130/0x130 [ 4671.060000][ T44] ? rcu_is_watching+0x12/0xb0 [ 4671.060241][ T44] ? trace_kmalloc+0x26/0xd0 [ 4671.060465][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690 [ 4671.060689][ T44] ? debug_objects_oom+0x160/0x160 [ 4671.060925][ T44] ? kasan_unpoison+0x27/0x50 [ 4671.061156][ T44] ? __asan_register_globals+0x5d/0x70 [ 4671.061381][ T44] do_init_module+0x27a/0x860 [ 4671.061616][ T44] ? free_module+0x2f0/0x2f0 [ 4671.061854][ T44] ? kfree+0x21d/0x540 [ 4671.062033][ T44] ? load_module+0x20c5/0x2dd0 [ 4671.062265][ T44] load_module+0x1f40/0x2dd0 [ 4671.062499][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4671.062776][ T44] ? kernel_read_file+0x3ed/0x550 [ 4671.063016][ T44] ? kernel_read_file+0x3c8/0x550 [ 4671.063249][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4671.063479][ T44] ? init_module_from_file+0xe9/0x150 [ 4671.063710][ T44] init_module_from_file+0xe9/0x150 [ 4671.063962][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4671.064209][ T44] ? idempotent_init_module+0x316/0x610 [ 4671.064432][ T44] ? __lock_release+0x5d/0x170 [ 4671.064658][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4671.064895][ T44] idempotent_init_module+0x331/0x610 [ 4671.065127][ T44] ? init_module_from_file+0x150/0x150 [ 4671.065369][ T44] ? cap_capable+0x94/0x230 [ 4671.065600][ T44] __x64_sys_finit_module+0xca/0x150 [ 4671.065823][ T44] ? do_syscall_64+0x85/0xfd0 [ 4671.066063][ T44] do_syscall_64+0xc1/0xfd0 [ 4671.066294][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4671.066571][ T44] RIP: 0033:0x7f855ecf892d [ 4671.066816][ T44] RSP: 002b:00007ffe70794088 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4671.067182][ T44] RAX: ffffffffffffffda RBX: 000055ecef050c30 RCX: 00007f855ecf892d [ 4671.067517][ T44] RDX: 0000000000000000 RSI: 000055ecbbcaca2a RDI: 0000000000000000 [ 4671.067882][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe707941c0 [ 4671.068226][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055ecbbcaca2a [ 4671.068568][ T44] R13: 000055ecef050f50 R14: 000055ecef050fa0 R15: 000055ecef050c9e [ 4671.068934][ T44] [ 4671.069114][ T44] INFO: task modprobe:21119 blocked on an rw-semaphore likely owned by task kworker/u16:0:12 [ 4671.069589][ T44] task:kworker/u16:0 state:R running task stack:24688 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 4671.070161][ T44] Workqueue: netns cleanup_net [ 4671.070391][ T44] Call Trace: [ 4671.070558][ T44] [ 4671.070673][ T44] ? __mutex_lock+0x19f/0x1190 [ 4671.070913][ T44] ? trace_sched_exit_tp+0xcd/0x130 [ 4671.071149][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 4671.071443][ T44] ? ww_mutex_lock+0x160/0x160 [ 4671.071693][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 4671.072010][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 4671.072304][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack] [ 4671.072648][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack] [ 4671.073003][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack] [ 4671.073362][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 4671.073662][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 4671.073961][ T44] ? _raw_spin_unlock+0x2d/0x50 [ 4671.074198][ T44] ? ops_undo_list+0x2bf/0x890 [ 4671.074431][ T44] ? rtnl_net_dumpid_one+0x270/0x270 [ 4671.074650][ T44] ? cleanup_net+0x2d6/0x8b0 [ 4671.074896][ T44] ? cleanup_net+0x3b2/0x8b0 [ 4671.075134][ T44] ? net_passive_dec+0x190/0x190 [ 4671.075360][ T44] ? rcu_is_watching+0x12/0xb0 [ 4671.075583][ T44] ? process_one_work+0xe35/0x1650 [ 4671.075820][ T44] ? pwq_dec_nr_in_flight+0x550/0x550 [ 4671.076084][ T44] ? assign_work+0x168/0x240 [ 4671.076316][ T44] ? worker_thread+0x591/0xcf0 [ 4671.076546][ T44] ? rescuer_thread+0xd10/0xd10 [ 4671.076809][ T44] ? kthread+0x37b/0x5f0 [ 4671.076995][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4671.077226][ T44] ? ret_from_fork+0x1b/0x270 [ 4671.077451][ T44] ? __lock_release+0x5d/0x170 [ 4671.077675][ T44] ? rcu_is_watching+0x12/0xb0 [ 4671.077911][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4671.078143][ T44] ? ret_from_fork+0x1db/0x270 [ 4671.078363][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4671.078586][ T44] ? ret_from_fork_asm+0x11/0x20 [ 4671.078830][ T44] [ 4671.079032][ T44] [ 4671.079032][ T44] Showing all locks held in the system: [ 4671.079352][ T44] 4 locks held by kworker/u16:0/12: [ 4671.079578][ T44] 1 lock held by khungtaskd/44: [ 4671.079791][ T44] #0: ffffffffac1881c0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4671.080573][ T44] 2 locks held by kworker/u19:0/408: [ 4671.080796][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1650 [ 4671.081248][ T44] #1: ffffc900008bfd30 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xded/0x1650 [ 4671.081744][ T44] 1 lock held by modprobe/21119: [ 4671.081966][ T44] #0: ffffffffac87ff50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4671.082415][ T44] [ 4671.082523][ T44] ============================================= [ 4671.082523][ T44] [ 4793.932940][ T44] INFO: task modprobe:21119 blocked for more than 491 seconds. [ 4793.933430][ T44] Not tainted 6.18.0-rc3-virtme #1 [ 4793.933642][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4793.934051][ T44] task:modprobe state:D stack:25664 pid:21119 tgid:21119 ppid:408 task_flags:0x400100 flags:0x00080001 [ 4793.934550][ T44] Call Trace: [ 4793.934727][ T44] [ 4793.934866][ T44] __schedule+0x880/0x1b10 [ 4793.935107][ T44] ? io_schedule_timeout+0x150/0x150 [ 4793.935345][ T44] ? schedule+0x1ee/0x270 [ 4793.935514][ T44] ? __lock_release+0x5d/0x170 [ 4793.935757][ T44] schedule+0xe2/0x270 [ 4793.935971][ T44] schedule_preempt_disabled+0x18/0x30 [ 4793.936202][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4793.936428][ T44] ? __lock_acquire+0x449/0x7e0 [ 4793.936651][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4793.936896][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.937122][ T44] ? lock_acquire+0x104/0x160 [ 4793.937353][ T44] ? register_pernet_subsys+0x1a/0x40 [ 4793.937587][ T44] down_write+0x1d6/0x200 [ 4793.937757][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4793.938043][ T44] ? find_held_lock+0x2b/0x80 [ 4793.938271][ T44] ? __create_object+0x5e/0xb0 [ 4793.938495][ T44] ? __lock_release+0x5d/0x170 [ 4793.938721][ T44] ? _sub_I_65535_1+0x230/0x230 [vxlan] [ 4793.938970][ T44] register_pernet_subsys+0x1a/0x40 [ 4793.939205][ T44] vxlan_init_module+0x17/0x1000 [vxlan] [ 4793.939439][ T44] do_one_initcall+0x8c/0x1d0 [ 4793.939663][ T44] ? trace_initcall_start+0x130/0x130 [ 4793.939916][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.940141][ T44] ? trace_kmalloc+0x26/0xd0 [ 4793.940363][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690 [ 4793.940586][ T44] ? debug_objects_oom+0x160/0x160 [ 4793.940826][ T44] ? kasan_unpoison+0x27/0x50 [ 4793.941064][ T44] ? __asan_register_globals+0x5d/0x70 [ 4793.941290][ T44] do_init_module+0x27a/0x860 [ 4793.941521][ T44] ? free_module+0x2f0/0x2f0 [ 4793.941741][ T44] ? kfree+0x21d/0x540 [ 4793.941917][ T44] ? load_module+0x20c5/0x2dd0 [ 4793.942147][ T44] load_module+0x1f40/0x2dd0 [ 4793.942389][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4793.942667][ T44] ? kernel_read_file+0x3ed/0x550 [ 4793.942902][ T44] ? kernel_read_file+0x3c8/0x550 [ 4793.943128][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4793.943355][ T44] ? init_module_from_file+0xe9/0x150 [ 4793.943578][ T44] init_module_from_file+0xe9/0x150 [ 4793.943800][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4793.944065][ T44] ? idempotent_init_module+0x316/0x610 [ 4793.944289][ T44] ? __lock_release+0x5d/0x170 [ 4793.944514][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4793.944737][ T44] idempotent_init_module+0x331/0x610 [ 4793.944969][ T44] ? init_module_from_file+0x150/0x150 [ 4793.945203][ T44] ? cap_capable+0x94/0x230 [ 4793.945434][ T44] __x64_sys_finit_module+0xca/0x150 [ 4793.945663][ T44] ? do_syscall_64+0x85/0xfd0 [ 4793.945896][ T44] do_syscall_64+0xc1/0xfd0 [ 4793.946129][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4793.946406][ T44] RIP: 0033:0x7f855ecf892d [ 4793.946639][ T44] RSP: 002b:00007ffe70794088 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4793.946984][ T44] RAX: ffffffffffffffda RBX: 000055ecef050c30 RCX: 00007f855ecf892d [ 4793.947329][ T44] RDX: 0000000000000000 RSI: 000055ecbbcaca2a RDI: 0000000000000000 [ 4793.947663][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe707941c0 [ 4793.948020][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055ecbbcaca2a [ 4793.948356][ T44] R13: 000055ecef050f50 R14: 000055ecef050fa0 R15: 000055ecef050c9e [ 4793.948723][ T44] [ 4793.948905][ T44] INFO: task modprobe:21119 blocked on an rw-semaphore likely owned by task kworker/u16:0:12 [ 4793.949381][ T44] task:kworker/u16:0 state:R running task stack:24688 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 4793.949938][ T44] Workqueue: netns cleanup_net [ 4793.950167][ T44] Call Trace: [ 4793.950340][ T44] [ 4793.950461][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 4793.950689][ T44] ? __mutex_handoff+0x2b0/0x2b0 [ 4793.950920][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.951149][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.951375][ T44] ? trace_contention_end+0xd8/0x140 [ 4793.951600][ T44] ? __mutex_lock+0x19f/0x1190 [ 4793.951825][ T44] ? trace_sched_exit_tp+0xcd/0x130 [ 4793.952087][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 4793.952384][ T44] ? ww_mutex_lock+0x160/0x160 [ 4793.952627][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 4793.952920][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 4793.953208][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack] [ 4793.953563][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack] [ 4793.953913][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack] [ 4793.954256][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 4793.954548][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 4793.954834][ T44] ? _raw_spin_unlock+0x2d/0x50 [ 4793.955068][ T44] ? ops_undo_list+0x2bf/0x890 [ 4793.955305][ T44] ? rtnl_net_dumpid_one+0x270/0x270 [ 4793.955528][ T44] ? cleanup_net+0x2d6/0x8b0 [ 4793.955757][ T44] ? cleanup_net+0x3b2/0x8b0 [ 4793.956012][ T44] ? net_passive_dec+0x190/0x190 [ 4793.956240][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.956465][ T44] ? process_one_work+0xe35/0x1650 [ 4793.956701][ T44] ? pwq_dec_nr_in_flight+0x550/0x550 [ 4793.956970][ T44] ? assign_work+0x168/0x240 [ 4793.957201][ T44] ? worker_thread+0x591/0xcf0 [ 4793.957430][ T44] ? rescuer_thread+0xd10/0xd10 [ 4793.957659][ T44] ? kthread+0x37b/0x5f0 [ 4793.957833][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4793.958062][ T44] ? ret_from_fork+0x1b/0x270 [ 4793.958286][ T44] ? __lock_release+0x5d/0x170 [ 4793.958510][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.958731][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4793.958974][ T44] ? ret_from_fork+0x1db/0x270 [ 4793.959196][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4793.959418][ T44] ? ret_from_fork_asm+0x11/0x20 [ 4793.959655][ T44] [ 4793.959841][ T44] [ 4793.959841][ T44] Showing all locks held in the system: [ 4793.960524][ T44] 4 locks held by kworker/u16:0/12: [ 4793.960749][ T44] 1 lock held by khungtaskd/44: [ 4793.960976][ T44] #0: ffffffffac1881c0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4793.961368][ T44] 2 locks held by kworker/u19:0/408: [ 4793.961579][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1650 [ 4793.962017][ T44] #1: ffffc900008bfd30 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xded/0x1650 [ 4793.962516][ T44] 1 lock held by modprobe/21119: [ 4793.962727][ T44] #0: ffffffffac87ff50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4793.963186][ T44] [ 4793.963294][ T44] ============================================= [ 4793.963294][ T44] [ 4916.812928][ T44] INFO: task modprobe:21119 blocked for more than 614 seconds. [ 4916.813433][ T44] Not tainted 6.18.0-rc3-virtme #1 [ 4916.813643][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4916.814032][ T44] task:modprobe state:D stack:25664 pid:21119 tgid:21119 ppid:408 task_flags:0x400100 flags:0x00080001 [ 4916.814528][ T44] Call Trace: [ 4916.814700][ T44] [ 4916.814822][ T44] __schedule+0x880/0x1b10 [ 4916.815105][ T44] ? io_schedule_timeout+0x150/0x150 [ 4916.815392][ T44] ? schedule+0x1ee/0x270 [ 4916.815559][ T44] ? __lock_release+0x5d/0x170 [ 4916.815788][ T44] schedule+0xe2/0x270 [ 4916.815972][ T44] schedule_preempt_disabled+0x18/0x30 [ 4916.816194][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4916.816419][ T44] ? __lock_acquire+0x449/0x7e0 [ 4916.816648][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4916.816889][ T44] ? rcu_is_watching+0x12/0xb0 [ 4916.817113][ T44] ? lock_acquire+0x104/0x160 [ 4916.817332][ T44] ? register_pernet_subsys+0x1a/0x40 [ 4916.817564][ T44] down_write+0x1d6/0x200 [ 4916.817732][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4916.818016][ T44] ? find_held_lock+0x2b/0x80 [ 4916.818246][ T44] ? __create_object+0x5e/0xb0 [ 4916.818477][ T44] ? __lock_release+0x5d/0x170 [ 4916.818701][ T44] ? _sub_I_65535_1+0x230/0x230 [vxlan] [ 4916.818967][ T44] register_pernet_subsys+0x1a/0x40 [ 4916.819191][ T44] vxlan_init_module+0x17/0x1000 [vxlan] [ 4916.819418][ T44] do_one_initcall+0x8c/0x1d0 [ 4916.819646][ T44] ? trace_initcall_start+0x130/0x130 [ 4916.819874][ T44] ? rcu_is_watching+0x12/0xb0 [ 4916.820112][ T44] ? trace_kmalloc+0x26/0xd0 [ 4916.820335][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690 [ 4916.820554][ T44] ? debug_objects_oom+0x160/0x160 [ 4916.820781][ T44] ? kasan_unpoison+0x27/0x50 [ 4916.821012][ T44] ? __asan_register_globals+0x5d/0x70 [ 4916.821236][ T44] do_init_module+0x27a/0x860 [ 4916.821465][ T44] ? free_module+0x2f0/0x2f0 [ 4916.821700][ T44] ? kfree+0x21d/0x540 [ 4916.821871][ T44] ? load_module+0x20c5/0x2dd0 [ 4916.822098][ T44] load_module+0x1f40/0x2dd0 [ 4916.822329][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4916.822602][ T44] ? kernel_read_file+0x3ed/0x550 [ 4916.822827][ T44] ? kernel_read_file+0x3c8/0x550 [ 4916.823072][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4916.823299][ T44] ? init_module_from_file+0xe9/0x150 [ 4916.823527][ T44] init_module_from_file+0xe9/0x150 [ 4916.823749][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4916.823994][ T44] ? idempotent_init_module+0x316/0x610 [ 4916.824214][ T44] ? __lock_release+0x5d/0x170 [ 4916.824440][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4916.824662][ T44] idempotent_init_module+0x331/0x610 [ 4916.824901][ T44] ? init_module_from_file+0x150/0x150 [ 4916.825134][ T44] ? cap_capable+0x94/0x230 [ 4916.825370][ T44] __x64_sys_finit_module+0xca/0x150 [ 4916.825591][ T44] ? do_syscall_64+0x85/0xfd0 [ 4916.825816][ T44] do_syscall_64+0xc1/0xfd0 [ 4916.826046][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4916.826322][ T44] RIP: 0033:0x7f855ecf892d [ 4916.826560][ T44] RSP: 002b:00007ffe70794088 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4916.826922][ T44] RAX: ffffffffffffffda RBX: 000055ecef050c30 RCX: 00007f855ecf892d [ 4916.827254][ T44] RDX: 0000000000000000 RSI: 000055ecbbcaca2a RDI: 0000000000000000 [ 4916.827591][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe707941c0 [ 4916.827935][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055ecbbcaca2a [ 4916.828270][ T44] R13: 000055ecef050f50 R14: 000055ecef050fa0 R15: 000055ecef050c9e [ 4916.828618][ T44] [ 4916.828786][ T44] INFO: task modprobe:21119 blocked on an rw-semaphore likely owned by task kworker/u16:0:12 [ 4916.829263][ T44] task:kworker/u16:0 state:R running task stack:24688 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 4916.829813][ T44] Workqueue: netns cleanup_net [ 4916.830047][ T44] Call Trace: [ 4916.830213][ T44] [ 4916.830324][ T44] ? __mutex_lock+0x19f/0x1190 [ 4916.830549][ T44] ? trace_sched_exit_tp+0xcd/0x130 [ 4916.830773][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 4916.831095][ T44] ? ww_mutex_lock+0x160/0x160 [ 4916.831342][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 4916.831627][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 4916.831918][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack] [ 4916.832260][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack] [ 4916.832599][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack] [ 4916.832954][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 4916.833244][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 4916.833527][ T44] ? _raw_spin_unlock+0x2d/0x50 [ 4916.833751][ T44] ? ops_undo_list+0x2bf/0x890 [ 4916.833985][ T44] ? rtnl_net_dumpid_one+0x270/0x270 [ 4916.834204][ T44] ? cleanup_net+0x2d6/0x8b0 [ 4916.834437][ T44] ? cleanup_net+0x3b2/0x8b0 [ 4916.834658][ T44] ? net_passive_dec+0x190/0x190 [ 4916.834906][ T44] ? rcu_is_watching+0x12/0xb0 [ 4916.835132][ T44] ? process_one_work+0xe35/0x1650 [ 4916.835369][ T44] ? pwq_dec_nr_in_flight+0x550/0x550 [ 4916.835596][ T44] ? assign_work+0x168/0x240 [ 4916.835820][ T44] ? worker_thread+0x591/0xcf0 [ 4916.836056][ T44] ? rescuer_thread+0xd10/0xd10 [ 4916.836307][ T44] ? kthread+0x37b/0x5f0 [ 4916.836477][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4916.836694][ T44] ? ret_from_fork+0x1b/0x270 [ 4916.836923][ T44] ? __lock_release+0x5d/0x170 [ 4916.837145][ T44] ? rcu_is_watching+0x12/0xb0 [ 4916.837363][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4916.837584][ T44] ? ret_from_fork+0x1db/0x270 [ 4916.837800][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 4916.838044][ T44] ? ret_from_fork_asm+0x11/0x20 [ 4916.838280][ T44] [ 4916.838464][ T44] [ 4916.838464][ T44] Showing all locks held in the system: [ 4916.838782][ T44] 4 locks held by kworker/u16:0/12: [ 4916.839296][ T44] 1 lock held by khungtaskd/44: [ 4916.839510][ T44] #0: ffffffffac1881c0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4916.839921][ T44] 2 locks held by kworker/u19:0/408: [ 4916.840132][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1650 [ 4916.840558][ T44] #1: ffffc900008bfd30 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xded/0x1650 [ 4916.841057][ T44] 1 lock held by modprobe/21119: [ 4916.841267][ T44] #0: ffffffffac87ff50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4916.841699][ T44] [ 4916.841805][ T44] ============================================= [ 4916.841805][ T44] [ 5039.692939][ T44] INFO: task modprobe:21119 blocked for more than 737 seconds. [ 5039.693496][ T44] Not tainted 6.18.0-rc3-virtme #1 [ 5039.693883][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5039.694499][ T44] task:modprobe state:D stack:25664 pid:21119 tgid:21119 ppid:408 task_flags:0x400100 flags:0x00080001 [ 5039.695343][ T44] Call Trace: [ 5039.695625][ T44] [ 5039.695823][ T44] __schedule+0x880/0x1b10 [ 5039.696237][ T44] ? io_schedule_timeout+0x150/0x150 [ 5039.696627][ T44] ? schedule+0x1ee/0x270 [ 5039.696929][ T44] ? __lock_release+0x5d/0x170 [ 5039.697309][ T44] schedule+0xe2/0x270 [ 5039.697586][ T44] schedule_preempt_disabled+0x18/0x30 [ 5039.697963][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 5039.698333][ T44] ? __lock_acquire+0x449/0x7e0 [ 5039.698696][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 5039.699125][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.699493][ T44] ? lock_acquire+0x104/0x160 [ 5039.699879][ T44] ? register_pernet_subsys+0x1a/0x40 [ 5039.700265][ T44] down_write+0x1d6/0x200 [ 5039.700542][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 5039.701007][ T44] ? find_held_lock+0x2b/0x80 [ 5039.701378][ T44] ? __create_object+0x5e/0xb0 [ 5039.701741][ T44] ? __lock_release+0x5d/0x170 [ 5039.702121][ T44] ? _sub_I_65535_1+0x230/0x230 [vxlan] [ 5039.702521][ T44] register_pernet_subsys+0x1a/0x40 [ 5039.702922][ T44] vxlan_init_module+0x17/0x1000 [vxlan] [ 5039.703309][ T44] do_one_initcall+0x8c/0x1d0 [ 5039.703675][ T44] ? trace_initcall_start+0x130/0x130 [ 5039.704055][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.704422][ T44] ? trace_kmalloc+0x26/0xd0 [ 5039.704792][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690 [ 5039.705177][ T44] ? debug_objects_oom+0x160/0x160 [ 5039.705548][ T44] ? kasan_unpoison+0x27/0x50 [ 5039.705933][ T44] ? __asan_register_globals+0x5d/0x70 [ 5039.706305][ T44] do_init_module+0x27a/0x860 [ 5039.706681][ T44] ? free_module+0x2f0/0x2f0 [ 5039.707087][ T44] ? kfree+0x21d/0x540 [ 5039.707365][ T44] ? load_module+0x20c5/0x2dd0 [ 5039.707741][ T44] load_module+0x1f40/0x2dd0 [ 5039.708153][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 5039.708605][ T44] ? kernel_read_file+0x3ed/0x550 [ 5039.708990][ T44] ? kernel_read_file+0x3c8/0x550 [ 5039.709367][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 5039.709743][ T44] ? init_module_from_file+0xe9/0x150 [ 5039.710120][ T44] init_module_from_file+0xe9/0x150 [ 5039.710483][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 5039.710927][ T44] ? idempotent_init_module+0x316/0x610 [ 5039.711290][ T44] ? __lock_release+0x5d/0x170 [ 5039.711664][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 5039.712045][ T44] idempotent_init_module+0x331/0x610 [ 5039.712416][ T44] ? init_module_from_file+0x150/0x150 [ 5039.712802][ T44] ? cap_capable+0x94/0x230 [ 5039.713204][ T44] __x64_sys_finit_module+0xca/0x150 [ 5039.713567][ T44] ? do_syscall_64+0x85/0xfd0 [ 5039.713949][ T44] do_syscall_64+0xc1/0xfd0 [ 5039.714316][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5039.714775][ T44] RIP: 0033:0x7f855ecf892d [ 5039.715196][ T44] RSP: 002b:00007ffe70794088 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 5039.715753][ T44] RAX: ffffffffffffffda RBX: 000055ecef050c30 RCX: 00007f855ecf892d [ 5039.716341][ T44] RDX: 0000000000000000 RSI: 000055ecbbcaca2a RDI: 0000000000000000 [ 5039.716898][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe707941c0 [ 5039.717447][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055ecbbcaca2a [ 5039.718001][ T44] R13: 000055ecef050f50 R14: 000055ecef050fa0 R15: 000055ecef050c9e [ 5039.718589][ T44] [ 5039.718901][ T44] INFO: task modprobe:21119 blocked on an rw-semaphore likely owned by task kworker/u16:0:12 [ 5039.719672][ T44] task:kworker/u16:0 state:R running task stack:24688 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 5039.720579][ T44] Workqueue: netns cleanup_net [ 5039.720974][ T44] Call Trace: [ 5039.721248][ T44] [ 5039.721446][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 5039.721816][ T44] ? __mutex_handoff+0x2b0/0x2b0 [ 5039.722195][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.722574][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.722974][ T44] ? trace_contention_end+0xd8/0x140 [ 5039.723340][ T44] ? __mutex_lock+0x19f/0x1190 [ 5039.723720][ T44] ? trace_sched_exit_tp+0xcd/0x130 [ 5039.724104][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5039.724600][ T44] ? ww_mutex_lock+0x160/0x160 [ 5039.725008][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5039.725482][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5039.725962][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack] [ 5039.726541][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack] [ 5039.727139][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack] [ 5039.727707][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 5039.728199][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 5039.728667][ T44] ? _raw_spin_unlock+0x2d/0x50 [ 5039.729062][ T44] ? ops_undo_list+0x2bf/0x890 [ 5039.729439][ T44] ? rtnl_net_dumpid_one+0x270/0x270 [ 5039.729803][ T44] ? cleanup_net+0x2d6/0x8b0 [ 5039.730196][ T44] ? cleanup_net+0x3b2/0x8b0 [ 5039.730564][ T44] ? net_passive_dec+0x190/0x190 [ 5039.730977][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.731354][ T44] ? process_one_work+0xe35/0x1650 [ 5039.731741][ T44] ? pwq_dec_nr_in_flight+0x550/0x550 [ 5039.732177][ T44] ? assign_work+0x168/0x240 [ 5039.732550][ T44] ? worker_thread+0x591/0xcf0 [ 5039.732957][ T44] ? rescuer_thread+0xd10/0xd10 [ 5039.733328][ T44] ? kthread+0x37b/0x5f0 [ 5039.733613][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5039.733987][ T44] ? ret_from_fork+0x1b/0x270 [ 5039.734353][ T44] ? __lock_release+0x5d/0x170 [ 5039.734726][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.735137][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5039.735506][ T44] ? ret_from_fork+0x1db/0x270 [ 5039.735877][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5039.736245][ T44] ? ret_from_fork_asm+0x11/0x20 [ 5039.736637][ T44] [ 5039.736952][ T44] [ 5039.736952][ T44] Showing all locks held in the system: [ 5039.737463][ T44] 4 locks held by kworker/u16:0/12: [ 5039.737821][ T44] 1 lock held by khungtaskd/44: [ 5039.738474][ T44] #0: ffffffffac1881c0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 5039.739041][ T44] 2 locks held by kworker/u19:0/408: [ 5039.739385][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1650 [ 5039.740095][ T44] #1: ffffc900008bfd30 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xded/0x1650 [ 5039.740949][ T44] 1 lock held by modprobe/21119: [ 5039.741296][ T44] #0: ffffffffac87ff50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 5039.743619][ T44] [ 5039.743756][ T44] ============================================= [ 5039.743756][ T44] [ 5162.573085][ T44] INFO: task modprobe:21119 blocked for more than 860 seconds. [ 5162.573705][ T44] Not tainted 6.18.0-rc3-virtme #1 [ 5162.573958][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5162.574335][ T44] task:modprobe state:D stack:25664 pid:21119 tgid:21119 ppid:408 task_flags:0x400100 flags:0x00080001 [ 5162.574869][ T44] Call Trace: [ 5162.575039][ T44] [ 5162.575167][ T44] __schedule+0x880/0x1b10 [ 5162.575415][ T44] ? io_schedule_timeout+0x150/0x150 [ 5162.575656][ T44] ? schedule+0x1ee/0x270 [ 5162.575817][ T44] ? __lock_release+0x5d/0x170 [ 5162.576103][ T44] schedule+0xe2/0x270 [ 5162.576276][ T44] schedule_preempt_disabled+0x18/0x30 [ 5162.576496][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 5162.576727][ T44] ? __lock_acquire+0x449/0x7e0 [ 5162.576966][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 5162.577220][ T44] ? rcu_is_watching+0x12/0xb0 [ 5162.577448][ T44] ? lock_acquire+0x104/0x160 [ 5162.577669][ T44] ? register_pernet_subsys+0x1a/0x40 [ 5162.577920][ T44] down_write+0x1d6/0x200 [ 5162.578093][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 5162.578387][ T44] ? find_held_lock+0x2b/0x80 [ 5162.578624][ T44] ? __create_object+0x5e/0xb0 [ 5162.578866][ T44] ? __lock_release+0x5d/0x170 [ 5162.579092][ T44] ? _sub_I_65535_1+0x230/0x230 [vxlan] [ 5162.579349][ T44] register_pernet_subsys+0x1a/0x40 [ 5162.579573][ T44] vxlan_init_module+0x17/0x1000 [vxlan] [ 5162.579802][ T44] do_one_initcall+0x8c/0x1d0 [ 5162.580061][ T44] ? trace_initcall_start+0x130/0x130 [ 5162.580319][ T44] ? rcu_is_watching+0x12/0xb0 [ 5162.580541][ T44] ? trace_kmalloc+0x26/0xd0 [ 5162.580763][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690 [ 5162.580992][ T44] ? debug_objects_oom+0x160/0x160 [ 5162.581227][ T44] ? kasan_unpoison+0x27/0x50 [ 5162.581452][ T44] ? __asan_register_globals+0x5d/0x70 [ 5162.581705][ T44] do_init_module+0x27a/0x860 [ 5162.581943][ T44] ? free_module+0x2f0/0x2f0 [ 5162.582179][ T44] ? kfree+0x21d/0x540 [ 5162.582346][ T44] ? load_module+0x20c5/0x2dd0 [ 5162.582570][ T44] load_module+0x1f40/0x2dd0 [ 5162.582800][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 5162.583083][ T44] ? kernel_read_file+0x3ed/0x550 [ 5162.583310][ T44] ? kernel_read_file+0x3c8/0x550 [ 5162.583532][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 5162.583762][ T44] ? init_module_from_file+0xe9/0x150 [ 5162.584016][ T44] init_module_from_file+0xe9/0x150 [ 5162.584244][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 5162.584481][ T44] ? idempotent_init_module+0x316/0x610 [ 5162.584701][ T44] ? __lock_release+0x5d/0x170 [ 5162.584945][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 5162.585177][ T44] idempotent_init_module+0x331/0x610 [ 5162.585409][ T44] ? init_module_from_file+0x150/0x150 [ 5162.585642][ T44] ? cap_capable+0x94/0x230 [ 5162.585879][ T44] __x64_sys_finit_module+0xca/0x150 [ 5162.586102][ T44] ? do_syscall_64+0x85/0xfd0 [ 5162.586330][ T44] do_syscall_64+0xc1/0xfd0 [ 5162.586554][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5162.586829][ T44] RIP: 0033:0x7f855ecf892d [ 5162.587082][ T44] RSP: 002b:00007ffe70794088 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 5162.587419][ T44] RAX: ffffffffffffffda RBX: 000055ecef050c30 RCX: 00007f855ecf892d [ 5162.587753][ T44] RDX: 0000000000000000 RSI: 000055ecbbcaca2a RDI: 0000000000000000 [ 5162.588115][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe707941c0 [ 5162.588456][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055ecbbcaca2a [ 5162.588786][ T44] R13: 000055ecef050f50 R14: 000055ecef050fa0 R15: 000055ecef050c9e [ 5162.589155][ T44] [ 5162.589328][ T44] INFO: task modprobe:21119 blocked on an rw-semaphore likely owned by task kworker/u16:0:12 [ 5162.589797][ T44] task:kworker/u16:0 state:R running task stack:24688 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 5162.590371][ T44] Workqueue: netns cleanup_net [ 5162.590602][ T44] Call Trace: [ 5162.590770][ T44] [ 5162.590898][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 5162.591131][ T44] ? __mutex_handoff+0x2b0/0x2b0 [ 5162.591354][ T44] ? rcu_is_watching+0x12/0xb0 [ 5162.591579][ T44] ? rcu_is_watching+0x12/0xb0 [ 5162.591811][ T44] ? trace_contention_end+0xd8/0x140 [ 5162.592057][ T44] ? __mutex_lock+0x19f/0x1190 [ 5162.592290][ T44] ? trace_sched_exit_tp+0xcd/0x130 [ 5162.592514][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5162.592806][ T44] ? ww_mutex_lock+0x160/0x160 [ 5162.593052][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5162.593351][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5162.593633][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack] [ 5162.594010][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack] [ 5162.594358][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack] [ 5162.594697][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 5162.595003][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 5162.595294][ T44] ? _raw_spin_unlock+0x2d/0x50 [ 5162.595521][ T44] ? ops_undo_list+0x2bf/0x890 [ 5162.595748][ T44] ? rtnl_net_dumpid_one+0x270/0x270 [ 5162.595990][ T44] ? cleanup_net+0x2d6/0x8b0 [ 5162.596226][ T44] ? cleanup_net+0x3b2/0x8b0 [ 5162.596451][ T44] ? net_passive_dec+0x190/0x190 [ 5162.596707][ T44] ? rcu_is_watching+0x12/0xb0 [ 5162.596942][ T44] ? process_one_work+0xe35/0x1650 [ 5162.597182][ T44] ? pwq_dec_nr_in_flight+0x550/0x550 [ 5162.597408][ T44] ? assign_work+0x168/0x240 [ 5162.597638][ T44] ? worker_thread+0x591/0xcf0 [ 5162.597875][ T44] ? rescuer_thread+0xd10/0xd10 [ 5162.598101][ T44] ? kthread+0x37b/0x5f0 [ 5162.598271][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5162.598498][ T44] ? ret_from_fork+0x1b/0x270 [ 5162.598718][ T44] ? __lock_release+0x5d/0x170 [ 5162.598948][ T44] ? rcu_is_watching+0x12/0xb0 [ 5162.599177][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5162.599398][ T44] ? ret_from_fork+0x1db/0x270 [ 5162.599616][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5162.599833][ T44] ? ret_from_fork_asm+0x11/0x20 [ 5162.600098][ T44] [ 5162.600286][ T44] [ 5162.600286][ T44] Showing all locks held in the system: [ 5162.600609][ T44] 4 locks held by kworker/u16:0/12: [ 5162.600832][ T44] 1 lock held by khungtaskd/44: [ 5162.601415][ T44] #0: ffffffffac1881c0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 5162.601806][ T44] 2 locks held by kworker/u19:0/408: [ 5162.602023][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1650 [ 5162.602456][ T44] #1: ffffc900008bfd30 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xded/0x1650 [ 5162.602955][ T44] 1 lock held by modprobe/21119: [ 5162.603176][ T44] #0: ffffffffac87ff50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 5162.603601][ T44] [ 5162.603713][ T44] ============================================= [ 5162.603713][ T44] [ 5285.453109][ T44] INFO: task modprobe:21119 blocked for more than 983 seconds. [ 5285.453725][ T44] Not tainted 6.18.0-rc3-virtme #1 [ 5285.453964][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5285.454328][ T44] task:modprobe state:D stack:25664 pid:21119 tgid:21119 ppid:408 task_flags:0x400100 flags:0x00080001 [ 5285.454863][ T44] Call Trace: [ 5285.455036][ T44] [ 5285.455158][ T44] __schedule+0x880/0x1b10 [ 5285.455413][ T44] ? io_schedule_timeout+0x150/0x150 [ 5285.455649][ T44] ? schedule+0x1ee/0x270 [ 5285.455816][ T44] ? __lock_release+0x5d/0x170 [ 5285.456076][ T44] schedule+0xe2/0x270 [ 5285.456246][ T44] schedule_preempt_disabled+0x18/0x30 [ 5285.456467][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 5285.456701][ T44] ? __lock_acquire+0x449/0x7e0 [ 5285.456960][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 5285.457194][ T44] ? rcu_is_watching+0x12/0xb0 [ 5285.457417][ T44] ? lock_acquire+0x104/0x160 [ 5285.457637][ T44] ? register_pernet_subsys+0x1a/0x40 [ 5285.457875][ T44] down_write+0x1d6/0x200 [ 5285.458046][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 5285.458323][ T44] ? find_held_lock+0x2b/0x80 [ 5285.458557][ T44] ? __create_object+0x5e/0xb0 [ 5285.458781][ T44] ? __lock_release+0x5d/0x170 [ 5285.459014][ T44] ? _sub_I_65535_1+0x230/0x230 [vxlan] [ 5285.459251][ T44] register_pernet_subsys+0x1a/0x40 [ 5285.459471][ T44] vxlan_init_module+0x17/0x1000 [vxlan] [ 5285.459700][ T44] do_one_initcall+0x8c/0x1d0 [ 5285.459953][ T44] ? trace_initcall_start+0x130/0x130 [ 5285.460186][ T44] ? rcu_is_watching+0x12/0xb0 [ 5285.460406][ T44] ? trace_kmalloc+0x26/0xd0 [ 5285.460627][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690 [ 5285.460856][ T44] ? debug_objects_oom+0x160/0x160 [ 5285.461083][ T44] ? kasan_unpoison+0x27/0x50 [ 5285.461308][ T44] ? __asan_register_globals+0x5d/0x70 [ 5285.461529][ T44] do_init_module+0x27a/0x860 [ 5285.461759][ T44] ? free_module+0x2f0/0x2f0 [ 5285.461995][ T44] ? kfree+0x21d/0x540 [ 5285.462162][ T44] ? load_module+0x20c5/0x2dd0 [ 5285.462388][ T44] load_module+0x1f40/0x2dd0 [ 5285.462623][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 5285.462909][ T44] ? kernel_read_file+0x3ed/0x550 [ 5285.463146][ T44] ? kernel_read_file+0x3c8/0x550 [ 5285.463370][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 5285.463602][ T44] ? init_module_from_file+0xe9/0x150 [ 5285.463821][ T44] init_module_from_file+0xe9/0x150 [ 5285.464072][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 5285.464310][ T44] ? idempotent_init_module+0x316/0x610 [ 5285.464530][ T44] ? __lock_release+0x5d/0x170 [ 5285.464752][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 5285.464983][ T44] idempotent_init_module+0x331/0x610 [ 5285.465216][ T44] ? init_module_from_file+0x150/0x150 [ 5285.465447][ T44] ? cap_capable+0x94/0x230 [ 5285.465676][ T44] __x64_sys_finit_module+0xca/0x150 [ 5285.465903][ T44] ? do_syscall_64+0x85/0xfd0 [ 5285.466127][ T44] do_syscall_64+0xc1/0xfd0 [ 5285.466349][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5285.466622][ T44] RIP: 0033:0x7f855ecf892d [ 5285.466867][ T44] RSP: 002b:00007ffe70794088 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 5285.467204][ T44] RAX: ffffffffffffffda RBX: 000055ecef050c30 RCX: 00007f855ecf892d [ 5285.467533][ T44] RDX: 0000000000000000 RSI: 000055ecbbcaca2a RDI: 0000000000000000 [ 5285.467882][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe707941c0 [ 5285.468224][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055ecbbcaca2a [ 5285.468556][ T44] R13: 000055ecef050f50 R14: 000055ecef050fa0 R15: 000055ecef050c9e [ 5285.468912][ T44] [ 5285.469082][ T44] INFO: task modprobe:21119 blocked on an rw-semaphore likely owned by task kworker/u16:0:12 [ 5285.469551][ T44] task:kworker/u16:0 state:R running task stack:24688 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 5285.470112][ T44] Workqueue: netns cleanup_net [ 5285.470341][ T44] Call Trace: [ 5285.470508][ T44] [ 5285.470620][ T44] ? rcu_read_lock_sched_held+0x43/0x80 [ 5285.470870][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 5285.471097][ T44] ? __mutex_handoff+0x2b0/0x2b0 [ 5285.471335][ T44] ? rcu_is_watching+0x12/0xb0 [ 5285.471560][ T44] ? rcu_is_watching+0x12/0xb0 [ 5285.471781][ T44] ? trace_contention_end+0xd8/0x140 [ 5285.472025][ T44] ? __mutex_lock+0x19f/0x1190 [ 5285.472249][ T44] ? trace_sched_exit_tp+0xcd/0x130 [ 5285.472473][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5285.472762][ T44] ? ww_mutex_lock+0x160/0x160 [ 5285.473018][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5285.473312][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5285.473593][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack] [ 5285.473946][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack] [ 5285.474285][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack] [ 5285.474631][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 5285.474930][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 5285.475216][ T44] ? _raw_spin_unlock+0x2d/0x50 [ 5285.475448][ T44] ? ops_undo_list+0x2bf/0x890 [ 5285.475674][ T44] ? rtnl_net_dumpid_one+0x270/0x270 [ 5285.475917][ T44] ? cleanup_net+0x2d6/0x8b0 [ 5285.476148][ T44] ? cleanup_net+0x3b2/0x8b0 [ 5285.476376][ T44] ? net_passive_dec+0x190/0x190 [ 5285.476601][ T44] ? rcu_is_watching+0x12/0xb0 [ 5285.476865][ T44] ? process_one_work+0xe35/0x1650 [ 5285.477105][ T44] ? pwq_dec_nr_in_flight+0x550/0x550 [ 5285.477334][ T44] ? assign_work+0x168/0x240 [ 5285.477561][ T44] ? worker_thread+0x591/0xcf0 [ 5285.477790][ T44] ? rescuer_thread+0xd10/0xd10 [ 5285.478020][ T44] ? kthread+0x37b/0x5f0 [ 5285.478197][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5285.478414][ T44] ? ret_from_fork+0x1b/0x270 [ 5285.478632][ T44] ? __lock_release+0x5d/0x170 [ 5285.478859][ T44] ? rcu_is_watching+0x12/0xb0 [ 5285.479078][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5285.479298][ T44] ? ret_from_fork+0x1db/0x270 [ 5285.479518][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5285.479738][ T44] ? ret_from_fork_asm+0x11/0x20 [ 5285.479999][ T44] [ 5285.480184][ T44] [ 5285.480184][ T44] Showing all locks held in the system: [ 5285.480496][ T44] 4 locks held by kworker/u16:0/12: [ 5285.480721][ T44] 1 lock held by khungtaskd/44: [ 5285.481300][ T44] #0: ffffffffac1881c0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 5285.481688][ T44] 2 locks held by kworker/u19:0/408: [ 5285.481910][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1650 [ 5285.482332][ T44] #1: ffffc900008bfd30 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xded/0x1650 [ 5285.482819][ T44] 1 lock held by modprobe/21119: [ 5285.483036][ T44] #0: ffffffffac87ff50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 5285.483479][ T44] [ 5285.483585][ T44] ============================================= [ 5285.483585][ T44] [ 5408.332925][ T44] INFO: task modprobe:21119 blocked for more than 1105 seconds. [ 5408.333452][ T44] Not tainted 6.18.0-rc3-virtme #1 [ 5408.333753][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5408.334244][ T44] task:modprobe state:D stack:25664 pid:21119 tgid:21119 ppid:408 task_flags:0x400100 flags:0x00080001 [ 5408.334815][ T44] Call Trace: [ 5408.335072][ T44] [ 5408.335237][ T44] __schedule+0x880/0x1b10 [ 5408.335496][ T44] ? io_schedule_timeout+0x150/0x150 [ 5408.335754][ T44] ? schedule+0x1ee/0x270 [ 5408.335948][ T44] ? __lock_release+0x5d/0x170 [ 5408.336202][ T44] schedule+0xe2/0x270 [ 5408.336383][ T44] schedule_preempt_disabled+0x18/0x30 [ 5408.336656][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 5408.336967][ T44] ? __lock_acquire+0x449/0x7e0 [ 5408.337264][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 5408.337578][ T44] ? rcu_is_watching+0x12/0xb0 [ 5408.337862][ T44] ? lock_acquire+0x104/0x160 [ 5408.338159][ T44] ? register_pernet_subsys+0x1a/0x40 [ 5408.338467][ T44] down_write+0x1d6/0x200 [ 5408.338682][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 5408.339082][ T44] ? find_held_lock+0x2b/0x80 [ 5408.339347][ T44] ? __create_object+0x5e/0xb0 [ 5408.339628][ T44] ? __lock_release+0x5d/0x170 [ 5408.339942][ T44] ? _sub_I_65535_1+0x230/0x230 [vxlan] [ 5408.340259][ T44] register_pernet_subsys+0x1a/0x40 [ 5408.340517][ T44] vxlan_init_module+0x17/0x1000 [vxlan] [ 5408.340832][ T44] do_one_initcall+0x8c/0x1d0 [ 5408.341150][ T44] ? trace_initcall_start+0x130/0x130 [ 5408.341400][ T44] ? rcu_is_watching+0x12/0xb0 [ 5408.341698][ T44] ? trace_kmalloc+0x26/0xd0 [ 5408.342026][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690 [ 5408.342321][ T44] ? debug_objects_oom+0x160/0x160 [ 5408.342580][ T44] ? kasan_unpoison+0x27/0x50 [ 5408.342827][ T44] ? __asan_register_globals+0x5d/0x70 [ 5408.343135][ T44] do_init_module+0x27a/0x860 [ 5408.343447][ T44] ? free_module+0x2f0/0x2f0 [ 5408.343743][ T44] ? kfree+0x21d/0x540 [ 5408.343986][ T44] ? load_module+0x20c5/0x2dd0 [ 5408.344287][ T44] load_module+0x1f40/0x2dd0 [ 5408.344550][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 5408.344950][ T44] ? kernel_read_file+0x3ed/0x550 [ 5408.345252][ T44] ? kernel_read_file+0x3c8/0x550 [ 5408.345555][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 5408.345878][ T44] ? init_module_from_file+0xe9/0x150 [ 5408.346178][ T44] init_module_from_file+0xe9/0x150 [ 5408.346477][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 5408.346752][ T44] ? idempotent_init_module+0x316/0x610 [ 5408.347020][ T44] ? __lock_release+0x5d/0x170 [ 5408.347322][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 5408.347622][ T44] idempotent_init_module+0x331/0x610 [ 5408.347942][ T44] ? init_module_from_file+0x150/0x150 [ 5408.348229][ T44] ? cap_capable+0x94/0x230 [ 5408.348508][ T44] __x64_sys_finit_module+0xca/0x150 [ 5408.348811][ T44] ? do_syscall_64+0x85/0xfd0 [ 5408.349126][ T44] do_syscall_64+0xc1/0xfd0 [ 5408.349426][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5408.349730][ T44] RIP: 0033:0x7f855ecf892d [ 5408.349997][ T44] RSP: 002b:00007ffe70794088 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 5408.350448][ T44] RAX: ffffffffffffffda RBX: 000055ecef050c30 RCX: 00007f855ecf892d [ 5408.350935][ T44] RDX: 0000000000000000 RSI: 000055ecbbcaca2a RDI: 0000000000000000 [ 5408.351378][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe707941c0 [ 5408.351727][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055ecbbcaca2a [ 5408.352178][ T44] R13: 000055ecef050f50 R14: 000055ecef050fa0 R15: 000055ecef050c9e [ 5408.352611][ T44] [ 5408.352789][ T44] INFO: task modprobe:21119 blocked on an rw-semaphore likely owned by task kworker/u16:0:12 [ 5408.353306][ T44] task:kworker/u16:0 state:R running task stack:24688 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 5408.354023][ T44] Workqueue: netns cleanup_net [ 5408.354262][ T44] Call Trace: [ 5408.354476][ T44] [ 5408.354634][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 5408.354966][ T44] ? __mutex_handoff+0x2b0/0x2b0 [ 5408.355278][ T44] ? rcu_is_watching+0x12/0xb0 [ 5408.355546][ T44] ? rcu_is_watching+0x12/0xb0 [ 5408.355777][ T44] ? trace_contention_end+0xd8/0x140 [ 5408.356026][ T44] ? __mutex_lock+0x19f/0x1190 [ 5408.356265][ T44] ? trace_sched_exit_tp+0xcd/0x130 [ 5408.356582][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5408.356979][ T44] ? ww_mutex_lock+0x160/0x160 [ 5408.357263][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5408.357563][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5408.357963][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack] [ 5408.358364][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack] [ 5408.358744][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack] [ 5408.359246][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 5408.359636][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 5408.360023][ T44] ? _raw_spin_unlock+0x2d/0x50 [ 5408.360285][ T44] ? ops_undo_list+0x2bf/0x890 [ 5408.360573][ T44] ? rtnl_net_dumpid_one+0x270/0x270 [ 5408.360879][ T44] ? cleanup_net+0x2d6/0x8b0 [ 5408.361195][ T44] ? cleanup_net+0x3b2/0x8b0 [ 5408.361438][ T44] ? net_passive_dec+0x190/0x190 [ 5408.361674][ T44] ? rcu_is_watching+0x12/0xb0 [ 5408.361920][ T44] ? process_one_work+0xe35/0x1650 [ 5408.362227][ T44] ? pwq_dec_nr_in_flight+0x550/0x550 [ 5408.362541][ T44] ? assign_work+0x168/0x240 [ 5408.362786][ T44] ? worker_thread+0x591/0xcf0 [ 5408.363068][ T44] ? rescuer_thread+0xd10/0xd10 [ 5408.363380][ T44] ? kthread+0x37b/0x5f0 [ 5408.363608][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5408.363914][ T44] ? ret_from_fork+0x1b/0x270 [ 5408.364227][ T44] ? __lock_release+0x5d/0x170 [ 5408.364480][ T44] ? rcu_is_watching+0x12/0xb0 [ 5408.364714][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5408.365015][ T44] ? ret_from_fork+0x1db/0x270 [ 5408.365322][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5408.365620][ T44] ? ret_from_fork_asm+0x11/0x20 [ 5408.365952][ T44] [ 5408.366205][ T44] [ 5408.366205][ T44] Showing all locks held in the system: [ 5408.366639][ T44] 4 locks held by kworker/u16:0/12: [ 5408.367176][ T44] 1 lock held by khungtaskd/44: [ 5408.367476][ T44] #0: ffffffffac1881c0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 5408.367920][ T44] 2 locks held by kworker/u19:0/408: [ 5408.368209][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1650 [ 5408.368723][ T44] #1: ffffc900008bfd30 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xded/0x1650 [ 5408.369302][ T44] 1 lock held by modprobe/21119: [ 5408.369593][ T44] #0: ffffffffac87ff50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 5408.370192][ T44] [ 5408.370320][ T44] ============================================= [ 5408.370320][ T44] [ 5531.212905][ T44] INFO: task modprobe:21119 blocked for more than 1228 seconds. [ 5531.213496][ T44] Not tainted 6.18.0-rc3-virtme #1 [ 5531.213729][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5531.214156][ T44] task:modprobe state:D stack:25664 pid:21119 tgid:21119 ppid:408 task_flags:0x400100 flags:0x00080001 [ 5531.214753][ T44] Call Trace: [ 5531.215008][ T44] [ 5531.215178][ T44] __schedule+0x880/0x1b10 [ 5531.215489][ T44] ? io_schedule_timeout+0x150/0x150 [ 5531.215812][ T44] ? schedule+0x1ee/0x270 [ 5531.216050][ T44] ? __lock_release+0x5d/0x170 [ 5531.216361][ T44] schedule+0xe2/0x270 [ 5531.216566][ T44] schedule_preempt_disabled+0x18/0x30 [ 5531.216857][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 5531.217167][ T44] ? __lock_acquire+0x449/0x7e0 [ 5531.217442][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 5531.217698][ T44] ? rcu_is_watching+0x12/0xb0 [ 5531.217973][ T44] ? lock_acquire+0x104/0x160 [ 5531.218264][ T44] ? register_pernet_subsys+0x1a/0x40 [ 5531.218507][ T44] down_write+0x1d6/0x200 [ 5531.218715][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 5531.219113][ T44] ? find_held_lock+0x2b/0x80 [ 5531.219425][ T44] ? __create_object+0x5e/0xb0 [ 5531.219692][ T44] ? __lock_release+0x5d/0x170 [ 5531.219944][ T44] ? _sub_I_65535_1+0x230/0x230 [vxlan] [ 5531.220224][ T44] register_pernet_subsys+0x1a/0x40 [ 5531.220463][ T44] vxlan_init_module+0x17/0x1000 [vxlan] [ 5531.220749][ T44] do_one_initcall+0x8c/0x1d0 [ 5531.221058][ T44] ? trace_initcall_start+0x130/0x130 [ 5531.221335][ T44] ? rcu_is_watching+0x12/0xb0 [ 5531.221577][ T44] ? trace_kmalloc+0x26/0xd0 [ 5531.221824][ T44] ? __kmalloc_cache_noprof+0x2e4/0x690 [ 5531.222116][ T44] ? debug_objects_oom+0x160/0x160 [ 5531.222431][ T44] ? kasan_unpoison+0x27/0x50 [ 5531.222667][ T44] ? __asan_register_globals+0x5d/0x70 [ 5531.222927][ T44] do_init_module+0x27a/0x860 [ 5531.223169][ T44] ? free_module+0x2f0/0x2f0 [ 5531.223469][ T44] ? kfree+0x21d/0x540 [ 5531.223701][ T44] ? load_module+0x20c5/0x2dd0 [ 5531.224013][ T44] load_module+0x1f40/0x2dd0 [ 5531.224334][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 5531.224673][ T44] ? kernel_read_file+0x3ed/0x550 [ 5531.224916][ T44] ? kernel_read_file+0x3c8/0x550 [ 5531.225209][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 5531.225521][ T44] ? init_module_from_file+0xe9/0x150 [ 5531.225782][ T44] init_module_from_file+0xe9/0x150 [ 5531.226026][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 5531.226314][ T44] ? idempotent_init_module+0x316/0x610 [ 5531.226611][ T44] ? __lock_release+0x5d/0x170 [ 5531.226935][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 5531.227233][ T44] idempotent_init_module+0x331/0x610 [ 5531.227501][ T44] ? init_module_from_file+0x150/0x150 [ 5531.227829][ T44] ? cap_capable+0x94/0x230 [ 5531.228141][ T44] __x64_sys_finit_module+0xca/0x150 [ 5531.228439][ T44] ? do_syscall_64+0x85/0xfd0 [ 5531.228680][ T44] do_syscall_64+0xc1/0xfd0 [ 5531.228934][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5531.229278][ T44] RIP: 0033:0x7f855ecf892d [ 5531.229603][ T44] RSP: 002b:00007ffe70794088 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 5531.229976][ T44] RAX: ffffffffffffffda RBX: 000055ecef050c30 RCX: 00007f855ecf892d [ 5531.230342][ T44] RDX: 0000000000000000 RSI: 000055ecbbcaca2a RDI: 0000000000000000 [ 5531.230751][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe707941c0 [ 5531.231221][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055ecbbcaca2a [ 5531.231672][ T44] R13: 000055ecef050f50 R14: 000055ecef050fa0 R15: 000055ecef050c9e [ 5531.232059][ T44] [ 5531.232287][ T44] INFO: task modprobe:21119 blocked on an rw-semaphore likely owned by task kworker/u16:0:12 [ 5531.232940][ T44] task:kworker/u16:0 state:R running task stack:24688 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 5531.233623][ T44] Workqueue: netns cleanup_net [ 5531.233934][ T44] Call Trace: [ 5531.234156][ T44] [ 5531.234307][ T44] ? __mutex_lock+0x19f/0x1190 [ 5531.234606][ T44] ? trace_sched_exit_tp+0xcd/0x130 [ 5531.234870][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5531.235179][ T44] ? ww_mutex_lock+0x160/0x160 [ 5531.235480][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5531.235873][ T44] ? nf_ct_iterate_cleanup+0x4a/0x340 [nf_conntrack] [ 5531.236238][ T44] ? __nf_conntrack_hash_insert+0x200/0x200 [nf_conntrack] [ 5531.236646][ T44] ? nf_conntrack_cleanup_net_list+0x19a/0x4b0 [nf_conntrack] [ 5531.237108][ T44] ? nf_conntrack_cleanup_net_list+0x10e/0x4b0 [nf_conntrack] [ 5531.237539][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 5531.237935][ T44] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 5531.238299][ T44] ? _raw_spin_unlock+0x2d/0x50 [ 5531.238549][ T44] ? ops_undo_list+0x2bf/0x890 [ 5531.238789][ T44] ? rtnl_net_dumpid_one+0x270/0x270 [ 5531.239095][ T44] ? cleanup_net+0x2d6/0x8b0 [ 5531.239337][ T44] ? cleanup_net+0x3b2/0x8b0 [ 5531.239606][ T44] ? net_passive_dec+0x190/0x190 [ 5531.239914][ T44] ? rcu_is_watching+0x12/0xb0 [ 5531.240207][ T44] ? process_one_work+0xe35/0x1650 [ 5531.240452][ T44] ? pwq_dec_nr_in_flight+0x550/0x550 [ 5531.240775][ T44] ? assign_work+0x168/0x240 [ 5531.241083][ T44] ? worker_thread+0x591/0xcf0 [ 5531.241386][ T44] ? rescuer_thread+0xd10/0xd10 [ 5531.241670][ T44] ? kthread+0x37b/0x5f0 [ 5531.241868][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5531.242130][ T44] ? ret_from_fork+0x1b/0x270 [ 5531.242424][ T44] ? __lock_release+0x5d/0x170 [ 5531.242700][ T44] ? rcu_is_watching+0x12/0xb0 [ 5531.242956][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5531.243192][ T44] ? ret_from_fork+0x1db/0x270 [ 5531.243420][ T44] ? kthread_is_per_cpu+0xc0/0xc0 [ 5531.243723][ T44] ? ret_from_fork_asm+0x11/0x20 [ 5531.244045][ T44] [ 5531.244269][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings [ 5531.244735][ T44] [ 5531.244735][ T44] Showing all locks held in the system: [ 5531.245302][ T44] 4 locks held by kworker/u16:0/12: [ 5531.245534][ T44] 1 lock held by khungtaskd/44: [ 5531.245772][ T44] #0: ffffffffac1881c0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 5531.246274][ T44] 2 locks held by kworker/u19:0/408: [ 5531.246495][ T44] #0: ffff888001099d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1650 [ 5531.247068][ T44] #1: ffffc900008bfd30 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xded/0x1650 [ 5531.247584][ T44] 1 lock held by modprobe/21119: [ 5531.247919][ T44] #0: ffffffffac87ff50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 5531.248439][ T44] [ 5531.248552][ T44] ============================================= [ 5531.248552][ T44] WAIT TIMEOUT stderr Ctrl-C stderr Ctrl-C stderr