[ 738.723603][ T44] INFO: task kworker/u16:0:12 blocked for more than 122 seconds. [ 738.724259][ T44] Not tainted 6.16.0-rc6-virtme #1 [ 738.724596][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 738.725026][ T44] task:kworker/u16:0 state:D stack:27024 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00004000 [ 738.725656][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 738.726018][ T44] Call Trace: [ 738.726205][ T44] [ 738.726336][ T44] __schedule+0x862/0x1b00 [ 738.726604][ T44] ? __pfx___schedule+0x10/0x10 [ 738.726856][ T44] ? schedule+0x1ee/0x270 [ 738.727042][ T44] ? __lock_release+0x5d/0x170 [ 738.727290][ T44] schedule+0xe2/0x270 [ 738.727476][ T44] schedule_preempt_disabled+0x18/0x30 [ 738.727726][ T44] __mutex_lock+0x77f/0xcd0 [ 738.727964][ T44] ? validate_chain+0x166/0x4d0 [ 738.728207][ T44] ? addrconf_verify_work+0x12/0x30 [ 738.728451][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 738.728734][ T44] ? rcu_is_watching+0x12/0xc0 [ 738.728999][ T44] ? addrconf_verify_work+0x12/0x30 [ 738.729236][ T44] addrconf_verify_work+0x12/0x30 [ 738.729484][ T44] process_one_work+0xe40/0x1660 [ 738.729750][ T44] ? __pfx_process_one_work+0x10/0x10 [ 738.729996][ T44] ? assign_work+0x16c/0x240 [ 738.730238][ T44] worker_thread+0x591/0xcf0 [ 738.730488][ T44] ? __pfx_worker_thread+0x10/0x10 [ 738.730749][ T44] kthread+0x37e/0x600 [ 738.730938][ T44] ? __pfx_kthread+0x10/0x10 [ 738.731176][ T44] ? ret_from_fork+0x1b/0x320 [ 738.731415][ T44] ? __lock_release+0x5d/0x170 [ 738.732065][ T44] ? rcu_is_watching+0x12/0xc0 [ 738.732310][ T44] ? __pfx_kthread+0x10/0x10 [ 738.732550][ T44] ret_from_fork+0x240/0x320 [ 738.732798][ T44] ? __pfx_kthread+0x10/0x10 [ 738.733038][ T44] ret_from_fork_asm+0x1a/0x30 [ 738.733344][ T44] [ 738.733596][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:1638. [ 738.734010][ T44] task:ip state:R stack:25216 pid:1638 tgid:1638 ppid:1 task_flags:0x400100 flags:0x00004006 [ 738.734556][ T44] Call Trace: [ 738.734766][ T44] [ 738.734897][ T44] __schedule+0x862/0x1b00 [ 738.735196][ T44] ? __pfx___schedule+0x10/0x10 [ 738.735465][ T44] ? debug_object_free+0x294/0x4c0 [ 738.735733][ T44] ? schedule+0x1ee/0x270 [ 738.735912][ T44] ? __lock_release+0x5d/0x170 [ 738.736157][ T44] schedule+0xe2/0x270 [ 738.736344][ T44] schedule_hrtimeout_range_clock+0x100/0x2d0 [ 738.736662][ T44] ? __pfx_schedule_hrtimeout_range_clock+0x10/0x10 [ 738.736958][ T44] ? find_held_lock+0x2b/0x80 [ 738.737216][ T44] ? __pfx_hrtimer_wakeup+0x10/0x10 [ 738.737466][ T44] ? ktime_get+0x178/0x200 [ 738.737724][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 738.737965][ T44] ? ktime_get+0xbb/0x200 [ 738.738157][ T44] usleep_range_state+0x141/0x1d0 [ 738.738405][ T44] ? __pfx_usleep_range_state+0x10/0x10 [ 738.738673][ T44] napi_disable_locked+0x3c0/0x5d0 [ 738.738925][ T44] ? __pfx_napi_disable_locked+0x10/0x10 [ 738.739178][ T44] napi_disable+0x43/0x80 [ 738.739361][ T44] virtnet_close+0x3b3/0x5c0 [ 738.739635][ T44] __dev_close_many+0x1ae/0x670 [ 738.739887][ T44] ? preempt_schedule_common+0x44/0xb0 [ 738.740125][ T44] ? __pfx___dev_close_many+0x10/0x10 [ 738.740377][ T44] __dev_change_flags+0x24e/0x6c0 [ 738.740651][ T44] ? __pfx___dev_change_flags+0x10/0x10 [ 738.740891][ T44] ? is_bpf_text_address+0x67/0x120 [ 738.741143][ T44] netif_change_flags+0x80/0x160 [ 738.741378][ T44] ? kernel_text_address+0xce/0xe0 [ 738.741670][ T44] do_setlink.constprop.0+0x98a/0x2650 [ 738.741919][ T44] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 738.742231][ T44] ? rcu_read_lock_any_held+0x43/0xb0 [ 738.742482][ T44] ? validate_chain+0x166/0x4d0 [ 738.742741][ T44] ? __kernel_text_address+0x12/0x40 [ 738.743017][ T44] ? __lock_acquire+0x44d/0x7e0 [ 738.743287][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 738.743557][ T44] ? __pfx___mutex_trylock_common+0x10/0x10 [ 738.743901][ T44] ? rcu_is_watching+0x12/0xc0 [ 738.744140][ T44] ? rcu_is_watching+0x12/0xc0 [ 738.744378][ T44] ? trace_contention_end+0xdc/0x140 [ 738.744646][ T44] ? __mutex_lock+0x19c/0xcd0 [ 738.744912][ T44] ? find_held_lock+0x2b/0x80 [ 738.745155][ T44] ? rtnl_newlink+0x651/0xa60 [ 738.745408][ T44] ? __create_object+0x5e/0xb0 [ 738.745666][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 738.745915][ T44] ? trace_cap_capable+0x10f/0x190 [ 738.746195][ T44] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 738.746487][ T44] ? __rtnl_newlink+0x40e/0xa40 [ 738.746746][ T44] rtnl_newlink+0x69a/0xa60 [ 738.747035][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 738.747281][ T44] ? __lock_acquire+0x44d/0x7e0 [ 738.747550][ T44] ? find_held_lock+0x2b/0x80 [ 738.747806][ T44] ? rtnetlink_rcv_msg+0x6ed/0xc00 [ 738.748086][ T44] ? __lock_release+0x5d/0x170 [ 738.748347][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 738.748615][ T44] rtnetlink_rcv_msg+0x710/0xc00 [ 738.748854][ T44] ? validate_chain+0x166/0x4d0 [ 738.749093][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 738.749339][ T44] ? __lock_acquire+0x44d/0x7e0 [ 738.749629][ T44] netlink_rcv_skb+0x121/0x350 [ 738.749876][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 738.750124][ T44] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 738.750384][ T44] ? netlink_deliver_tap+0x13e/0x340 [ 738.750641][ T44] ? netlink_deliver_tap+0xc3/0x340 [ 738.750884][ T44] netlink_unicast+0x4b6/0x790 [ 738.751133][ T44] ? __pfx_netlink_unicast+0x10/0x10 [ 738.751383][ T44] ? __lock_acquire+0x44d/0x7e0 [ 738.751680][ T44] netlink_sendmsg+0x721/0xbe0 [ 738.751924][ T44] ? __pfx_netlink_sendmsg+0x10/0x10 [ 738.752167][ T44] ? __import_iovec+0x238/0x3c0 [ 738.752411][ T44] ____sys_sendmsg+0x7ad/0xa10 [ 738.752665][ T44] ? __pfx_____sys_sendmsg+0x10/0x10 [ 738.752907][ T44] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 738.753249][ T44] ___sys_sendmsg+0xed/0x170 [ 738.753493][ T44] ? kasan_record_aux_stack+0x8c/0xa0 [ 738.753753][ T44] ? __call_rcu_common.constprop.0+0xa8/0x640 [ 738.754083][ T44] ? __pfx____sys_sendmsg+0x10/0x10 [ 738.754349][ T44] ? find_held_lock+0x2b/0x80 [ 738.754609][ T44] ? __lock_acquire+0x44d/0x7e0 [ 738.754861][ T44] ? find_held_lock+0x2b/0x80 [ 738.755151][ T44] ? __virt_addr_valid+0x22e/0x450 [ 738.755411][ T44] ? __lock_release+0x5d/0x170 [ 738.755691][ T44] __sys_sendmsg+0x10b/0x1a0 [ 738.755945][ T44] ? __call_rcu_common.constprop.0+0x320/0x640 [ 738.756263][ T44] ? __pfx___sys_sendmsg+0x10/0x10 [ 738.756522][ T44] ? rcu_is_watching+0x12/0xc0 [ 738.756794][ T44] do_syscall_64+0xc1/0x380 [ 738.757053][ T44] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 738.757408][ T44] RIP: 0033:0x7fa4e4e7d1e7 [ 738.757690][ T44] RSP: 002b:00007fff678a4348 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 738.758073][ T44] RAX: ffffffffffffffda RBX: 00007fff678a4a70 RCX: 00007fa4e4e7d1e7 [ 738.758431][ T44] RDX: 0000000000000000 RSI: 00007fff678a43b0 RDI: 0000000000000003 [ 738.758806][ T44] RBP: 0000000000000003 R08: 0000000000000003 R09: 0000000000000078 [ 738.759201][ T44] R10: 00007fa4e4d7aee8 R11: 0000000000000246 R12: 0000000000000003 [ 738.759633][ T44] R13: 0000000068817d05 R14: 0000000000499600 R15: 0000000000000000 [ 738.760009][ T44] [ 738.760247][ T44] INFO: task kworker/1:2:413 blocked for more than 122 seconds. [ 738.760643][ T44] Not tainted 6.16.0-rc6-virtme #1 [ 738.760892][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 738.761299][ T44] task:kworker/1:2 state:D stack:27744 pid:413 tgid:413 ppid:2 task_flags:0x4208060 flags:0x00004000 [ 738.761878][ T44] Workqueue: events virtnet_rx_mode_work [ 738.762140][ T44] Call Trace: [ 738.762347][ T44] [ 738.762475][ T44] __schedule+0x862/0x1b00 [ 738.762742][ T44] ? __pfx___schedule+0x10/0x10 [ 738.763001][ T44] ? schedule+0x1ee/0x270 [ 738.763213][ T44] ? __lock_release+0x5d/0x170 [ 738.763487][ T44] schedule+0xe2/0x270 [ 738.763686][ T44] schedule_preempt_disabled+0x18/0x30 [ 738.763938][ T44] __mutex_lock+0x77f/0xcd0 [ 738.764213][ T44] ? virtnet_rx_mode_work+0x145/0x860 [ 738.764495][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 738.764747][ T44] ? mark_held_locks+0x49/0x80 [ 738.764996][ T44] ? lockdep_hardirqs_on+0x7c/0x110 [ 738.765276][ T44] ? rcu_is_watching+0x12/0xc0 [ 738.765534][ T44] ? trace_kmalloc+0x2a/0xe0 [ 738.765782][ T44] ? __kmalloc_cache_noprof+0x15f/0x360 [ 738.766050][ T44] ? virtnet_rx_mode_work+0x145/0x860 [ 738.766301][ T44] virtnet_rx_mode_work+0x145/0x860 [ 738.766557][ T44] ? __lock_acquire+0x44d/0x7e0 [ 738.766815][ T44] ? __pfx_virtnet_rx_mode_work+0x10/0x10 [ 738.767056][ T44] ? rcu_is_watching+0x12/0xc0 [ 738.767299][ T44] ? rcu_is_watching+0x12/0xc0 [ 738.767579][ T44] process_one_work+0xe40/0x1660 [ 738.767833][ T44] ? __pfx_process_one_work+0x10/0x10 [ 738.768083][ T44] ? assign_work+0x16c/0x240 [ 738.768325][ T44] worker_thread+0x591/0xcf0 [ 738.768598][ T44] ? __pfx_worker_thread+0x10/0x10 [ 738.768841][ T44] kthread+0x37e/0x600 [ 738.769025][ T44] ? __pfx_kthread+0x10/0x10 [ 738.769259][ T44] ? ret_from_fork+0x1b/0x320 [ 738.769500][ T44] ? __lock_release+0x5d/0x170 [ 738.769754][ T44] ? rcu_is_watching+0x12/0xc0 [ 738.769992][ T44] ? __pfx_kthread+0x10/0x10 [ 738.770253][ T44] ret_from_fork+0x240/0x320 [ 738.770500][ T44] ? __pfx_kthread+0x10/0x10 [ 738.770748][ T44] ret_from_fork_asm+0x1a/0x30 [ 738.771001][ T44] [ 738.771214][ T44] INFO: task kworker/1:2:413 is blocked on a mutex likely owned by task ip:1638. [ 738.771621][ T44] task:ip state:D stack:25216 pid:1638 tgid:1638 ppid:1 task_flags:0x400100 flags:0x00004006 [ 738.772141][ T44] Call Trace: [ 738.772321][ T44] [ 738.772451][ T44] __schedule+0x862/0x1b00 [ 738.772712][ T44] ? __pfx___schedule+0x10/0x10 [ 738.772988][ T44] ? schedule+0x1ee/0x270 [ 738.773377][ T44] ? __lock_release+0x5d/0x170 [ 738.773639][ T44] schedule+0xe2/0x270 [ 738.773860][ T44] schedule_hrtimeout_range_clock+0x100/0x2d0 [ 738.774154][ T44] ? __pfx_schedule_hrtimeout_range_clock+0x10/0x10 [ 738.774460][ T44] ? find_held_lock+0x2b/0x80 [ 738.774717][ T44] ? __pfx_hrtimer_wakeup+0x10/0x10 [ 738.774961][ T44] ? ktime_get+0x178/0x200 [ 738.775203][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 738.775631][ T44] ? ktime_get+0xbb/0x200 [ 738.775842][ T44] usleep_range_state+0x141/0x1d0 [ 738.776082][ T44] ? __pfx_usleep_range_state+0x10/0x10 [ 738.776329][ T44] napi_disable_locked+0x3c0/0x5d0 [ 738.777357][ T44] ? __pfx_napi_disable_locked+0x10/0x10 [ 738.777652][ T44] napi_disable+0x43/0x80 [ 738.777849][ T44] virtnet_close+0x3b3/0x5c0 [ 738.778100][ T44] __dev_close_many+0x1ae/0x670 [ 738.778519][ T44] ? preempt_schedule_common+0x44/0xb0 [ 738.778769][ T44] ? __pfx___dev_close_many+0x10/0x10 [ 738.779022][ T44] __dev_change_flags+0x24e/0x6c0 [ 738.779273][ T44] ? __pfx___dev_change_flags+0x10/0x10 [ 738.779677][ T44] ? is_bpf_text_address+0x67/0x120 [ 738.779936][ T44] netif_change_flags+0x80/0x160 [ 738.780179][ T44] ? kernel_text_address+0xce/0xe0 [ 738.780429][ T44] do_setlink.constprop.0+0x98a/0x2650 [ 738.780833][ T44] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 738.781158][ T44] ? rcu_read_lock_any_held+0x43/0xb0 [ 738.781401][ T44] ? validate_chain+0x166/0x4d0 [ 738.781656][ T44] ? __kernel_text_address+0x12/0x40 [ 738.782049][ T44] ? __lock_acquire+0x44d/0x7e0 [ 738.782298][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 738.782535][ T44] ? __pfx___mutex_trylock_common+0x10/0x10 [ 738.782841][ T44] ? rcu_is_watching+0x12/0xc0 [ 738.783258][ T44] ? rcu_is_watching+0x12/0xc0 [ 738.783510][ T44] ? trace_contention_end+0xdc/0x140 [ 738.783786][ T44] ? __mutex_lock+0x19c/0xcd0 [ 738.784049][ T44] ? find_held_lock+0x2b/0x80 [ 738.784450][ T44] ? rtnl_newlink+0x651/0xa60 [ 738.784710][ T44] ? __create_object+0x5e/0xb0 [ 738.784962][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 738.785207][ T44] ? trace_cap_capable+0x10f/0x190 [ 738.785479][ T44] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 738.785792][ T44] ? __rtnl_newlink+0x40e/0xa40 [ 738.786047][ T44] rtnl_newlink+0x69a/0xa60 [ 738.786294][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 738.786536][ T44] ? __lock_acquire+0x44d/0x7e0 [ 738.786792][ T44] ? find_held_lock+0x2b/0x80 [ 738.787034][ T44] ? rtnetlink_rcv_msg+0x6ed/0xc00 [ 738.787274][ T44] ? __lock_release+0x5d/0x170 [ 738.787693][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 738.787934][ T44] rtnetlink_rcv_msg+0x710/0xc00 [ 738.788180][ T44] ? validate_chain+0x166/0x4d0 [ 738.788423][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 738.788681][ T44] ? __lock_acquire+0x44d/0x7e0 [ 738.788936][ T44] netlink_rcv_skb+0x121/0x350 [ 738.789181][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 738.789433][ T44] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 738.789694][ T44] ? netlink_deliver_tap+0x13e/0x340 [ 738.789929][ T44] ? netlink_deliver_tap+0xc3/0x340 [ 738.790168][ T44] netlink_unicast+0x4b6/0x790 [ 738.790416][ T44] ? __pfx_netlink_unicast+0x10/0x10 [ 738.790819][ T44] ? __lock_acquire+0x44d/0x7e0 [ 738.791063][ T44] netlink_sendmsg+0x721/0xbe0 [ 738.791330][ T44] ? __pfx_netlink_sendmsg+0x10/0x10 [ 738.791590][ T44] ? __import_iovec+0x238/0x3c0 [ 738.791859][ T44] ____sys_sendmsg+0x7ad/0xa10 [ 738.792128][ T44] ? __pfx_____sys_sendmsg+0x10/0x10 [ 738.792370][ T44] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 738.792880][ T44] ___sys_sendmsg+0xed/0x170 [ 738.793123][ T44] ? kasan_record_aux_stack+0x8c/0xa0 [ 738.793380][ T44] ? __call_rcu_common.constprop.0+0xa8/0x640 [ 738.793684][ T44] ? __pfx____sys_sendmsg+0x10/0x10 [ 738.794072][ T44] ? find_held_lock+0x2b/0x80 [ 738.794342][ T44] ? __lock_acquire+0x44d/0x7e0 [ 738.794598][ T44] ? find_held_lock+0x2b/0x80 [ 738.794863][ T44] ? __virt_addr_valid+0x22e/0x450 [ 738.795106][ T44] ? __lock_release+0x5d/0x170 [ 738.795362][ T44] __sys_sendmsg+0x10b/0x1a0 [ 738.795658][ T44] ? __call_rcu_common.constprop.0+0x320/0x640 [ 738.795953][ T44] ? __pfx___sys_sendmsg+0x10/0x10 [ 738.796359][ T44] ? rcu_is_watching+0x12/0xc0 [ 738.796663][ T44] do_syscall_64+0xc1/0x380 [ 738.796914][ T44] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 738.797218][ T44] RIP: 0033:0x7fa4e4e7d1e7 [ 738.797477][ T44] RSP: 002b:00007fff678a4348 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 738.797856][ T44] RAX: ffffffffffffffda RBX: 00007fff678a4a70 RCX: 00007fa4e4e7d1e7 [ 738.798219][ T44] RDX: 0000000000000000 RSI: 00007fff678a43b0 RDI: 0000000000000003 [ 738.798592][ T44] RBP: 0000000000000003 R08: 0000000000000003 R09: 0000000000000078 [ 738.798995][ T44] R10: 00007fa4e4d7aee8 R11: 0000000000000246 R12: 0000000000000003 [ 738.799539][ T44] R13: 0000000068817d05 R14: 0000000000499600 R15: 0000000000000000 [ 738.799928][ T44] [ 738.800126][ T44] [ 738.800126][ T44] Showing all locks held in the system: [ 738.800681][ T44] 3 locks held by kworker/u16:0/12: [ 738.800940][ T44] #0: ffff88800939e548 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1660 [ 738.801471][ T44] #1: ffffc900000c7d40 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xdf6/0x1660 [ 738.802218][ T44] #2: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 738.802656][ T44] 1 lock held by khungtaskd/44: [ 738.803037][ T44] #0: ffffffffb75796a0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 738.803466][ T44] 3 locks held by kworker/1:2/413: [ 738.803745][ T44] #0: ffff8880010a9548 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1660 [ 738.804217][ T44] #1: ffffc90001a97d40 ((work_completion)(&vi->rx_mode_work)){+.+.}-{0:0}, at: process_one_work+0xdf6/0x1660 [ 738.804761][ T44] #2: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: virtnet_rx_mode_work+0x145/0x860 [ 738.805339][ T44] 2 locks held by ip/1638: [ 738.805583][ T44] #0: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x651/0xa60 [ 738.805994][ T44] #1: ffff888008eb2c80 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 738.806421][ T44] 1 lock held by ip/1703: [ 738.806606][ T44] #0: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ae/0xc00 [ 738.807160][ T44] [ 738.807295][ T44] ============================================= [ 738.807295][ T44] [ 861.603688][ T44] INFO: task kworker/u16:0:12 blocked for more than 245 seconds. [ 861.604237][ T44] Not tainted 6.16.0-rc6-virtme #1 [ 861.604729][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 861.605279][ T44] task:kworker/u16:0 state:D stack:27024 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00004000 [ 861.605916][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 861.606361][ T44] Call Trace: [ 861.606637][ T44] [ 861.606780][ T44] __schedule+0x862/0x1b00 [ 861.607048][ T44] ? __pfx___schedule+0x10/0x10 [ 861.607372][ T44] ? schedule+0x1ee/0x270 [ 861.607592][ T44] ? __lock_release+0x5d/0x170 [ 861.607896][ T44] schedule+0xe2/0x270 [ 861.608094][ T44] schedule_preempt_disabled+0x18/0x30 [ 861.608514][ T44] __mutex_lock+0x77f/0xcd0 [ 861.608890][ T44] ? validate_chain+0x166/0x4d0 [ 861.609178][ T44] ? addrconf_verify_work+0x12/0x30 [ 861.609470][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 861.609810][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.610077][ T44] ? addrconf_verify_work+0x12/0x30 [ 861.610383][ T44] addrconf_verify_work+0x12/0x30 [ 861.610678][ T44] process_one_work+0xe40/0x1660 [ 861.610970][ T44] ? __pfx_process_one_work+0x10/0x10 [ 861.611326][ T44] ? assign_work+0x16c/0x240 [ 861.611602][ T44] worker_thread+0x591/0xcf0 [ 861.611926][ T44] ? __pfx_worker_thread+0x10/0x10 [ 861.612297][ T44] kthread+0x37e/0x600 [ 861.612492][ T44] ? __pfx_kthread+0x10/0x10 [ 861.612801][ T44] ? ret_from_fork+0x1b/0x320 [ 861.613115][ T44] ? __lock_release+0x5d/0x170 [ 861.613451][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.613753][ T44] ? __pfx_kthread+0x10/0x10 [ 861.614059][ T44] ret_from_fork+0x240/0x320 [ 861.614348][ T44] ? __pfx_kthread+0x10/0x10 [ 861.614661][ T44] ret_from_fork_asm+0x1a/0x30 [ 861.614992][ T44] [ 861.615257][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:1638. [ 861.615796][ T44] task:ip state:D stack:25216 pid:1638 tgid:1638 ppid:1 task_flags:0x400100 flags:0x00004006 [ 861.616515][ T44] Call Trace: [ 861.616743][ T44] [ 861.616885][ T44] __schedule+0x862/0x1b00 [ 861.617230][ T44] ? __pfx___schedule+0x10/0x10 [ 861.617501][ T44] ? schedule+0x1ee/0x270 [ 861.617760][ T44] ? __lock_release+0x5d/0x170 [ 861.618052][ T44] schedule+0xe2/0x270 [ 861.618282][ T44] schedule_hrtimeout_range_clock+0x100/0x2d0 [ 861.618612][ T44] ? __pfx_schedule_hrtimeout_range_clock+0x10/0x10 [ 861.618976][ T44] ? find_held_lock+0x2b/0x80 [ 861.619256][ T44] ? __pfx_hrtimer_wakeup+0x10/0x10 [ 861.619513][ T44] ? ktime_get+0x178/0x200 [ 861.619809][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 861.620096][ T44] ? ktime_get+0xbb/0x200 [ 861.620410][ T44] usleep_range_state+0x141/0x1d0 [ 861.620709][ T44] ? __pfx_usleep_range_state+0x10/0x10 [ 861.620967][ T44] ? usleep_range_state+0x16f/0x1d0 [ 861.621271][ T44] napi_disable_locked+0x3c0/0x5d0 [ 861.621530][ T44] ? __pfx_napi_disable_locked+0x10/0x10 [ 861.621868][ T44] napi_disable+0x43/0x80 [ 861.622090][ T44] virtnet_close+0x3b3/0x5c0 [ 861.622392][ T44] __dev_close_many+0x1ae/0x670 [ 861.622662][ T44] ? preempt_schedule_common+0x44/0xb0 [ 861.622921][ T44] ? __pfx___dev_close_many+0x10/0x10 [ 861.623274][ T44] __dev_change_flags+0x24e/0x6c0 [ 861.623537][ T44] ? __pfx___dev_change_flags+0x10/0x10 [ 861.623833][ T44] ? is_bpf_text_address+0x67/0x120 [ 861.624170][ T44] netif_change_flags+0x80/0x160 [ 861.624480][ T44] ? kernel_text_address+0xce/0xe0 [ 861.624753][ T44] do_setlink.constprop.0+0x98a/0x2650 [ 861.625020][ T44] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 861.625421][ T44] ? rcu_read_lock_any_held+0x43/0xb0 [ 861.625731][ T44] ? validate_chain+0x166/0x4d0 [ 861.626028][ T44] ? __kernel_text_address+0x12/0x40 [ 861.626355][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.626659][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 861.626988][ T44] ? __pfx___mutex_trylock_common+0x10/0x10 [ 861.627424][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.627767][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.628042][ T44] ? trace_contention_end+0xdc/0x140 [ 861.628387][ T44] ? __mutex_lock+0x19c/0xcd0 [ 861.628675][ T44] ? find_held_lock+0x2b/0x80 [ 861.628974][ T44] ? rtnl_newlink+0x651/0xa60 [ 861.629307][ T44] ? __create_object+0x5e/0xb0 [ 861.629619][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 861.629928][ T44] ? trace_cap_capable+0x10f/0x190 [ 861.630294][ T44] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 861.630638][ T44] ? __rtnl_newlink+0x40e/0xa40 [ 861.630936][ T44] rtnl_newlink+0x69a/0xa60 [ 861.631236][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 861.631494][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.631856][ T44] ? find_held_lock+0x2b/0x80 [ 861.632113][ T44] ? rtnetlink_rcv_msg+0x6ed/0xc00 [ 861.632458][ T44] ? __lock_release+0x5d/0x170 [ 861.632727][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 861.632980][ T44] rtnetlink_rcv_msg+0x710/0xc00 [ 861.633297][ T44] ? validate_chain+0x166/0x4d0 [ 861.633620][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 861.633924][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.634195][ T44] netlink_rcv_skb+0x121/0x350 [ 861.634497][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 861.634848][ T44] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 861.635149][ T44] ? netlink_deliver_tap+0x13e/0x340 [ 861.635463][ T44] ? netlink_deliver_tap+0xc3/0x340 [ 861.635741][ T44] netlink_unicast+0x4b6/0x790 [ 861.636004][ T44] ? __pfx_netlink_unicast+0x10/0x10 [ 861.636365][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.636660][ T44] netlink_sendmsg+0x721/0xbe0 [ 861.636955][ T44] ? __pfx_netlink_sendmsg+0x10/0x10 [ 861.637277][ T44] ? __import_iovec+0x238/0x3c0 [ 861.637545][ T44] ____sys_sendmsg+0x7ad/0xa10 [ 861.637820][ T44] ? __pfx_____sys_sendmsg+0x10/0x10 [ 861.638133][ T44] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 861.638532][ T44] ___sys_sendmsg+0xed/0x170 [ 861.638804][ T44] ? kasan_record_aux_stack+0x8c/0xa0 [ 861.639119][ T44] ? __call_rcu_common.constprop.0+0xa8/0x640 [ 861.639452][ T44] ? __pfx____sys_sendmsg+0x10/0x10 [ 861.639800][ T44] ? find_held_lock+0x2b/0x80 [ 861.640116][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.640461][ T44] ? find_held_lock+0x2b/0x80 [ 861.640791][ T44] ? __virt_addr_valid+0x22e/0x450 [ 861.641066][ T44] ? __lock_release+0x5d/0x170 [ 861.641434][ T44] __sys_sendmsg+0x10b/0x1a0 [ 861.641773][ T44] ? __call_rcu_common.constprop.0+0x320/0x640 [ 861.642169][ T44] ? __pfx___sys_sendmsg+0x10/0x10 [ 861.642455][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.642744][ T44] do_syscall_64+0xc1/0x380 [ 861.643018][ T44] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 861.643410][ T44] RIP: 0033:0x7fa4e4e7d1e7 [ 861.643736][ T44] RSP: 002b:00007fff678a4348 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 861.644194][ T44] RAX: ffffffffffffffda RBX: 00007fff678a4a70 RCX: 00007fa4e4e7d1e7 [ 861.644693][ T44] RDX: 0000000000000000 RSI: 00007fff678a43b0 RDI: 0000000000000003 [ 861.645124][ T44] RBP: 0000000000000003 R08: 0000000000000003 R09: 0000000000000078 [ 861.645662][ T44] R10: 00007fa4e4d7aee8 R11: 0000000000000246 R12: 0000000000000003 [ 861.646098][ T44] R13: 0000000068817d05 R14: 0000000000499600 R15: 0000000000000000 [ 861.646504][ T44] [ 861.646745][ T44] INFO: task kworker/1:2:413 blocked for more than 245 seconds. [ 861.647099][ T44] Not tainted 6.16.0-rc6-virtme #1 [ 861.647346][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 861.647871][ T44] task:kworker/1:2 state:D stack:27744 pid:413 tgid:413 ppid:2 task_flags:0x4208060 flags:0x00004000 [ 861.648647][ T44] Workqueue: events virtnet_rx_mode_work [ 861.648969][ T44] Call Trace: [ 861.649208][ T44] [ 861.649366][ T44] __schedule+0x862/0x1b00 [ 861.649704][ T44] ? __pfx___schedule+0x10/0x10 [ 861.649985][ T44] ? schedule+0x1ee/0x270 [ 861.650195][ T44] ? __lock_release+0x5d/0x170 [ 861.650499][ T44] schedule+0xe2/0x270 [ 861.650726][ T44] schedule_preempt_disabled+0x18/0x30 [ 861.650985][ T44] __mutex_lock+0x77f/0xcd0 [ 861.651299][ T44] ? virtnet_rx_mode_work+0x145/0x860 [ 861.651557][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 861.651845][ T44] ? mark_held_locks+0x49/0x80 [ 861.652218][ T44] ? lockdep_hardirqs_on+0x7c/0x110 [ 861.652478][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.652787][ T44] ? trace_kmalloc+0x2a/0xe0 [ 861.653058][ T44] ? __kmalloc_cache_noprof+0x15f/0x360 [ 861.653395][ T44] ? virtnet_rx_mode_work+0x145/0x860 [ 861.653665][ T44] virtnet_rx_mode_work+0x145/0x860 [ 861.653923][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.654204][ T44] ? __pfx_virtnet_rx_mode_work+0x10/0x10 [ 861.654476][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.654818][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.655103][ T44] process_one_work+0xe40/0x1660 [ 861.655415][ T44] ? __pfx_process_one_work+0x10/0x10 [ 861.655700][ T44] ? assign_work+0x16c/0x240 [ 861.655962][ T44] worker_thread+0x591/0xcf0 [ 861.656400][ T44] ? __pfx_worker_thread+0x10/0x10 [ 861.656714][ T44] kthread+0x37e/0x600 [ 861.656926][ T44] ? __pfx_kthread+0x10/0x10 [ 861.657182][ T44] ? ret_from_fork+0x1b/0x320 [ 861.657437][ T44] ? __lock_release+0x5d/0x170 [ 861.657706][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.657966][ T44] ? __pfx_kthread+0x10/0x10 [ 861.658227][ T44] ret_from_fork+0x240/0x320 [ 861.658483][ T44] ? __pfx_kthread+0x10/0x10 [ 861.658752][ T44] ret_from_fork_asm+0x1a/0x30 [ 861.659036][ T44] [ 861.659276][ T44] INFO: task kworker/1:2:413 is blocked on a mutex likely owned by task ip:1638. [ 861.659720][ T44] task:ip state:D stack:25216 pid:1638 tgid:1638 ppid:1 task_flags:0x400100 flags:0x00004006 [ 861.660450][ T44] Call Trace: [ 861.660664][ T44] [ 861.660845][ T44] ? __pfx___schedule+0x10/0x10 [ 861.661131][ T44] ? schedule+0x1ee/0x270 [ 861.661331][ T44] ? __lock_release+0x5d/0x170 [ 861.661601][ T44] ? schedule+0xe2/0x270 [ 861.661791][ T44] ? schedule_hrtimeout_range_clock+0x100/0x2d0 [ 861.662170][ T44] ? __pfx_schedule_hrtimeout_range_clock+0x10/0x10 [ 861.662553][ T44] ? find_held_lock+0x2b/0x80 [ 861.662841][ T44] ? __pfx_hrtimer_wakeup+0x10/0x10 [ 861.663146][ T44] ? ktime_get+0x178/0x200 [ 861.663457][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 861.663778][ T44] ? ktime_get+0xbb/0x200 [ 861.664016][ T44] ? usleep_range_state+0x141/0x1d0 [ 861.664365][ T44] ? __pfx_usleep_range_state+0x10/0x10 [ 861.664637][ T44] ? usleep_range_state+0x16f/0x1d0 [ 861.664939][ T44] ? napi_disable_locked+0x3c0/0x5d0 [ 861.665223][ T44] ? __pfx_napi_disable_locked+0x10/0x10 [ 861.665540][ T44] ? napi_disable+0x43/0x80 [ 861.665813][ T44] ? virtnet_close+0x3b3/0x5c0 [ 861.666146][ T44] ? __dev_close_many+0x1ae/0x670 [ 861.666432][ T44] ? preempt_schedule_common+0x44/0xb0 [ 861.666739][ T44] ? __pfx___dev_close_many+0x10/0x10 [ 861.667041][ T44] ? __dev_change_flags+0x24e/0x6c0 [ 861.667371][ T44] ? __pfx___dev_change_flags+0x10/0x10 [ 861.667635][ T44] ? is_bpf_text_address+0x67/0x120 [ 861.667972][ T44] ? netif_change_flags+0x80/0x160 [ 861.668350][ T44] ? kernel_text_address+0xce/0xe0 [ 861.668700][ T44] ? do_setlink.constprop.0+0x98a/0x2650 [ 861.668972][ T44] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 861.669307][ T44] ? rcu_read_lock_any_held+0x43/0xb0 [ 861.669559][ T44] ? validate_chain+0x166/0x4d0 [ 861.669887][ T44] ? __kernel_text_address+0x12/0x40 [ 861.670177][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.670463][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 861.670778][ T44] ? __pfx___mutex_trylock_common+0x10/0x10 [ 861.671215][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.671527][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.671946][ T44] ? trace_contention_end+0xdc/0x140 [ 861.672268][ T44] ? __mutex_lock+0x19c/0xcd0 [ 861.672655][ T44] ? find_held_lock+0x2b/0x80 [ 861.672907][ T44] ? rtnl_newlink+0x651/0xa60 [ 861.673358][ T44] ? __create_object+0x5e/0xb0 [ 861.673665][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 861.673946][ T44] ? trace_cap_capable+0x10f/0x190 [ 861.674250][ T44] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 861.674796][ T44] ? __rtnl_newlink+0x40e/0xa40 [ 861.675113][ T44] ? rtnl_newlink+0x69a/0xa60 [ 861.675395][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 861.675752][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.676177][ T44] ? find_held_lock+0x2b/0x80 [ 861.676444][ T44] ? rtnetlink_rcv_msg+0x6ed/0xc00 [ 861.676762][ T44] ? __lock_release+0x5d/0x170 [ 861.677109][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 861.677500][ T44] ? rtnetlink_rcv_msg+0x710/0xc00 [ 861.677785][ T44] ? validate_chain+0x166/0x4d0 [ 861.678046][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 861.678331][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.678768][ T44] ? netlink_rcv_skb+0x121/0x350 [ 861.679079][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 861.679345][ T44] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 861.679690][ T44] ? netlink_deliver_tap+0x13e/0x340 [ 861.680165][ T44] ? netlink_deliver_tap+0xc3/0x340 [ 861.680430][ T44] ? netlink_unicast+0x4b6/0x790 [ 861.680809][ T44] ? __pfx_netlink_unicast+0x10/0x10 [ 861.681134][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.681604][ T44] ? netlink_sendmsg+0x721/0xbe0 [ 861.681898][ T44] ? __pfx_netlink_sendmsg+0x10/0x10 [ 861.682248][ T44] ? __import_iovec+0x238/0x3c0 [ 861.682607][ T44] ? ____sys_sendmsg+0x7ad/0xa10 [ 861.683217][ T44] ? __pfx_____sys_sendmsg+0x10/0x10 [ 861.683482][ T44] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 861.683832][ T44] ? ___sys_sendmsg+0xed/0x170 [ 861.684110][ T44] ? kasan_record_aux_stack+0x8c/0xa0 [ 861.684532][ T44] ? __call_rcu_common.constprop.0+0xa8/0x640 [ 861.684863][ T44] ? __pfx____sys_sendmsg+0x10/0x10 [ 861.685119][ T44] ? find_held_lock+0x2b/0x80 [ 861.685422][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.685848][ T44] ? find_held_lock+0x2b/0x80 [ 861.686101][ T44] ? __virt_addr_valid+0x22e/0x450 [ 861.686393][ T44] ? __lock_release+0x5d/0x170 [ 861.686831][ T44] ? __sys_sendmsg+0x10b/0x1a0 [ 861.687081][ T44] ? __call_rcu_common.constprop.0+0x320/0x640 [ 861.687432][ T44] ? __pfx___sys_sendmsg+0x10/0x10 [ 861.687723][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.687981][ T44] ? do_syscall_64+0xc1/0x380 [ 861.688256][ T44] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 861.688608][ T44] [ 861.688826][ T44] INFO: task ip:1703 blocked for more than 122 seconds. [ 861.689262][ T44] Not tainted 6.16.0-rc6-virtme #1 [ 861.689509][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 861.689950][ T44] task:ip state:D stack:26032 pid:1703 tgid:1703 ppid:1686 task_flags:0x400100 flags:0x00004002 [ 861.690872][ T44] Call Trace: [ 861.691144][ T44] [ 861.691284][ T44] __schedule+0x862/0x1b00 [ 861.691545][ T44] ? __pfx___schedule+0x10/0x10 [ 861.691842][ T44] ? schedule+0x1ee/0x270 [ 861.692031][ T44] ? __lock_release+0x5d/0x170 [ 861.692288][ T44] schedule+0xe2/0x270 [ 861.692479][ T44] schedule_preempt_disabled+0x18/0x30 [ 861.692898][ T44] __mutex_lock+0x77f/0xcd0 [ 861.693179][ T44] ? rtnetlink_rcv_msg+0x2ae/0xc00 [ 861.693463][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 861.693755][ T44] ? rtnetlink_rcv_msg+0x296/0xc00 [ 861.694026][ T44] ? __lock_release+0x5d/0x170 [ 861.694319][ T44] ? rtnetlink_rcv_msg+0x2ae/0xc00 [ 861.694600][ T44] rtnetlink_rcv_msg+0x2ae/0xc00 [ 861.694900][ T44] ? validate_chain+0x166/0x4d0 [ 861.695250][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 861.695531][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.695837][ T44] netlink_rcv_skb+0x121/0x350 [ 861.696110][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 861.696455][ T44] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 861.696774][ T44] ? netlink_deliver_tap+0x13e/0x340 [ 861.697078][ T44] ? netlink_deliver_tap+0xc3/0x340 [ 861.697432][ T44] netlink_unicast+0x4b6/0x790 [ 861.698034][ T44] ? __pfx_netlink_unicast+0x10/0x10 [ 861.698318][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.698597][ T44] netlink_sendmsg+0x721/0xbe0 [ 861.698881][ T44] ? __pfx_netlink_sendmsg+0x10/0x10 [ 861.699481][ T44] ? __import_iovec+0x238/0x3c0 [ 861.699864][ T44] ____sys_sendmsg+0x7ad/0xa10 [ 861.700120][ T44] ? __pfx_____sys_sendmsg+0x10/0x10 [ 861.700383][ T44] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 861.700896][ T44] ___sys_sendmsg+0xed/0x170 [ 861.701159][ T44] ? __pfx____sys_sendmsg+0x10/0x10 [ 861.701408][ T44] ? __pfx_handle_pte_fault+0x10/0x10 [ 861.701680][ T44] ? mt_find+0x2b2/0x3c0 [ 861.701892][ T44] ? __handle_mm_fault+0x3fc/0x5e0 [ 861.702157][ T44] ? __pfx___handle_mm_fault+0x10/0x10 [ 861.702408][ T44] ? mt_find+0x2bc/0x3c0 [ 861.702631][ T44] __sys_sendmsg+0x10b/0x1a0 [ 861.702888][ T44] ? __pfx___sys_sendmsg+0x10/0x10 [ 861.703287][ T44] ? do_user_addr_fault+0x38d/0xe00 [ 861.703547][ T44] ? do_user_addr_fault+0x38d/0xe00 [ 861.703826][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.704088][ T44] do_syscall_64+0xc1/0x380 [ 861.704512][ T44] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 861.704858][ T44] RIP: 0033:0x7f7bcf2c31e7 [ 861.705121][ T44] RSP: 002b:00007fffc64ca908 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 861.705734][ T44] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f7bcf2c31e7 [ 861.706143][ T44] RDX: 0000000000000000 RSI: 00007fffc64ca970 RDI: 0000000000000006 [ 861.706555][ T44] RBP: 00007fffc64caa60 R08: 0000000000000001 R09: 00007f7bcf4970c0 [ 861.707257][ T44] R10: 00007f7bcf1bb6f8 R11: 0000000000000246 R12: 00007fffc64cc93b [ 861.707733][ T44] R13: 0000000068817dd9 R14: 00007fffc64caa20 R15: 000000000000000d [ 861.708306][ T44] [ 861.708548][ T44] INFO: task ip:1703 is blocked on a mutex likely owned by task ip:1638. [ 861.708945][ T44] task:ip state:D stack:24976 pid:1638 tgid:1638 ppid:1 task_flags:0x400100 flags:0x00004006 [ 861.709694][ T44] Call Trace: [ 861.709919][ T44] [ 861.710052][ T44] __schedule+0x862/0x1b00 [ 861.710366][ T44] ? __pfx___schedule+0x10/0x10 [ 861.710805][ T44] ? schedule+0x1ee/0x270 [ 861.711004][ T44] ? clockevents_program_event+0x1ed/0x300 [ 861.711324][ T44] schedule+0xe2/0x270 [ 861.711518][ T44] schedule_hrtimeout_range_clock+0x100/0x2d0 [ 861.711993][ T44] ? __pfx_schedule_hrtimeout_range_clock+0x10/0x10 [ 861.712315][ T44] ? find_held_lock+0x2b/0x80 [ 861.712599][ T44] ? __pfx_hrtimer_wakeup+0x10/0x10 [ 861.712871][ T44] ? ktime_get+0x178/0x200 [ 861.713293][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 861.713605][ T44] ? ktime_get+0xbb/0x200 [ 861.713810][ T44] usleep_range_state+0x141/0x1d0 [ 861.714073][ T44] ? __pfx_usleep_range_state+0x10/0x10 [ 861.714348][ T44] ? usleep_range_state+0x16f/0x1d0 [ 861.714775][ T44] napi_disable_locked+0x3c0/0x5d0 [ 861.715037][ T44] ? __pfx_napi_disable_locked+0x10/0x10 [ 861.715313][ T44] napi_disable+0x43/0x80 [ 861.715528][ T44] virtnet_close+0x3b3/0x5c0 [ 861.715968][ T44] __dev_close_many+0x1ae/0x670 [ 861.716300][ T44] ? preempt_schedule_common+0x44/0xb0 [ 861.716588][ T44] ? __pfx___dev_close_many+0x10/0x10 [ 861.716866][ T44] __dev_change_flags+0x24e/0x6c0 [ 861.717282][ T44] ? __pfx___dev_change_flags+0x10/0x10 [ 861.717544][ T44] ? is_bpf_text_address+0x67/0x120 [ 861.717874][ T44] netif_change_flags+0x80/0x160 [ 861.718151][ T44] ? kernel_text_address+0xce/0xe0 [ 861.718440][ T44] do_setlink.constprop.0+0x98a/0x2650 [ 861.718728][ T44] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 861.719071][ T44] ? rcu_read_lock_any_held+0x43/0xb0 [ 861.719328][ T44] ? validate_chain+0x166/0x4d0 [ 861.719768][ T44] ? __kernel_text_address+0x12/0x40 [ 861.720030][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.720333][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 861.720928][ T44] ? __pfx___mutex_trylock_common+0x10/0x10 [ 861.721270][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.721540][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.721831][ T44] ? trace_contention_end+0xdc/0x140 [ 861.722110][ T44] ? __mutex_lock+0x19c/0xcd0 [ 861.722381][ T44] ? find_held_lock+0x2b/0x80 [ 861.722669][ T44] ? rtnl_newlink+0x651/0xa60 [ 861.722942][ T44] ? __create_object+0x5e/0xb0 [ 861.723366][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 861.723745][ T44] ? trace_cap_capable+0x10f/0x190 [ 861.724157][ T44] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 861.724635][ T44] ? __rtnl_newlink+0x40e/0xa40 [ 861.725074][ T44] rtnl_newlink+0x69a/0xa60 [ 861.725340][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 861.725610][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.725880][ T44] ? find_held_lock+0x2b/0x80 [ 861.726143][ T44] ? rtnetlink_rcv_msg+0x6ed/0xc00 [ 861.726392][ T44] ? __lock_release+0x5d/0x170 [ 861.726716][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 861.727004][ T44] rtnetlink_rcv_msg+0x710/0xc00 [ 861.727409][ T44] ? validate_chain+0x166/0x4d0 [ 861.727689][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 861.727955][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.728258][ T44] netlink_rcv_skb+0x121/0x350 [ 861.728517][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 861.728798][ T44] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 861.729074][ T44] ? netlink_deliver_tap+0x13e/0x340 [ 861.729333][ T44] ? netlink_deliver_tap+0xc3/0x340 [ 861.729638][ T44] netlink_unicast+0x4b6/0x790 [ 861.729923][ T44] ? __pfx_netlink_unicast+0x10/0x10 [ 861.730195][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.730467][ T44] netlink_sendmsg+0x721/0xbe0 [ 861.730929][ T44] ? __pfx_netlink_sendmsg+0x10/0x10 [ 861.731200][ T44] ? __import_iovec+0x238/0x3c0 [ 861.731487][ T44] ____sys_sendmsg+0x7ad/0xa10 [ 861.731838][ T44] ? __pfx_____sys_sendmsg+0x10/0x10 [ 861.732403][ T44] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 861.732758][ T44] ___sys_sendmsg+0xed/0x170 [ 861.733008][ T44] ? kasan_record_aux_stack+0x8c/0xa0 [ 861.733259][ T44] ? __call_rcu_common.constprop.0+0xa8/0x640 [ 861.733746][ T44] ? __pfx____sys_sendmsg+0x10/0x10 [ 861.734011][ T44] ? find_held_lock+0x2b/0x80 [ 861.734306][ T44] ? __lock_acquire+0x44d/0x7e0 [ 861.734882][ T44] ? find_held_lock+0x2b/0x80 [ 861.735146][ T44] ? __virt_addr_valid+0x22e/0x450 [ 861.735407][ T44] ? __lock_release+0x5d/0x170 [ 861.735707][ T44] __sys_sendmsg+0x10b/0x1a0 [ 861.735968][ T44] ? __call_rcu_common.constprop.0+0x320/0x640 [ 861.736316][ T44] ? __pfx___sys_sendmsg+0x10/0x10 [ 861.736601][ T44] ? rcu_is_watching+0x12/0xc0 [ 861.736866][ T44] do_syscall_64+0xc1/0x380 [ 861.737136][ T44] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 861.737464][ T44] RIP: 0033:0x7fa4e4e7d1e7 [ 861.737749][ T44] RSP: 002b:00007fff678a4348 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 861.738158][ T44] RAX: ffffffffffffffda RBX: 00007fff678a4a70 RCX: 00007fa4e4e7d1e7 [ 861.738590][ T44] RDX: 0000000000000000 RSI: 00007fff678a43b0 RDI: 0000000000000003 [ 861.739004][ T44] RBP: 0000000000000003 R08: 0000000000000003 R09: 0000000000000078 [ 861.739560][ T44] R10: 00007fa4e4d7aee8 R11: 0000000000000246 R12: 0000000000000003 [ 861.739996][ T44] R13: 0000000068817d05 R14: 0000000000499600 R15: 0000000000000000 [ 861.740595][ T44] [ 861.741005][ T44] [ 861.741005][ T44] Showing all locks held in the system: [ 861.741375][ T44] 3 locks held by kworker/u16:0/12: [ 861.741771][ T44] #0: ffff88800939e548 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1660 [ 861.742275][ T44] #1: ffffc900000c7d40 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xdf6/0x1660 [ 861.743047][ T44] #2: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 861.743501][ T44] 1 lock held by khungtaskd/44: [ 861.743762][ T44] #0: ffffffffb75796a0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 861.744217][ T44] 3 locks held by kworker/1:2/413: [ 861.744480][ T44] #0: ffff8880010a9548 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1660 [ 861.745171][ T44] #1: ffffc90001a97d40 ((work_completion)(&vi->rx_mode_work)){+.+.}-{0:0}, at: process_one_work+0xdf6/0x1660 [ 861.745731][ T44] #2: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: virtnet_rx_mode_work+0x145/0x860 [ 861.746315][ T44] 2 locks held by ip/1638: [ 861.746554][ T44] #0: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x651/0xa60 [ 861.747008][ T44] #1: ffff888008eb2c80 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 861.747444][ T44] 1 lock held by ip/1703: [ 861.747640][ T44] #0: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ae/0xc00 [ 861.748074][ T44] [ 861.748267][ T44] ============================================= [ 861.748267][ T44] [ 984.483660][ T44] INFO: task kworker/u16:0:12 blocked for more than 368 seconds. [ 984.484246][ T44] Not tainted 6.16.0-rc6-virtme #1 [ 984.484644][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 984.485085][ T44] task:kworker/u16:0 state:D stack:27024 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00004000 [ 984.485722][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 984.486098][ T44] Call Trace: [ 984.486301][ T44] [ 984.486482][ T44] __schedule+0x862/0x1b00 [ 984.486820][ T44] ? __pfx___schedule+0x10/0x10 [ 984.487110][ T44] ? schedule+0x1ee/0x270 [ 984.487336][ T44] ? __lock_release+0x5d/0x170 [ 984.487649][ T44] schedule+0xe2/0x270 [ 984.487834][ T44] schedule_preempt_disabled+0x18/0x30 [ 984.488085][ T44] __mutex_lock+0x77f/0xcd0 [ 984.488350][ T44] ? validate_chain+0x166/0x4d0 [ 984.488625][ T44] ? addrconf_verify_work+0x12/0x30 [ 984.488874][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 984.489144][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.489429][ T44] ? addrconf_verify_work+0x12/0x30 [ 984.489738][ T44] addrconf_verify_work+0x12/0x30 [ 984.490020][ T44] process_one_work+0xe40/0x1660 [ 984.490308][ T44] ? __pfx_process_one_work+0x10/0x10 [ 984.490560][ T44] ? assign_work+0x16c/0x240 [ 984.490852][ T44] worker_thread+0x591/0xcf0 [ 984.491149][ T44] ? __pfx_worker_thread+0x10/0x10 [ 984.491430][ T44] kthread+0x37e/0x600 [ 984.491649][ T44] ? __pfx_kthread+0x10/0x10 [ 984.492008][ T44] ? ret_from_fork+0x1b/0x320 [ 984.492275][ T44] ? __lock_release+0x5d/0x170 [ 984.492621][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.492908][ T44] ? __pfx_kthread+0x10/0x10 [ 984.493177][ T44] ret_from_fork+0x240/0x320 [ 984.493460][ T44] ? __pfx_kthread+0x10/0x10 [ 984.493749][ T44] ret_from_fork_asm+0x1a/0x30 [ 984.494082][ T44] [ 984.494341][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:1638. [ 984.494794][ T44] task:ip state:D stack:24976 pid:1638 tgid:1638 ppid:1 task_flags:0x400100 flags:0x00004006 [ 984.495403][ T44] Call Trace: [ 984.495625][ T44] [ 984.495779][ T44] ? __schedule+0x862/0x1b00 [ 984.496060][ T44] ? mark_held_locks+0x49/0x80 [ 984.496404][ T44] ? __pfx___schedule+0x10/0x10 [ 984.496841][ T44] ? schedule+0x1ee/0x270 [ 984.497138][ T44] ? __lock_release+0x5d/0x170 [ 984.497538][ T44] ? schedule+0xe2/0x270 [ 984.497839][ T44] ? schedule_hrtimeout_range_clock+0x100/0x2d0 [ 984.498167][ T44] ? __pfx_schedule_hrtimeout_range_clock+0x10/0x10 [ 984.498458][ T44] ? find_held_lock+0x2b/0x80 [ 984.498721][ T44] ? __pfx_hrtimer_wakeup+0x10/0x10 [ 984.499011][ T44] ? ktime_get+0x178/0x200 [ 984.499387][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 984.499643][ T44] ? ktime_get+0xbb/0x200 [ 984.499829][ T44] ? usleep_range_state+0x141/0x1d0 [ 984.500076][ T44] ? __pfx_usleep_range_state+0x10/0x10 [ 984.500324][ T44] ? napi_disable_locked+0x3c0/0x5d0 [ 984.500606][ T44] ? __pfx_napi_disable_locked+0x10/0x10 [ 984.500856][ T44] ? napi_disable+0x43/0x80 [ 984.501106][ T44] ? virtnet_close+0x3b3/0x5c0 [ 984.501359][ T44] ? __dev_close_many+0x1ae/0x670 [ 984.501609][ T44] ? preempt_schedule_common+0x44/0xb0 [ 984.501846][ T44] ? __pfx___dev_close_many+0x10/0x10 [ 984.502108][ T44] ? __dev_change_flags+0x24e/0x6c0 [ 984.502367][ T44] ? __pfx___dev_change_flags+0x10/0x10 [ 984.502669][ T44] ? is_bpf_text_address+0x67/0x120 [ 984.502925][ T44] ? netif_change_flags+0x80/0x160 [ 984.503175][ T44] ? kernel_text_address+0xce/0xe0 [ 984.503430][ T44] ? do_setlink.constprop.0+0x98a/0x2650 [ 984.503688][ T44] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 984.504010][ T44] ? rcu_read_lock_any_held+0x43/0xb0 [ 984.504252][ T44] ? validate_chain+0x166/0x4d0 [ 984.504495][ T44] ? __kernel_text_address+0x12/0x40 [ 984.504758][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.505007][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 984.505246][ T44] ? __pfx___mutex_trylock_common+0x10/0x10 [ 984.505545][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.505816][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.506074][ T44] ? trace_contention_end+0xdc/0x140 [ 984.506314][ T44] ? __mutex_lock+0x19c/0xcd0 [ 984.506551][ T44] ? find_held_lock+0x2b/0x80 [ 984.506800][ T44] ? rtnl_newlink+0x651/0xa60 [ 984.507076][ T44] ? __create_object+0x5e/0xb0 [ 984.507346][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 984.507595][ T44] ? trace_cap_capable+0x10f/0x190 [ 984.507843][ T44] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 984.508146][ T44] ? __rtnl_newlink+0x40e/0xa40 [ 984.508398][ T44] ? rtnl_newlink+0x69a/0xa60 [ 984.508659][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 984.508897][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.509150][ T44] ? find_held_lock+0x2b/0x80 [ 984.509388][ T44] ? rtnetlink_rcv_msg+0x6ed/0xc00 [ 984.509631][ T44] ? __lock_release+0x5d/0x170 [ 984.509877][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 984.510130][ T44] ? rtnetlink_rcv_msg+0x710/0xc00 [ 984.510367][ T44] ? validate_chain+0x166/0x4d0 [ 984.510613][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 984.510853][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.511110][ T44] ? netlink_rcv_skb+0x121/0x350 [ 984.511373][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 984.511633][ T44] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 984.511911][ T44] ? netlink_deliver_tap+0x13e/0x340 [ 984.512172][ T44] ? netlink_deliver_tap+0xc3/0x340 [ 984.512426][ T44] ? netlink_unicast+0x4b6/0x790 [ 984.512711][ T44] ? __pfx_netlink_unicast+0x10/0x10 [ 984.512952][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.513205][ T44] ? netlink_sendmsg+0x721/0xbe0 [ 984.513472][ T44] ? __pfx_netlink_sendmsg+0x10/0x10 [ 984.513772][ T44] ? __import_iovec+0x238/0x3c0 [ 984.514055][ T44] ? ____sys_sendmsg+0x7ad/0xa10 [ 984.514298][ T44] ? __pfx_____sys_sendmsg+0x10/0x10 [ 984.514537][ T44] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 984.515001][ T44] ? ___sys_sendmsg+0xed/0x170 [ 984.515330][ T44] ? kasan_record_aux_stack+0x8c/0xa0 [ 984.515609][ T44] ? __call_rcu_common.constprop.0+0xa8/0x640 [ 984.515936][ T44] ? __pfx____sys_sendmsg+0x10/0x10 [ 984.516203][ T44] ? find_held_lock+0x2b/0x80 [ 984.516549][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.516840][ T44] ? find_held_lock+0x2b/0x80 [ 984.517115][ T44] ? __virt_addr_valid+0x22e/0x450 [ 984.517358][ T44] ? __lock_release+0x5d/0x170 [ 984.517622][ T44] ? __sys_sendmsg+0x10b/0x1a0 [ 984.517859][ T44] ? __call_rcu_common.constprop.0+0x320/0x640 [ 984.518179][ T44] ? __pfx___sys_sendmsg+0x10/0x10 [ 984.518429][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.518687][ T44] ? do_syscall_64+0xc1/0x380 [ 984.518927][ T44] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 984.519267][ T44] [ 984.519482][ T44] INFO: task kworker/1:2:413 blocked for more than 368 seconds. [ 984.519829][ T44] Not tainted 6.16.0-rc6-virtme #1 [ 984.520061][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 984.520445][ T44] task:kworker/1:2 state:D stack:27744 pid:413 tgid:413 ppid:2 task_flags:0x4208060 flags:0x00004000 [ 984.521003][ T44] Workqueue: events virtnet_rx_mode_work [ 984.521260][ T44] Call Trace: [ 984.521440][ T44] [ 984.521581][ T44] __schedule+0x862/0x1b00 [ 984.521830][ T44] ? __pfx___schedule+0x10/0x10 [ 984.522098][ T44] ? schedule+0x1ee/0x270 [ 984.522279][ T44] ? __lock_release+0x5d/0x170 [ 984.522521][ T44] schedule+0xe2/0x270 [ 984.522709][ T44] schedule_preempt_disabled+0x18/0x30 [ 984.522954][ T44] __mutex_lock+0x77f/0xcd0 [ 984.523235][ T44] ? virtnet_rx_mode_work+0x145/0x860 [ 984.523505][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 984.523755][ T44] ? mark_held_locks+0x49/0x80 [ 984.524007][ T44] ? lockdep_hardirqs_on+0x7c/0x110 [ 984.524292][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.524546][ T44] ? trace_kmalloc+0x2a/0xe0 [ 984.524857][ T44] ? __kmalloc_cache_noprof+0x15f/0x360 [ 984.525147][ T44] ? virtnet_rx_mode_work+0x145/0x860 [ 984.525406][ T44] virtnet_rx_mode_work+0x145/0x860 [ 984.525675][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.525935][ T44] ? __pfx_virtnet_rx_mode_work+0x10/0x10 [ 984.526201][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.526479][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.526764][ T44] process_one_work+0xe40/0x1660 [ 984.527054][ T44] ? __pfx_process_one_work+0x10/0x10 [ 984.527328][ T44] ? assign_work+0x16c/0x240 [ 984.527604][ T44] worker_thread+0x591/0xcf0 [ 984.527872][ T44] ? __pfx_worker_thread+0x10/0x10 [ 984.528192][ T44] kthread+0x37e/0x600 [ 984.528394][ T44] ? __pfx_kthread+0x10/0x10 [ 984.528719][ T44] ? ret_from_fork+0x1b/0x320 [ 984.528991][ T44] ? __lock_release+0x5d/0x170 [ 984.529326][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.529625][ T44] ? __pfx_kthread+0x10/0x10 [ 984.529896][ T44] ret_from_fork+0x240/0x320 [ 984.530154][ T44] ? __pfx_kthread+0x10/0x10 [ 984.530408][ T44] ret_from_fork_asm+0x1a/0x30 [ 984.530753][ T44] [ 984.531000][ T44] INFO: task kworker/1:2:413 is blocked on a mutex likely owned by task ip:1638. [ 984.531494][ T44] task:ip state:D stack:24976 pid:1638 tgid:1638 ppid:1 task_flags:0x400100 flags:0x00004006 [ 984.532206][ T44] Call Trace: [ 984.532411][ T44] [ 984.532549][ T44] __schedule+0x862/0x1b00 [ 984.532901][ T44] ? __pfx___schedule+0x10/0x10 [ 984.533211][ T44] ? schedule+0x1ee/0x270 [ 984.533447][ T44] ? __lock_release+0x5d/0x170 [ 984.533759][ T44] schedule+0xe2/0x270 [ 984.533967][ T44] schedule_hrtimeout_range_clock+0x100/0x2d0 [ 984.534301][ T44] ? __pfx_schedule_hrtimeout_range_clock+0x10/0x10 [ 984.534623][ T44] ? find_held_lock+0x2b/0x80 [ 984.534881][ T44] ? __pfx_hrtimer_wakeup+0x10/0x10 [ 984.535151][ T44] ? ktime_get+0x178/0x200 [ 984.535406][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 984.535679][ T44] ? ktime_get+0xbb/0x200 [ 984.535879][ T44] usleep_range_state+0x86/0x1d0 [ 984.536150][ T44] ? __pfx_usleep_range_state+0x10/0x10 [ 984.536414][ T44] napi_disable_locked+0x3c0/0x5d0 [ 984.536691][ T44] ? __pfx_napi_disable_locked+0x10/0x10 [ 984.536960][ T44] napi_disable+0x43/0x80 [ 984.537166][ T44] virtnet_close+0x3b3/0x5c0 [ 984.537434][ T44] __dev_close_many+0x1ae/0x670 [ 984.537711][ T44] ? preempt_schedule_common+0x44/0xb0 [ 984.537965][ T44] ? __pfx___dev_close_many+0x10/0x10 [ 984.538238][ T44] __dev_change_flags+0x24e/0x6c0 [ 984.538498][ T44] ? __pfx___dev_change_flags+0x10/0x10 [ 984.538808][ T44] ? is_bpf_text_address+0x67/0x120 [ 984.539109][ T44] netif_change_flags+0x80/0x160 [ 984.539400][ T44] ? kernel_text_address+0xce/0xe0 [ 984.539684][ T44] do_setlink.constprop.0+0x98a/0x2650 [ 984.539935][ T44] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 984.540315][ T44] ? rcu_read_lock_any_held+0x43/0xb0 [ 984.540605][ T44] ? validate_chain+0x166/0x4d0 [ 984.540862][ T44] ? __kernel_text_address+0x12/0x40 [ 984.541119][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.541366][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 984.541623][ T44] ? __pfx___mutex_trylock_common+0x10/0x10 [ 984.541916][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.542171][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.542403][ T44] ? trace_contention_end+0xdc/0x140 [ 984.542649][ T44] ? __mutex_lock+0x19c/0xcd0 [ 984.542887][ T44] ? find_held_lock+0x2b/0x80 [ 984.543138][ T44] ? rtnl_newlink+0x651/0xa60 [ 984.543416][ T44] ? __create_object+0x5e/0xb0 [ 984.543672][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 984.543912][ T44] ? trace_cap_capable+0x10f/0x190 [ 984.544257][ T44] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 984.544754][ T44] ? __rtnl_newlink+0x40e/0xa40 [ 984.545143][ T44] rtnl_newlink+0x69a/0xa60 [ 984.545827][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 984.546204][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.546652][ T44] ? find_held_lock+0x2b/0x80 [ 984.547042][ T44] ? rtnetlink_rcv_msg+0x6ed/0xc00 [ 984.547420][ T44] ? __lock_release+0x5d/0x170 [ 984.547851][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 984.548250][ T44] rtnetlink_rcv_msg+0x710/0xc00 [ 984.548685][ T44] ? validate_chain+0x166/0x4d0 [ 984.549034][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 984.549426][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.549870][ T44] netlink_rcv_skb+0x121/0x350 [ 984.550281][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 984.550978][ T44] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 984.551401][ T44] ? netlink_deliver_tap+0x13e/0x340 [ 984.551804][ T44] ? netlink_deliver_tap+0xc3/0x340 [ 984.552205][ T44] netlink_unicast+0x4b6/0x790 [ 984.552863][ T44] ? __pfx_netlink_unicast+0x10/0x10 [ 984.553286][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.553713][ T44] netlink_sendmsg+0x721/0xbe0 [ 984.554122][ T44] ? __pfx_netlink_sendmsg+0x10/0x10 [ 984.554797][ T44] ? __import_iovec+0x238/0x3c0 [ 984.555215][ T44] ____sys_sendmsg+0x7ad/0xa10 [ 984.555634][ T44] ? __pfx_____sys_sendmsg+0x10/0x10 [ 984.556029][ T44] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 984.556850][ T44] ___sys_sendmsg+0xed/0x170 [ 984.557224][ T44] ? kasan_record_aux_stack+0x8c/0xa0 [ 984.557619][ T44] ? __call_rcu_common.constprop.0+0xa8/0x640 [ 984.558112][ T44] ? __pfx____sys_sendmsg+0x10/0x10 [ 984.558509][ T44] ? find_held_lock+0x2b/0x80 [ 984.558926][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.559333][ T44] ? find_held_lock+0x2b/0x80 [ 984.560015][ T44] ? __virt_addr_valid+0x22e/0x450 [ 984.560414][ T44] ? __lock_release+0x5d/0x170 [ 984.560870][ T44] __sys_sendmsg+0x10b/0x1a0 [ 984.561266][ T44] ? __call_rcu_common.constprop.0+0x320/0x640 [ 984.561907][ T44] ? __pfx___sys_sendmsg+0x10/0x10 [ 984.562325][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.562745][ T44] do_syscall_64+0xc1/0x380 [ 984.563137][ T44] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 984.563973][ T44] RIP: 0033:0x7fa4e4e7d1e7 [ 984.564390][ T44] RSP: 002b:00007fff678a4348 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 984.565042][ T44] RAX: ffffffffffffffda RBX: 00007fff678a4a70 RCX: 00007fa4e4e7d1e7 [ 984.565885][ T44] RDX: 0000000000000000 RSI: 00007fff678a43b0 RDI: 0000000000000003 [ 984.566472][ T44] RBP: 0000000000000003 R08: 0000000000000003 R09: 0000000000000078 [ 984.567115][ T44] R10: 00007fa4e4d7aee8 R11: 0000000000000246 R12: 0000000000000003 [ 984.568009][ T44] R13: 0000000068817d05 R14: 0000000000499600 R15: 0000000000000000 [ 984.568697][ T44] [ 984.569021][ T44] INFO: task ip:1703 blocked for more than 245 seconds. [ 984.569483][ T44] Not tainted 6.16.0-rc6-virtme #1 [ 984.569719][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 984.570219][ T44] task:ip state:D stack:26032 pid:1703 tgid:1703 ppid:1686 task_flags:0x400100 flags:0x00004002 [ 984.570999][ T44] Call Trace: [ 984.571246][ T44] [ 984.571379][ T44] __schedule+0x862/0x1b00 [ 984.571708][ T44] ? __pfx___schedule+0x10/0x10 [ 984.572233][ T44] ? schedule+0x1ee/0x270 [ 984.572465][ T44] ? __lock_release+0x5d/0x170 [ 984.572847][ T44] schedule+0xe2/0x270 [ 984.573150][ T44] schedule_preempt_disabled+0x18/0x30 [ 984.573641][ T44] __mutex_lock+0x77f/0xcd0 [ 984.573983][ T44] ? rtnetlink_rcv_msg+0x2ae/0xc00 [ 984.574403][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 984.574876][ T44] ? rtnetlink_rcv_msg+0x296/0xc00 [ 984.575213][ T44] ? __lock_release+0x5d/0x170 [ 984.575529][ T44] ? rtnetlink_rcv_msg+0x2ae/0xc00 [ 984.575822][ T44] rtnetlink_rcv_msg+0x2ae/0xc00 [ 984.576131][ T44] ? validate_chain+0x166/0x4d0 [ 984.576679][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 984.577027][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.577352][ T44] netlink_rcv_skb+0x121/0x350 [ 984.577684][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 984.578032][ T44] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 984.578465][ T44] ? netlink_deliver_tap+0x13e/0x340 [ 984.578898][ T44] ? netlink_deliver_tap+0xc3/0x340 [ 984.579329][ T44] netlink_unicast+0x4b6/0x790 [ 984.579804][ T44] ? __pfx_netlink_unicast+0x10/0x10 [ 984.580136][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.580468][ T44] netlink_sendmsg+0x721/0xbe0 [ 984.580846][ T44] ? __pfx_netlink_sendmsg+0x10/0x10 [ 984.581209][ T44] ? __import_iovec+0x238/0x3c0 [ 984.581548][ T44] ____sys_sendmsg+0x7ad/0xa10 [ 984.581873][ T44] ? __pfx_____sys_sendmsg+0x10/0x10 [ 984.582256][ T44] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 984.582851][ T44] ___sys_sendmsg+0xed/0x170 [ 984.583257][ T44] ? __pfx____sys_sendmsg+0x10/0x10 [ 984.583663][ T44] ? __pfx_handle_pte_fault+0x10/0x10 [ 984.583952][ T44] ? mt_find+0x2b2/0x3c0 [ 984.584359][ T44] ? __handle_mm_fault+0x3fc/0x5e0 [ 984.584676][ T44] ? __pfx___handle_mm_fault+0x10/0x10 [ 984.584929][ T44] ? mt_find+0x2bc/0x3c0 [ 984.585161][ T44] __sys_sendmsg+0x10b/0x1a0 [ 984.585481][ T44] ? __pfx___sys_sendmsg+0x10/0x10 [ 984.585737][ T44] ? do_user_addr_fault+0x38d/0xe00 [ 984.585996][ T44] ? do_user_addr_fault+0x38d/0xe00 [ 984.586247][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.586490][ T44] do_syscall_64+0xc1/0x380 [ 984.586980][ T44] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 984.587366][ T44] RIP: 0033:0x7f7bcf2c31e7 [ 984.587627][ T44] RSP: 002b:00007fffc64ca908 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 984.588105][ T44] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f7bcf2c31e7 [ 984.588599][ T44] RDX: 0000000000000000 RSI: 00007fffc64ca970 RDI: 0000000000000006 [ 984.589021][ T44] RBP: 00007fffc64caa60 R08: 0000000000000001 R09: 00007f7bcf4970c0 [ 984.589387][ T44] R10: 00007f7bcf1bb6f8 R11: 0000000000000246 R12: 00007fffc64cc93b [ 984.589831][ T44] R13: 0000000068817dd9 R14: 00007fffc64caa20 R15: 000000000000000d [ 984.590218][ T44] [ 984.590445][ T44] INFO: task ip:1703 is blocked on a mutex likely owned by task ip:1638. [ 984.590792][ T44] task:ip state:D stack:24976 pid:1638 tgid:1638 ppid:1 task_flags:0x400100 flags:0x00004006 [ 984.591820][ T44] Call Trace: [ 984.592114][ T44] [ 984.592328][ T44] __schedule+0x862/0x1b00 [ 984.592645][ T44] ? __pfx___schedule+0x10/0x10 [ 984.592982][ T44] ? schedule+0x1ee/0x270 [ 984.593403][ T44] ? __lock_release+0x5d/0x170 [ 984.593721][ T44] schedule+0xe2/0x270 [ 984.593908][ T44] schedule_hrtimeout_range_clock+0x100/0x2d0 [ 984.594463][ T44] ? __pfx_schedule_hrtimeout_range_clock+0x10/0x10 [ 984.594914][ T44] ? find_held_lock+0x2b/0x80 [ 984.595173][ T44] ? __pfx_hrtimer_wakeup+0x10/0x10 [ 984.595412][ T44] ? ktime_get+0x178/0x200 [ 984.595933][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 984.596208][ T44] ? ktime_get+0xbb/0x200 [ 984.596413][ T44] usleep_range_state+0x141/0x1d0 [ 984.596702][ T44] ? __pfx_usleep_range_state+0x10/0x10 [ 984.596971][ T44] napi_disable_locked+0x3c0/0x5d0 [ 984.597517][ T44] ? __pfx_napi_disable_locked+0x10/0x10 [ 984.597803][ T44] napi_disable+0x43/0x80 [ 984.598069][ T44] virtnet_close+0x3b3/0x5c0 [ 984.598513][ T44] __dev_close_many+0x1ae/0x670 [ 984.598931][ T44] ? preempt_schedule_common+0x44/0xb0 [ 984.599247][ T44] ? __pfx___dev_close_many+0x10/0x10 [ 984.599562][ T44] __dev_change_flags+0x24e/0x6c0 [ 984.599854][ T44] ? __pfx___dev_change_flags+0x10/0x10 [ 984.600120][ T44] ? is_bpf_text_address+0x67/0x120 [ 984.600387][ T44] netif_change_flags+0x80/0x160 [ 984.600714][ T44] ? kernel_text_address+0xce/0xe0 [ 984.601029][ T44] do_setlink.constprop.0+0x98a/0x2650 [ 984.601444][ T44] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 984.601781][ T44] ? rcu_read_lock_any_held+0x43/0xb0 [ 984.602078][ T44] ? validate_chain+0x166/0x4d0 [ 984.602400][ T44] ? __kernel_text_address+0x12/0x40 [ 984.602715][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.603027][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 984.603377][ T44] ? __pfx___mutex_trylock_common+0x10/0x10 [ 984.603888][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.604148][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.604466][ T44] ? trace_contention_end+0xdc/0x140 [ 984.604730][ T44] ? __mutex_lock+0x19c/0xcd0 [ 984.605003][ T44] ? find_held_lock+0x2b/0x80 [ 984.605441][ T44] ? rtnl_newlink+0x651/0xa60 [ 984.605731][ T44] ? __create_object+0x5e/0xb0 [ 984.606101][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 984.606453][ T44] ? trace_cap_capable+0x10f/0x190 [ 984.606757][ T44] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 984.607114][ T44] ? __rtnl_newlink+0x40e/0xa40 [ 984.607364][ T44] rtnl_newlink+0x69a/0xa60 [ 984.607765][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 984.608009][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.608267][ T44] ? find_held_lock+0x2b/0x80 [ 984.608508][ T44] ? rtnetlink_rcv_msg+0x6ed/0xc00 [ 984.608771][ T44] ? __lock_release+0x5d/0x170 [ 984.609030][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 984.609353][ T44] rtnetlink_rcv_msg+0x710/0xc00 [ 984.609604][ T44] ? validate_chain+0x166/0x4d0 [ 984.610011][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 984.610258][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.610508][ T44] netlink_rcv_skb+0x121/0x350 [ 984.610772][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 984.611106][ T44] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 984.611405][ T44] ? netlink_deliver_tap+0x13e/0x340 [ 984.611657][ T44] ? netlink_deliver_tap+0xc3/0x340 [ 984.611912][ T44] netlink_unicast+0x4b6/0x790 [ 984.612239][ T44] ? __pfx_netlink_unicast+0x10/0x10 [ 984.612604][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.612893][ T44] netlink_sendmsg+0x721/0xbe0 [ 984.613190][ T44] ? __pfx_netlink_sendmsg+0x10/0x10 [ 984.613608][ T44] ? __import_iovec+0x238/0x3c0 [ 984.613943][ T44] ____sys_sendmsg+0x7ad/0xa10 [ 984.614276][ T44] ? __pfx_____sys_sendmsg+0x10/0x10 [ 984.614511][ T44] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 984.614923][ T44] ___sys_sendmsg+0xed/0x170 [ 984.615170][ T44] ? kasan_record_aux_stack+0x8c/0xa0 [ 984.615421][ T44] ? __call_rcu_common.constprop.0+0xa8/0x640 [ 984.615849][ T44] ? __pfx____sys_sendmsg+0x10/0x10 [ 984.616128][ T44] ? find_held_lock+0x2b/0x80 [ 984.616371][ T44] ? __lock_acquire+0x44d/0x7e0 [ 984.616753][ T44] ? find_held_lock+0x2b/0x80 [ 984.617103][ T44] ? __virt_addr_valid+0x22e/0x450 [ 984.617428][ T44] ? __lock_release+0x5d/0x170 [ 984.617729][ T44] __sys_sendmsg+0x10b/0x1a0 [ 984.618074][ T44] ? __call_rcu_common.constprop.0+0x320/0x640 [ 984.618379][ T44] ? __pfx___sys_sendmsg+0x10/0x10 [ 984.618788][ T44] ? rcu_is_watching+0x12/0xc0 [ 984.619046][ T44] do_syscall_64+0xc1/0x380 [ 984.619396][ T44] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 984.619925][ T44] RIP: 0033:0x7fa4e4e7d1e7 [ 984.620264][ T44] RSP: 002b:00007fff678a4348 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 984.620657][ T44] RAX: ffffffffffffffda RBX: 00007fff678a4a70 RCX: 00007fa4e4e7d1e7 [ 984.621320][ T44] RDX: 0000000000000000 RSI: 00007fff678a43b0 RDI: 0000000000000003 [ 984.621734][ T44] RBP: 0000000000000003 R08: 0000000000000003 R09: 0000000000000078 [ 984.622217][ T44] R10: 00007fa4e4d7aee8 R11: 0000000000000246 R12: 0000000000000003 [ 984.622747][ T44] R13: 0000000068817d05 R14: 0000000000499600 R15: 0000000000000000 [ 984.623228][ T44] [ 984.623562][ T44] [ 984.623562][ T44] Showing all locks held in the system: [ 984.624150][ T44] 3 locks held by kworker/u16:0/12: [ 984.624475][ T44] #0: ffff88800939e548 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1660 [ 984.625079][ T44] #1: ffffc900000c7d40 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xdf6/0x1660 [ 984.625742][ T44] #2: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 984.626191][ T44] 1 lock held by khungtaskd/44: [ 984.626494][ T44] #0: ffffffffb75796a0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 984.627166][ T44] 3 locks held by kworker/1:2/413: [ 984.627472][ T44] #0: ffff8880010a9548 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1660 [ 984.627969][ T44] #1: ffffc90001a97d40 ((work_completion)(&vi->rx_mode_work)){+.+.}-{0:0}, at: process_one_work+0xdf6/0x1660 [ 984.628703][ T44] #2: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: virtnet_rx_mode_work+0x145/0x860 [ 984.629205][ T44] 2 locks held by ip/1638: [ 984.629507][ T44] #0: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x651/0xa60 [ 984.629956][ T44] #1: ffff888008eb2c80 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 984.630651][ T44] 1 lock held by ip/1703: [ 984.631180][ T44] #0: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ae/0xc00 [ 984.631962][ T44] [ 984.632163][ T44] ============================================= [ 984.632163][ T44] [ 1107.363621][ T44] INFO: task kworker/u16:0:12 blocked for more than 491 seconds. [ 1107.364180][ T44] Not tainted 6.16.0-rc6-virtme #1 [ 1107.364445][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1107.364903][ T44] task:kworker/u16:0 state:D stack:27024 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00004000 [ 1107.365487][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 1107.365824][ T44] Call Trace: [ 1107.366015][ T44] [ 1107.366177][ T44] __schedule+0x862/0x1b00 [ 1107.366466][ T44] ? __pfx___schedule+0x10/0x10 [ 1107.366811][ T44] ? schedule+0x1ee/0x270 [ 1107.367023][ T44] ? __lock_release+0x5d/0x170 [ 1107.367290][ T44] schedule+0xe2/0x270 [ 1107.367532][ T44] schedule_preempt_disabled+0x18/0x30 [ 1107.367801][ T44] __mutex_lock+0x77f/0xcd0 [ 1107.368057][ T44] ? validate_chain+0x166/0x4d0 [ 1107.368318][ T44] ? addrconf_verify_work+0x12/0x30 [ 1107.368604][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 1107.368907][ T44] ? rcu_is_watching+0x12/0xc0 [ 1107.369167][ T44] ? addrconf_verify_work+0x12/0x30 [ 1107.369440][ T44] addrconf_verify_work+0x12/0x30 [ 1107.369709][ T44] process_one_work+0xe40/0x1660 [ 1107.370028][ T44] ? __pfx_process_one_work+0x10/0x10 [ 1107.370293][ T44] ? assign_work+0x16c/0x240 [ 1107.370549][ T44] worker_thread+0x591/0xcf0 [ 1107.370846][ T44] ? __pfx_worker_thread+0x10/0x10 [ 1107.371108][ T44] kthread+0x37e/0x600 [ 1107.371291][ T44] ? __pfx_kthread+0x10/0x10 [ 1107.371554][ T44] ? ret_from_fork+0x1b/0x320 [ 1107.371843][ T44] ? __lock_release+0x5d/0x170 [ 1107.372115][ T44] ? rcu_is_watching+0x12/0xc0 [ 1107.372402][ T44] ? __pfx_kthread+0x10/0x10 [ 1107.372726][ T44] ret_from_fork+0x240/0x320 [ 1107.373015][ T44] ? __pfx_kthread+0x10/0x10 [ 1107.373293][ T44] ret_from_fork_asm+0x1a/0x30 [ 1107.373588][ T44] [ 1107.373844][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:1638. [ 1107.374288][ T44] task:ip state:D stack:24976 pid:1638 tgid:1638 ppid:1 task_flags:0x400100 flags:0x00004006 [ 1107.374892][ T44] Call Trace: [ 1107.375070][ T44] [ 1107.375215][ T44] __schedule+0x862/0x1b00 [ 1107.375515][ T44] ? __pfx___schedule+0x10/0x10 [ 1107.375785][ T44] ? schedule+0x1ee/0x270 [ 1107.375964][ T44] ? __lock_release+0x5d/0x170 [ 1107.376257][ T44] schedule+0xe2/0x270 [ 1107.376490][ T44] schedule_hrtimeout_range_clock+0x100/0x2d0 [ 1107.376859][ T44] ? __pfx_schedule_hrtimeout_range_clock+0x10/0x10 [ 1107.377182][ T44] ? find_held_lock+0x2b/0x80 [ 1107.377467][ T44] ? __pfx_hrtimer_wakeup+0x10/0x10 [ 1107.377740][ T44] ? ktime_get+0x178/0x200 [ 1107.378012][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 1107.378268][ T44] ? ktime_get+0xbb/0x200 [ 1107.378452][ T44] usleep_range_state+0x141/0x1d0 [ 1107.378714][ T44] ? __pfx_usleep_range_state+0x10/0x10 [ 1107.378974][ T44] napi_disable_locked+0x3c0/0x5d0 [ 1107.379243][ T44] ? __pfx_napi_disable_locked+0x10/0x10 [ 1107.379513][ T44] napi_disable+0x43/0x80 [ 1107.379728][ T44] virtnet_close+0x3b3/0x5c0 [ 1107.380003][ T44] __dev_close_many+0x1ae/0x670 [ 1107.380275][ T44] ? preempt_schedule_common+0x44/0xb0 [ 1107.380547][ T44] ? __pfx___dev_close_many+0x10/0x10 [ 1107.380845][ T44] __dev_change_flags+0x24e/0x6c0 [ 1107.381143][ T44] ? __pfx___dev_change_flags+0x10/0x10 [ 1107.381396][ T44] ? is_bpf_text_address+0x67/0x120 [ 1107.381664][ T44] netif_change_flags+0x80/0x160 [ 1107.381946][ T44] ? kernel_text_address+0xce/0xe0 [ 1107.382217][ T44] do_setlink.constprop.0+0x98a/0x2650 [ 1107.382496][ T44] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 1107.382834][ T44] ? rcu_read_lock_any_held+0x43/0xb0 [ 1107.383117][ T44] ? validate_chain+0x166/0x4d0 [ 1107.383368][ T44] ? __kernel_text_address+0x12/0x40 [ 1107.383634][ T44] ? __lock_acquire+0x44d/0x7e0 [ 1107.383905][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 1107.384175][ T44] ? __pfx___mutex_trylock_common+0x10/0x10 [ 1107.384484][ T44] ? rcu_is_watching+0x12/0xc0 [ 1107.384769][ T44] ? rcu_is_watching+0x12/0xc0 [ 1107.385040][ T44] ? trace_contention_end+0xdc/0x140 [ 1107.385303][ T44] ? __mutex_lock+0x19c/0xcd0 [ 1107.385586][ T44] ? find_held_lock+0x2b/0x80 [ 1107.385855][ T44] ? rtnl_newlink+0x651/0xa60 [ 1107.386148][ T44] ? __create_object+0x5e/0xb0 [ 1107.386441][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 1107.386719][ T44] ? trace_cap_capable+0x10f/0x190 [ 1107.386992][ T44] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 1107.387321][ T44] ? __rtnl_newlink+0x40e/0xa40 [ 1107.387612][ T44] rtnl_newlink+0x69a/0xa60 [ 1107.387880][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 1107.388141][ T44] ? __lock_acquire+0x44d/0x7e0 [ 1107.388411][ T44] ? find_held_lock+0x2b/0x80 [ 1107.388692][ T44] ? rtnetlink_rcv_msg+0x6ed/0xc00 [ 1107.388958][ T44] ? __lock_release+0x5d/0x170 [ 1107.389234][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 1107.389497][ T44] rtnetlink_rcv_msg+0x710/0xc00 [ 1107.389770][ T44] ? validate_chain+0x166/0x4d0 [ 1107.390028][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1107.390293][ T44] ? __lock_acquire+0x44d/0x7e0 [ 1107.390551][ T44] netlink_rcv_skb+0x121/0x350 [ 1107.390826][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1107.391084][ T44] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 1107.391370][ T44] ? netlink_deliver_tap+0x13e/0x340 [ 1107.391632][ T44] ? netlink_deliver_tap+0xc3/0x340 [ 1107.391899][ T44] netlink_unicast+0x4b6/0x790 [ 1107.392164][ T44] ? __pfx_netlink_unicast+0x10/0x10 [ 1107.392442][ T44] ? __lock_acquire+0x44d/0x7e0 [ 1107.392728][ T44] netlink_sendmsg+0x721/0xbe0 [ 1107.392994][ T44] ? __pfx_netlink_sendmsg+0x10/0x10 [ 1107.393266][ T44] ? __import_iovec+0x238/0x3c0 [ 1107.393550][ T44] ____sys_sendmsg+0x7ad/0xa10 [ 1107.393831][ T44] ? __pfx_____sys_sendmsg+0x10/0x10 [ 1107.394089][ T44] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 1107.394425][ T44] ___sys_sendmsg+0xed/0x170 [ 1107.394698][ T44] ? kasan_record_aux_stack+0x8c/0xa0 [ 1107.394961][ T44] ? __call_rcu_common.constprop.0+0xa8/0x640 [ 1107.395302][ T44] ? __pfx____sys_sendmsg+0x10/0x10 [ 1107.395590][ T44] ? find_held_lock+0x2b/0x80 [ 1107.395865][ T44] ? __lock_acquire+0x44d/0x7e0 [ 1107.396138][ T44] ? find_held_lock+0x2b/0x80 [ 1107.396410][ T44] ? __virt_addr_valid+0x22e/0x450 [ 1107.396698][ T44] ? __lock_release+0x5d/0x170 [ 1107.396978][ T44] __sys_sendmsg+0x10b/0x1a0 [ 1107.397249][ T44] ? __call_rcu_common.constprop.0+0x320/0x640 [ 1107.397588][ T44] ? __pfx___sys_sendmsg+0x10/0x10 [ 1107.397873][ T44] ? rcu_is_watching+0x12/0xc0 [ 1107.398146][ T44] do_syscall_64+0xc1/0x380 [ 1107.398418][ T44] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1107.398752][ T44] RIP: 0033:0x7fa4e4e7d1e7 [ 1107.399034][ T44] RSP: 002b:00007fff678a4348 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 1107.399443][ T44] RAX: ffffffffffffffda RBX: 00007fff678a4a70 RCX: 00007fa4e4e7d1e7 [ 1107.399844][ T44] RDX: 0000000000000000 RSI: 00007fff678a43b0 RDI: 0000000000000003 [ 1107.400239][ T44] RBP: 0000000000000003 R08: 0000000000000003 R09: 0000000000000078 [ 1107.400651][ T44] R10: 00007fa4e4d7aee8 R11: 0000000000000246 R12: 0000000000000003 [ 1107.401054][ T44] R13: 0000000068817d05 R14: 0000000000499600 R15: 0000000000000000 [ 1107.401468][ T44] [ 1107.401718][ T44] INFO: task kworker/1:2:413 blocked for more than 491 seconds. [ 1107.402087][ T44] Not tainted 6.16.0-rc6-virtme #1 [ 1107.402361][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1107.402800][ T44] task:kworker/1:2 state:D stack:27744 pid:413 tgid:413 ppid:2 task_flags:0x4208060 flags:0x00004000 [ 1107.403379][ T44] Workqueue: events virtnet_rx_mode_work [ 1107.403662][ T44] Call Trace: [ 1107.403855][ T44] [ 1107.404005][ T44] __schedule+0x862/0x1b00 [ 1107.404286][ T44] ? __pfx___schedule+0x10/0x10 [ 1107.404590][ T44] ? schedule+0x1ee/0x270 [ 1107.404801][ T44] ? __lock_release+0x5d/0x170 [ 1107.405087][ T44] schedule+0xe2/0x270 [ 1107.405296][ T44] schedule_preempt_disabled+0x18/0x30 [ 1107.405580][ T44] __mutex_lock+0x77f/0xcd0 [ 1107.405857][ T44] ? virtnet_rx_mode_work+0x145/0x860 [ 1107.406123][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 1107.406386][ T44] ? mark_held_locks+0x49/0x80 [ 1107.406658][ T44] ? lockdep_hardirqs_on+0x7c/0x110 [ 1107.406940][ T44] ? rcu_is_watching+0x12/0xc0 [ 1107.407213][ T44] ? trace_kmalloc+0x2a/0xe0 [ 1107.407482][ T44] ? __kmalloc_cache_noprof+0x15f/0x360 [ 1107.407763][ T44] ? virtnet_rx_mode_work+0x145/0x860 [ 1107.408029][ T44] virtnet_rx_mode_work+0x145/0x860 [ 1107.408298][ T44] ? __lock_acquire+0x44d/0x7e0 [ 1107.408597][ T44] ? __pfx_virtnet_rx_mode_work+0x10/0x10 [ 1107.408881][ T44] ? rcu_is_watching+0x12/0xc0 [ 1107.409154][ T44] ? rcu_is_watching+0x12/0xc0 [ 1107.409425][ T44] process_one_work+0xe40/0x1660 [ 1107.409715][ T44] ? __pfx_process_one_work+0x10/0x10 [ 1107.409993][ T44] ? assign_work+0x16c/0x240 [ 1107.410267][ T44] worker_thread+0x591/0xcf0 [ 1107.410545][ T44] ? __pfx_worker_thread+0x10/0x10 [ 1107.410820][ T44] kthread+0x37e/0x600 [ 1107.411039][ T44] ? __pfx_kthread+0x10/0x10 [ 1107.411304][ T44] ? ret_from_fork+0x1b/0x320 [ 1107.411583][ T44] ? __lock_release+0x5d/0x170 [ 1107.411854][ T44] ? rcu_is_watching+0x12/0xc0 [ 1107.412126][ T44] ? __pfx_kthread+0x10/0x10 [ 1107.412404][ T44] ret_from_fork+0x240/0x320 [ 1107.412685][ T44] ? __pfx_kthread+0x10/0x10 [ 1107.412952][ T44] ret_from_fork_asm+0x1a/0x30 [ 1107.413254][ T44] [ 1107.413504][ T44] INFO: task kworker/1:2:413 is blocked on a mutex likely owned by task ip:1638. [ 1107.413947][ T44] task:ip state:D stack:24976 pid:1638 tgid:1638 ppid:1 task_flags:0x400100 flags:0x00004006 [ 1107.414524][ T44] Call Trace: [ 1107.414742][ T44] [ 1107.414874][ T44] __schedule+0x862/0x1b00 [ 1107.415151][ T44] ? __pfx___schedule+0x10/0x10 [ 1107.415432][ T44] ? schedule+0x1ee/0x270 [ 1107.415643][ T44] ? __lock_release+0x5d/0x170 [ 1107.415920][ T44] schedule+0xe2/0x270 [ 1107.416130][ T44] schedule_hrtimeout_range_clock+0x100/0x2d0 [ 1107.416464][ T44] ? __pfx_schedule_hrtimeout_range_clock+0x10/0x10 [ 1107.416810][ T44] ? find_held_lock+0x2b/0x80 [ 1107.417083][ T44] ? __pfx_hrtimer_wakeup+0x10/0x10 [ 1107.417365][ T44] ? ktime_get+0x178/0x200 [ 1107.417642][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 1107.417911][ T44] ? ktime_get+0xbb/0x200 [ 1107.418106][ T44] usleep_range_state+0x141/0x1d0 [ 1107.418394][ T44] ? __pfx_usleep_range_state+0x10/0x10 [ 1107.418674][ T44] napi_disable_locked+0x3c0/0x5d0 [ 1107.418948][ T44] ? __pfx_napi_disable_locked+0x10/0x10 [ 1107.419236][ T44] napi_disable+0x43/0x80 [ 1107.419445][ T44] virtnet_close+0x3b3/0x5c0 [ 1107.419732][ T44] __dev_close_many+0x1ae/0x670 [ 1107.420005][ T44] ? preempt_schedule_common+0x44/0xb0 [ 1107.420275][ T44] ? __pfx___dev_close_many+0x10/0x10 [ 1107.420552][ T44] __dev_change_flags+0x24e/0x6c0 [ 1107.420837][ T44] ? __pfx___dev_change_flags+0x10/0x10 [ 1107.421111][ T44] ? is_bpf_text_address+0x67/0x120 [ 1107.421389][ T44] netif_change_flags+0x80/0x160 [ 1107.421659][ T44] ? kernel_text_address+0xce/0xe0 [ 1107.421932][ T44] do_setlink.constprop.0+0x98a/0x2650 [ 1107.422207][ T44] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 1107.422558][ T44] ? rcu_read_lock_any_held+0x43/0xb0 [ 1107.422853][ T44] ? validate_chain+0x166/0x4d0 [ 1107.423133][ T44] ? __kernel_text_address+0x12/0x40 [ 1107.423405][ T44] ? __lock_acquire+0x44d/0x7e0 [ 1107.423681][ T44] ? __mutex_trylock_common+0xf9/0x260 [ 1107.423951][ T44] ? __pfx___mutex_trylock_common+0x10/0x10 [ 1107.424279][ T44] ? rcu_is_watching+0x12/0xc0 [ 1107.424718][ T44] ? rcu_is_watching+0x12/0xc0 [ 1107.424988][ T44] ? trace_contention_end+0xdc/0x140 [ 1107.425268][ T44] ? __mutex_lock+0x19c/0xcd0 [ 1107.425537][ T44] ? find_held_lock+0x2b/0x80 [ 1107.425953][ T44] ? rtnl_newlink+0x651/0xa60 [ 1107.426220][ T44] ? __create_object+0x5e/0xb0 [ 1107.426489][ T44] ? __pfx___mutex_lock+0x10/0x10 [ 1107.426761][ T44] ? trace_cap_capable+0x10f/0x190 [ 1107.427177][ T44] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 1107.427515][ T44] ? __rtnl_newlink+0x40e/0xa40 [ 1107.427796][ T44] rtnl_newlink+0x69a/0xa60 [ 1107.428073][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 1107.428481][ T44] ? __lock_acquire+0x44d/0x7e0 [ 1107.428769][ T44] ? find_held_lock+0x2b/0x80 [ 1107.429042][ T44] ? rtnetlink_rcv_msg+0x6ed/0xc00 [ 1107.429305][ T44] ? __lock_release+0x5d/0x170 [ 1107.429727][ T44] ? __pfx_rtnl_newlink+0x10/0x10 [ 1107.430003][ T44] rtnetlink_rcv_msg+0x710/0xc00 [ 1107.430273][ T44] ? validate_chain+0x166/0x4d0 [ 1107.430540][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1107.430962][ T44] ? __lock_acquire+0x44d/0x7e0 [ 1107.431235][ T44] netlink_rcv_skb+0x121/0x350 [ 1107.431504][ T44] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1107.431776][ T44] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 1107.432200][ T44] ? netlink_deliver_tap+0x13e/0x340 [ 1107.432482][ T44] ? netlink_deliver_tap+0xc3/0x340 [ 1107.432763][ T44] netlink_unicast+0x4b6/0x790 [ 1107.433033][ T44] ? __pfx_netlink_unicast+0x10/0x10 [ 1107.433445][ T44] ? __lock_acquire+0x44d/0x7e0 [ 1107.433721][ T44] netlink_sendmsg+0x721/0xbe0 [ 1107.433992][ T44] ? __pfx_netlink_sendmsg+0x10/0x10 [ 1107.434258][ T44] ? __import_iovec+0x238/0x3c0 [ 1107.434695][ T44] ____sys_sendmsg+0x7ad/0xa10 [ 1107.434965][ T44] ? __pfx_____sys_sendmsg+0x10/0x10 [ 1107.435233][ T44] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 1107.435582][ T44] ___sys_sendmsg+0xed/0x170 [ 1107.435996][ T44] ? kasan_record_aux_stack+0x8c/0xa0 [ 1107.436263][ T44] ? __call_rcu_common.constprop.0+0xa8/0x640 [ 1107.436612][ T44] ? __pfx____sys_sendmsg+0x10/0x10 [ 1107.437071][ T44] ? find_held_lock+0x2b/0x80 [ 1107.437344][ T44] ? __lock_acquire+0x44d/0x7e0 [ 1107.437624][ T44] ? find_held_lock+0x2b/0x80 [ 1107.437894][ T44] ? __virt_addr_valid+0x22e/0x450 [ 1107.438326][ T44] ? __lock_release+0x5d/0x170 [ 1107.438606][ T44] __sys_sendmsg+0x10b/0x1a0 [ 1107.438870][ T44] ? __call_rcu_common.constprop.0+0x320/0x640 [ 1107.439202][ T44] ? __pfx___sys_sendmsg+0x10/0x10 [ 1107.439639][ T44] ? rcu_is_watching+0x12/0xc0 [ 1107.439909][ T44] do_syscall_64+0xc1/0x380 [ 1107.440177][ T44] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1107.440500][ T44] RIP: 0033:0x7fa4e4e7d1e7 [ 1107.440946][ T44] RSP: 002b:00007fff678a4348 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 1107.441342][ T44] RAX: ffffffffffffffda RBX: 00007fff678a4a70 RCX: 00007fa4e4e7d1e7 [ 1107.441746][ T44] RDX: 0000000000000000 RSI: 00007fff678a43b0 RDI: 0000000000000003 [ 1107.442285][ T44] RBP: 0000000000000003 R08: 0000000000000003 R09: 0000000000000078 [ 1107.442698][ T44] R10: 00007fa4e4d7aee8 R11: 0000000000000246 R12: 0000000000000003 [ 1107.443256][ T44] R13: 0000000068817d05 R14: 0000000000499600 R15: 0000000000000000 [ 1107.443676][ T44] [ 1107.443883][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings [ 1107.444533][ T44] [ 1107.444533][ T44] Showing all locks held in the system: [ 1107.445073][ T44] 3 locks held by kworker/u16:0/12: [ 1107.445338][ T44] #0: ffff88800939e548 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1660 [ 1107.445862][ T44] #1: ffffc900000c7d40 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xdf6/0x1660 [ 1107.446482][ T44] #2: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 1107.447087][ T44] 1 lock held by khungtaskd/44: [ 1107.447346][ T44] #0: ffffffffb75796a0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 1107.447813][ T44] 3 locks held by kworker/1:2/413: [ 1107.448204][ T44] #0: ffff8880010a9548 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1660 [ 1107.448723][ T44] #1: ffffc90001a97d40 ((work_completion)(&vi->rx_mode_work)){+.+.}-{0:0}, at: process_one_work+0xdf6/0x1660 [ 1107.449414][ T44] #2: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: virtnet_rx_mode_work+0x145/0x860 [ 1107.449877][ T44] 2 locks held by ip/1638: [ 1107.450135][ T44] #0: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x651/0xa60 [ 1107.450727][ T44] #1: ffff888008eb2c80 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 1107.451177][ T44] 1 lock held by ip/1703: [ 1107.451362][ T44] #0: ffffffffb7e56ca8 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ae/0xc00 [ 1107.451967][ T44] [ 1107.452095][ T44] ============================================= [ 1107.452095][ T44] WAIT TIMEOUT stderr Ctrl-C stderr Ctrl-C stderr