[ 27.029811][ T258] [ 27.029903][ T258] ===================================== [ 27.030034][ T258] WARNING: bad unlock balance detected! [ 27.030160][ T258] 6.12.0-rc5-virtme #1 Not tainted [ 27.030286][ T258] ------------------------------------- [ 27.030411][ T258] ip/258 is trying to release lock (rtnl_mutex) at: [ 27.030571][ T258] [] __rtnl_unlock+0x69/0xf0 [ 27.030733][ T258] but there are no more locks to release! [ 27.030858][ T258] [ 27.030858][ T258] other info that might help us debug this: [ 27.031049][ T258] no locks held by ip/258. [ 27.031175][ T258] [ 27.031175][ T258] stack backtrace: [ 27.031329][ T258] CPU: 0 UID: 0 PID: 258 Comm: ip Not tainted 6.12.0-rc5-virtme #1 [ 27.031518][ T258] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 27.031798][ T258] Call Trace: [ 27.031898][ T258] [ 27.031965][ T258] dump_stack_lvl+0x82/0xd0 [ 27.032096][ T258] ? __rtnl_unlock+0x69/0xf0 [ 27.032224][ T258] print_unlock_imbalance_bug+0x1aa/0x1f0 [ 27.032355][ T258] __lock_release+0x2f7/0x460 [ 27.032481][ T258] ? __pfx___lock_release+0x10/0x10 [ 27.032608][ T258] ? __rtnl_unlock+0x69/0xf0 [ 27.032736][ T258] lock_release+0xd7/0x140 [ 27.032863][ T258] __mutex_unlock_slowpath+0x8f/0x3b0 [ 27.032989][ T258] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 27.033116][ T258] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 27.033274][ T258] ? rtnl_link_ops_get+0x187/0x220 [ 27.033405][ T258] __rtnl_unlock+0x69/0xf0 [ 27.033532][ T258] rtnl_newlink+0x7fd/0xa30 [ 27.033659][ T258] ? __pfx_rtnl_newlink+0x10/0x10 [ 27.033784][ T258] ? find_held_lock+0x2c/0x110 [ 27.033915][ T258] ? __lock_release+0x103/0x460 [ 27.034041][ T258] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 27.034167][ T258] ? __pfx___lock_release+0x10/0x10 [ 27.034297][ T258] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 27.034425][ T258] ? __pfx_rtnl_newlink+0x10/0x10 [ 27.034552][ T258] rtnetlink_rcv_msg+0x712/0xc10 [ 27.034679][ T258] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 27.034806][ T258] ? hlock_class+0x4e/0x130 [ 27.034935][ T258] ? mark_lock+0x38/0x3e0 [ 27.035032][ T258] ? __lock_acquire+0xb3f/0x1580 [ 27.035160][ T258] netlink_rcv_skb+0x130/0x360 [ 27.035287][ T258] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 27.035415][ T258] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 27.035547][ T258] ? netlink_deliver_tap+0x13e/0x340 [ 27.035674][ T258] ? netlink_deliver_tap+0xc3/0x340 [ 27.035800][ T258] netlink_unicast+0x44b/0x710 [ 27.035927][ T258] ? __pfx_netlink_unicast+0x10/0x10 [ 27.036059][ T258] ? find_held_lock+0x2c/0x110 [ 27.036185][ T258] netlink_sendmsg+0x723/0xbe0 [ 27.036313][ T258] ? __pfx_netlink_sendmsg+0x10/0x10 [ 27.036441][ T258] ____sys_sendmsg+0x7ac/0xa10 [ 27.036568][ T258] ? __pfx_____sys_sendmsg+0x10/0x10 [ 27.036692][ T258] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 27.036848][ T258] ? hlock_class+0x4e/0x130 [ 27.036975][ T258] ? validate_chain+0x130/0x9b0 [ 27.037105][ T258] ___sys_sendmsg+0xee/0x170 [ 27.037233][ T258] ? __pfx_validate_chain+0x10/0x10 [ 27.037358][ T258] ? __pfx____sys_sendmsg+0x10/0x10 [ 27.037489][ T258] ? __lock_acquire+0xb3f/0x1580 [ 27.037619][ T258] ? find_held_lock+0x2c/0x110 [ 27.037745][ T258] ? __lock_release+0x103/0x460 [ 27.037869][ T258] ? __might_fault+0x11b/0x170 [ 27.037996][ T258] ? fdget+0x52/0x1e0 [ 27.038093][ T258] ? lock_acquire+0x32/0xc0 [ 27.038223][ T258] __sys_sendmsg+0xcd/0x170 [ 27.038350][ T258] ? __pfx___sys_sendmsg+0x10/0x10 [ 27.038484][ T258] ? rseq_update_cpu_node_id+0xe6/0x140 [ 27.038617][ T258] do_syscall_64+0xc1/0x1d0 [ 27.038745][ T258] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 27.038901][ T258] RIP: 0033:0x7f646dff87b7 [ 27.039033][ T258] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 27.039482][ T258] RSP: 002b:00007fffa4f4ec78 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 27.039672][ T258] RAX: ffffffffffffffda RBX: 00007fffa4f4f3a0 RCX: 00007f646dff87b7 [ 27.039860][ T258] RDX: 0000000000000000 RSI: 00007fffa4f4ece0 RDI: 0000000000000005 [ 27.040048][ T258] RBP: 0000000000000003 R08: 000000000000005c R09: 0000000000000002 [ 27.040238][ T258] R10: 00007f646deb1708 R11: 0000000000000246 R12: 00007fffa4f4f3b8 [ 27.040426][ T258] R13: 000000006729dcf2 R14: 0000000000496600 R15: 00007fffa4f4edc8 [ 27.040616][ T258] [ 247.092616][ T43] INFO: task ip:258 blocked for more than 122 seconds. [ 247.093163][ T43] Not tainted 6.12.0-rc5-virtme #1 [ 247.093284][ T43] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 247.093516][ T43] task:ip state:D stack:25792 pid:258 tgid:258 ppid:243 flags:0x00004002 [ 247.093768][ T43] Call Trace: [ 247.093861][ T43] [ 247.093927][ T43] __schedule+0xa19/0x1dc0 [ 247.094056][ T43] ? __pfx___schedule+0x10/0x10 [ 247.094179][ T43] ? trace_lock_acquire+0x14d/0x1f0 [ 247.094315][ T43] ? trace_lock_release+0x10e/0x180 [ 247.094439][ T43] schedule+0xdf/0x210 [ 247.094528][ T43] schedule_preempt_disabled+0x15/0x30 [ 247.094644][ T43] __mutex_lock+0x634/0xac0 [ 247.094769][ T43] ? rtnl_newlink+0x64b/0xa30 [ 247.094888][ T43] ? __pfx___mutex_lock+0x10/0x10 [ 247.095007][ T43] ? trace_lock_acquire+0x14d/0x1f0 [ 247.095126][ T43] ? rtnl_newlink+0x64b/0xa30 [ 247.095238][ T43] rtnl_newlink+0x64b/0xa30 [ 247.095365][ T43] ? __pfx_rtnl_newlink+0x10/0x10 [ 247.095482][ T43] ? find_held_lock+0x2c/0x110 [ 247.095602][ T43] ? __pfx___lock_release+0x10/0x10 [ 247.095719][ T43] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 247.095844][ T43] ? __pfx_rtnl_newlink+0x10/0x10 [ 247.095958][ T43] rtnetlink_rcv_msg+0x712/0xc10 [ 247.096072][ T43] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 247.096187][ T43] ? hlock_class+0x4e/0x130 [ 247.096308][ T43] ? mark_lock+0x38/0x3e0 [ 247.096399][ T43] ? __lock_acquire+0xb3f/0x1580 [ 247.096512][ T43] netlink_rcv_skb+0x130/0x360 [ 247.096630][ T43] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 247.096749][ T43] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 247.096869][ T43] ? netlink_deliver_tap+0x13e/0x340 [ 247.096983][ T43] ? netlink_deliver_tap+0xc3/0x340 [ 247.097097][ T43] netlink_unicast+0x44b/0x710 [ 247.097216][ T43] ? __pfx_netlink_unicast+0x10/0x10 [ 247.097337][ T43] ? find_held_lock+0x2c/0x110 [ 247.097454][ T43] netlink_sendmsg+0x723/0xbe0 [ 247.097571][ T43] ? __pfx_netlink_sendmsg+0x10/0x10 [ 247.097692][ T43] ____sys_sendmsg+0x7ac/0xa10 [ 247.097809][ T43] ? __pfx_____sys_sendmsg+0x10/0x10 [ 247.097925][ T43] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 247.098069][ T43] ? hlock_class+0x4e/0x130 [ 247.098184][ T43] ? validate_chain+0x130/0x9b0 [ 247.098307][ T43] ___sys_sendmsg+0xee/0x170 [ 247.098423][ T43] ? __pfx_validate_chain+0x10/0x10 [ 247.098538][ T43] ? __pfx____sys_sendmsg+0x10/0x10 [ 247.098659][ T43] ? __lock_acquire+0xb3f/0x1580 [ 247.098775][ T43] ? find_held_lock+0x2c/0x110 [ 247.098892][ T43] ? __lock_release+0x103/0x460 [ 247.099006][ T43] ? __might_fault+0x11b/0x170 [ 247.099122][ T43] ? fdget+0x52/0x1e0 [ 247.099209][ T43] ? lock_acquire+0x32/0xc0 [ 247.099335][ T43] __sys_sendmsg+0xcd/0x170 [ 247.099450][ T43] ? __pfx___sys_sendmsg+0x10/0x10 [ 247.099565][ T43] ? rseq_update_cpu_node_id+0xe6/0x140 [ 247.099692][ T43] do_syscall_64+0xc1/0x1d0 [ 247.099851][ T43] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 247.100000][ T43] RIP: 0033:0x7f646dff87b7 [ 247.100125][ T43] RSP: 002b:00007fffa4f4ec78 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 247.100308][ T43] RAX: ffffffffffffffda RBX: 00007fffa4f4f3a0 RCX: 00007f646dff87b7 [ 247.100497][ T43] RDX: 0000000000000000 RSI: 00007fffa4f4ece0 RDI: 0000000000000005 [ 247.100671][ T43] RBP: 0000000000000003 R08: 000000000000005c R09: 0000000000000002 [ 247.100843][ T43] R10: 00007f646deb1708 R11: 0000000000000246 R12: 00007fffa4f4f3b8 [ 247.101014][ T43] R13: 000000006729dcf2 R14: 0000000000496600 R15: 00007fffa4f4edc8 [ 247.101189][ T43] [ 247.101276][ T43] INFO: lockdep is turned off. [ 369.972499][ T43] INFO: task kworker/u16:0:11 blocked for more than 122 seconds. [ 369.973191][ T43] Not tainted 6.12.0-rc5-virtme #1 [ 369.973509][ T43] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 369.973703][ T43] task:kworker/u16:0 state:D stack:29560 pid:11 tgid:11 ppid:2 flags:0x00004000 [ 369.973943][ T43] Workqueue: ipv6_addrconf addrconf_verify_work [ 369.974102][ T43] Call Trace: [ 369.974195][ T43] [ 369.974263][ T43] __schedule+0xa19/0x1dc0 [ 369.974400][ T43] ? __pfx___schedule+0x10/0x10 [ 369.974519][ T43] ? trace_lock_acquire+0x14d/0x1f0 [ 369.974639][ T43] ? trace_lock_release+0x10e/0x180 [ 369.974754][ T43] schedule+0xdf/0x210 [ 369.974842][ T43] schedule_preempt_disabled+0x15/0x30 [ 369.974957][ T43] __mutex_lock+0x634/0xac0 [ 369.975076][ T43] ? do_raw_spin_unlock+0x58/0x220 [ 369.975194][ T43] ? addrconf_verify_work+0x12/0x30 [ 369.975313][ T43] ? __pfx___mutex_lock+0x10/0x10 [ 369.975428][ T43] ? trace_lock_acquire+0x14d/0x1f0 [ 369.975543][ T43] ? trace_lock_acquire+0x14d/0x1f0 [ 369.975660][ T43] ? addrconf_verify_work+0x12/0x30 [ 369.975773][ T43] addrconf_verify_work+0x12/0x30 [ 369.975887][ T43] process_one_work+0xe55/0x16d0 [ 369.976004][ T43] ? __pfx___lock_release+0x10/0x10 [ 369.976123][ T43] ? __pfx_process_one_work+0x10/0x10 [ 369.976237][ T43] ? assign_work+0x16c/0x240 [ 369.976363][ T43] worker_thread+0x58c/0xce0 [ 369.976480][ T43] ? __pfx_worker_thread+0x10/0x10 [ 369.976596][ T43] kthread+0x28a/0x350 [ 369.976683][ T43] ? __pfx_kthread+0x10/0x10 [ 369.976799][ T43] ret_from_fork+0x31/0x70 [ 369.976916][ T43] ? __pfx_kthread+0x10/0x10 [ 369.977032][ T43] ret_from_fork_asm+0x1a/0x30 [ 369.977153][ T43] [ 369.977256][ T43] INFO: task ip:258 blocked for more than 245 seconds. [ 369.977400][ T43] Not tainted 6.12.0-rc5-virtme #1 [ 369.977508][ T43] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 369.977697][ T43] task:ip state:D stack:25792 pid:258 tgid:258 ppid:243 flags:0x00004002 [ 369.977925][ T43] Call Trace: [ 369.978018][ T43] [ 369.978077][ T43] __schedule+0xa19/0x1dc0 [ 369.978195][ T43] ? __pfx___schedule+0x10/0x10 [ 369.978316][ T43] ? trace_lock_acquire+0x14d/0x1f0 [ 369.978432][ T43] ? trace_lock_release+0x10e/0x180 [ 369.978549][ T43] schedule+0xdf/0x210 [ 369.978635][ T43] schedule_preempt_disabled+0x15/0x30 [ 369.978749][ T43] __mutex_lock+0x634/0xac0 [ 369.978865][ T43] ? rtnl_newlink+0x64b/0xa30 [ 369.978992][ T43] ? __pfx___mutex_lock+0x10/0x10 [ 369.979111][ T43] ? trace_lock_acquire+0x14d/0x1f0 [ 369.979247][ T43] ? rtnl_newlink+0x64b/0xa30 [ 369.979367][ T43] rtnl_newlink+0x64b/0xa30 [ 369.979485][ T43] ? __pfx_rtnl_newlink+0x10/0x10 [ 369.979604][ T43] ? find_held_lock+0x2c/0x110 [ 369.979722][ T43] ? __pfx___lock_release+0x10/0x10 [ 369.979840][ T43] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 369.979959][ T43] ? __pfx_rtnl_newlink+0x10/0x10 [ 369.980076][ T43] rtnetlink_rcv_msg+0x712/0xc10 [ 369.980194][ T43] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 369.980317][ T43] ? hlock_class+0x4e/0x130 [ 369.980448][ T43] ? mark_lock+0x38/0x3e0 [ 369.980535][ T43] ? __lock_acquire+0xb3f/0x1580 [ 369.980652][ T43] netlink_rcv_skb+0x130/0x360 [ 369.980769][ T43] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 369.980882][ T43] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 369.981007][ T43] ? netlink_deliver_tap+0x13e/0x340 [ 369.981123][ T43] ? netlink_deliver_tap+0xc3/0x340 [ 369.981238][ T43] netlink_unicast+0x44b/0x710 [ 369.981364][ T43] ? __pfx_netlink_unicast+0x10/0x10 [ 369.981480][ T43] ? find_held_lock+0x2c/0x110 [ 369.981597][ T43] netlink_sendmsg+0x723/0xbe0 [ 369.981712][ T43] ? __pfx_netlink_sendmsg+0x10/0x10 [ 369.981829][ T43] ____sys_sendmsg+0x7ac/0xa10 [ 369.981954][ T43] ? __pfx_____sys_sendmsg+0x10/0x10 [ 369.982071][ T43] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 369.982215][ T43] ? hlock_class+0x4e/0x130 [ 369.982335][ T43] ? validate_chain+0x130/0x9b0 [ 369.982451][ T43] ___sys_sendmsg+0xee/0x170 [ 369.982566][ T43] ? __pfx_validate_chain+0x10/0x10 [ 369.982680][ T43] ? __pfx____sys_sendmsg+0x10/0x10 [ 369.982795][ T43] ? __lock_acquire+0xb3f/0x1580 [ 369.982916][ T43] ? find_held_lock+0x2c/0x110 [ 369.983030][ T43] ? __lock_release+0x103/0x460 [ 369.983144][ T43] ? __might_fault+0x11b/0x170 [ 369.983262][ T43] ? fdget+0x52/0x1e0 [ 369.983357][ T43] ? lock_acquire+0x32/0xc0 [ 369.983474][ T43] __sys_sendmsg+0xcd/0x170 [ 369.983590][ T43] ? __pfx___sys_sendmsg+0x10/0x10 [ 369.983704][ T43] ? rseq_update_cpu_node_id+0xe6/0x140 [ 369.983828][ T43] do_syscall_64+0xc1/0x1d0 [ 369.983947][ T43] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 369.984094][ T43] RIP: 0033:0x7f646dff87b7 [ 369.984214][ T43] RSP: 002b:00007fffa4f4ec78 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 369.984390][ T43] RAX: ffffffffffffffda RBX: 00007fffa4f4f3a0 RCX: 00007f646dff87b7 [ 369.984562][ T43] RDX: 0000000000000000 RSI: 00007fffa4f4ece0 RDI: 0000000000000005 [ 369.984735][ T43] RBP: 0000000000000003 R08: 000000000000005c R09: 0000000000000002 [ 369.984902][ T43] R10: 00007f646deb1708 R11: 0000000000000246 R12: 00007fffa4f4f3b8 [ 369.985073][ T43] R13: 000000006729dcf2 R14: 0000000000496600 R15: 00007fffa4f4edc8 [ 369.985245][ T43] [ 369.985337][ T43] INFO: lockdep is turned off. HARD STOP (392.538239) WAIT TIMEOUT stderr Ctrl-C stderr Ctrl-C stderr WAIT TIMEOUT stderr