[ 25.443528][ T233] [ 25.443625][ T233] ===================================== [ 25.443758][ T233] WARNING: bad unlock balance detected! [ 25.443896][ T233] 6.12.0-rc5-virtme #1 Not tainted [ 25.444024][ T233] ------------------------------------- [ 25.444146][ T233] restore_ipv4/233 is trying to release lock (rtnl_mutex) at: [ 25.444351][ T233] [] __rtnl_unlock+0x69/0xf0 [ 25.444517][ T233] but there are no more locks to release! [ 25.444646][ T233] [ 25.444646][ T233] other info that might help us debug this: [ 25.444829][ T233] no locks held by restore_ipv4/233. [ 25.444964][ T233] [ 25.444964][ T233] stack backtrace: [ 25.445119][ T233] CPU: 0 UID: 0 PID: 233 Comm: restore_ipv4 Not tainted 6.12.0-rc5-virtme #1 [ 25.445349][ T233] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 25.445635][ T233] Call Trace: [ 25.445742][ T233] [ 25.445812][ T233] dump_stack_lvl+0x82/0xd0 [ 25.445962][ T233] ? __rtnl_unlock+0x69/0xf0 [ 25.446094][ T233] print_unlock_imbalance_bug+0x1aa/0x1f0 [ 25.446224][ T233] __lock_release+0x2f7/0x460 [ 25.446356][ T233] ? __pfx___lock_release+0x10/0x10 [ 25.446496][ T233] ? __rtnl_unlock+0x69/0xf0 [ 25.446627][ T233] lock_release+0xd7/0x140 [ 25.446766][ T233] __mutex_unlock_slowpath+0x8f/0x3b0 [ 25.446904][ T233] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 25.447036][ T233] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 25.447194][ T233] ? rtnl_link_ops_get+0x187/0x220 [ 25.447323][ T233] __rtnl_unlock+0x69/0xf0 [ 25.447449][ T233] rtnl_newlink+0x7fd/0xa30 [ 25.447576][ T233] ? __pfx_rtnl_newlink+0x10/0x10 [ 25.447702][ T233] ? find_held_lock+0x2c/0x110 [ 25.447832][ T233] ? __lock_release+0x103/0x460 [ 25.447957][ T233] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 25.448084][ T233] ? __pfx___lock_release+0x10/0x10 [ 25.448228][ T233] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 25.448361][ T233] ? __pfx_rtnl_newlink+0x10/0x10 [ 25.448489][ T233] rtnetlink_rcv_msg+0x712/0xc10 [ 25.448617][ T233] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 25.448742][ T233] ? hlock_class+0x4e/0x130 [ 25.448870][ T233] ? mark_lock+0x38/0x3e0 [ 25.448970][ T233] ? __lock_acquire+0xb3f/0x1580 [ 25.449100][ T233] netlink_rcv_skb+0x130/0x360 [ 25.449228][ T233] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 25.449361][ T233] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 25.449494][ T233] ? netlink_deliver_tap+0x13e/0x340 [ 25.449624][ T233] ? netlink_deliver_tap+0xc3/0x340 [ 25.449752][ T233] netlink_unicast+0x44b/0x710 [ 25.449886][ T233] ? __pfx_netlink_unicast+0x10/0x10 [ 25.450013][ T233] ? netlink_autobind.isra.0+0xa5/0x270 [ 25.450139][ T233] ? netlink_autobind.isra.0+0x18a/0x270 [ 25.450280][ T233] netlink_sendmsg+0x723/0xbe0 [ 25.450412][ T233] ? __pfx_netlink_sendmsg+0x10/0x10 [ 25.450544][ T233] ? fdget+0x52/0x1e0 [ 25.450648][ T233] __sys_sendto+0x377/0x400 [ 25.450778][ T233] ? __pfx___sys_sendto+0x10/0x10 [ 25.450913][ T233] ? find_held_lock+0x2c/0x110 [ 25.451049][ T233] ? __might_fault+0xc3/0x170 [ 25.451174][ T233] ? lock_acquire+0x32/0xc0 [ 25.451298][ T233] ? trace_rseq_update+0xe2/0x140 [ 25.451442][ T233] ? rseq_update_cpu_node_id+0xe6/0x140 [ 25.451577][ T233] ? __rseq_handle_notify_resume+0x288/0x3e0 [ 25.451735][ T233] ? do_user_addr_fault+0x374/0xe30 [ 25.451861][ T233] ? __pfx___rseq_handle_notify_resume+0x10/0x10 [ 25.452037][ T233] __x64_sys_sendto+0xe0/0x1c0 [ 25.452172][ T233] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 25.452329][ T233] do_syscall_64+0xc1/0x1d0 [ 25.452470][ T233] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 25.452631][ T233] RIP: 0033:0x7fd764ddf700 [ 25.452764][ T233] Code: ff ff 64 89 02 eb bd 0f 1f 00 f3 0f 1e fa 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 1d 45 31 c9 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 68 c3 0f 1f 80 00 00 00 00 41 54 48 83 ec 20 [ 25.453227][ T233] RSP: 002b:00007fffec04df38 EFLAGS: 00000246 ORIG_RAX: 000000000000002c [ 25.453431][ T233] RAX: ffffffffffffffda RBX: 00007fffec04dfb8 RCX: 00007fd764ddf700 [ 25.453619][ T233] RDX: 0000000000000078 RSI: 00007fffec04df80 RDI: 0000000000000008 [ 25.453819][ T233] RBP: 00007fffec04df80 R08: 0000000000000000 R09: 0000000000000000 [ 25.454009][ T233] R10: 0000000000000000 R11: 0000000000000246 R12: 000000000040edf8 [ 25.454197][ T233] R13: 0000000000000048 R14: 000000000000004c R15: 0000000000000008 [ 25.454389][ T233] [ 247.091451][ T43] INFO: task restore_ipv4:233 blocked for more than 122 seconds. [ 247.091828][ T43] Not tainted 6.12.0-rc5-virtme #1 [ 247.091947][ T43] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 247.092155][ T43] task:restore_ipv4 state:D stack:25712 pid:233 tgid:233 ppid:232 flags:0x00004002 [ 247.092435][ T43] Call Trace: [ 247.092532][ T43] [ 247.092614][ T43] __schedule+0xa19/0x1dc0 [ 247.092749][ T43] ? __pfx___schedule+0x10/0x10 [ 247.092870][ T43] ? trace_lock_acquire+0x14d/0x1f0 [ 247.092993][ T43] ? trace_lock_release+0x10e/0x180 [ 247.093110][ T43] schedule+0xdf/0x210 [ 247.093199][ T43] schedule_preempt_disabled+0x15/0x30 [ 247.093334][ T43] __mutex_lock+0x634/0xac0 [ 247.093457][ T43] ? rtnl_newlink+0x64b/0xa30 [ 247.093580][ T43] ? __pfx___mutex_lock+0x10/0x10 [ 247.093698][ T43] ? trace_lock_acquire+0x14d/0x1f0 [ 247.093829][ T43] ? rtnl_newlink+0x64b/0xa30 [ 247.093953][ T43] rtnl_newlink+0x64b/0xa30 [ 247.094075][ T43] ? __pfx_rtnl_newlink+0x10/0x10 [ 247.094188][ T43] ? find_held_lock+0x2c/0x110 [ 247.094318][ T43] ? __pfx___lock_release+0x10/0x10 [ 247.094441][ T43] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 247.094557][ T43] ? __pfx_rtnl_newlink+0x10/0x10 [ 247.094685][ T43] rtnetlink_rcv_msg+0x712/0xc10 [ 247.094802][ T43] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 247.094922][ T43] ? hlock_class+0x4e/0x130 [ 247.095036][ T43] ? mark_lock+0x38/0x3e0 [ 247.095124][ T43] ? __lock_acquire+0xb3f/0x1580 [ 247.095249][ T43] netlink_rcv_skb+0x130/0x360 [ 247.095378][ T43] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 247.095497][ T43] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 247.095621][ T43] ? netlink_deliver_tap+0x13e/0x340 [ 247.095740][ T43] ? netlink_deliver_tap+0xc3/0x340 [ 247.095856][ T43] netlink_unicast+0x44b/0x710 [ 247.095974][ T43] ? __pfx_netlink_unicast+0x10/0x10 [ 247.096088][ T43] ? netlink_autobind.isra.0+0xa5/0x270 [ 247.096203][ T43] ? netlink_autobind.isra.0+0x18a/0x270 [ 247.096326][ T43] netlink_sendmsg+0x723/0xbe0 [ 247.096444][ T43] ? __pfx_netlink_sendmsg+0x10/0x10 [ 247.096562][ T43] ? fdget+0x52/0x1e0 [ 247.096653][ T43] __sys_sendto+0x377/0x400 [ 247.096772][ T43] ? __pfx___sys_sendto+0x10/0x10 [ 247.096886][ T43] ? find_held_lock+0x2c/0x110 [ 247.097024][ T43] ? __might_fault+0xc3/0x170 [ 247.097143][ T43] ? lock_acquire+0x32/0xc0 [ 247.097270][ T43] ? trace_rseq_update+0xe2/0x140 [ 247.097392][ T43] ? rseq_update_cpu_node_id+0xe6/0x140 [ 247.097511][ T43] ? __rseq_handle_notify_resume+0x288/0x3e0 [ 247.097663][ T43] ? do_user_addr_fault+0x374/0xe30 [ 247.097782][ T43] ? __pfx___rseq_handle_notify_resume+0x10/0x10 [ 247.097928][ T43] __x64_sys_sendto+0xe0/0x1c0 [ 247.098050][ T43] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 247.098210][ T43] do_syscall_64+0xc1/0x1d0 [ 247.098335][ T43] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 247.098484][ T43] RIP: 0033:0x7fd764ddf700 [ 247.098616][ T43] RSP: 002b:00007fffec04df38 EFLAGS: 00000246 ORIG_RAX: 000000000000002c [ 247.098795][ T43] RAX: ffffffffffffffda RBX: 00007fffec04dfb8 RCX: 00007fd764ddf700 [ 247.098966][ T43] RDX: 0000000000000078 RSI: 00007fffec04df80 RDI: 0000000000000008 [ 247.099138][ T43] RBP: 00007fffec04df80 R08: 0000000000000000 R09: 0000000000000000 [ 247.099321][ T43] R10: 0000000000000000 R11: 0000000000000246 R12: 000000000040edf8 [ 247.099537][ T43] R13: 0000000000000048 R14: 000000000000004c R15: 0000000000000008 [ 247.099721][ T43] [ 247.099813][ T43] INFO: lockdep is turned off. [ 369.971439][ T43] INFO: task kworker/u16:1:75 blocked for more than 122 seconds. [ 369.972149][ T43] Not tainted 6.12.0-rc5-virtme #1 [ 369.972373][ T43] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 369.972602][ T43] task:kworker/u16:1 state:D stack:30248 pid:75 tgid:75 ppid:2 flags:0x00004000 [ 369.972852][ T43] Workqueue: ipv6_addrconf addrconf_verify_work [ 369.973020][ T43] Call Trace: [ 369.973112][ T43] [ 369.973178][ T43] __schedule+0xa19/0x1dc0 [ 369.973317][ T43] ? __pfx___schedule+0x10/0x10 [ 369.973438][ T43] ? __lock_release+0x103/0x460 [ 369.973560][ T43] ? trace_lock_acquire+0x14d/0x1f0 [ 369.973698][ T43] ? trace_lock_release+0x10e/0x180 [ 369.973815][ T43] schedule+0xdf/0x210 [ 369.973905][ T43] schedule_preempt_disabled+0x15/0x30 [ 369.974020][ T43] __mutex_lock+0x634/0xac0 [ 369.974136][ T43] ? do_raw_spin_unlock+0x58/0x220 [ 369.974261][ T43] ? addrconf_verify_work+0x12/0x30 [ 369.974381][ T43] ? __pfx___mutex_lock+0x10/0x10 [ 369.974496][ T43] ? trace_lock_acquire+0x14d/0x1f0 [ 369.974626][ T43] ? trace_lock_acquire+0x14d/0x1f0 [ 369.974744][ T43] ? addrconf_verify_work+0x12/0x30 [ 369.974857][ T43] addrconf_verify_work+0x12/0x30 [ 369.974977][ T43] process_one_work+0xe55/0x16d0 [ 369.975097][ T43] ? __pfx___lock_release+0x10/0x10 [ 369.975213][ T43] ? __pfx_process_one_work+0x10/0x10 [ 369.975333][ T43] ? assign_work+0x16c/0x240 [ 369.975456][ T43] worker_thread+0x58c/0xce0 [ 369.975592][ T43] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 369.975742][ T43] ? __pfx_worker_thread+0x10/0x10 [ 369.975858][ T43] ? __pfx_worker_thread+0x10/0x10 [ 369.975978][ T43] kthread+0x28a/0x350 [ 369.976119][ T43] ? __pfx_kthread+0x10/0x10 [ 369.976257][ T43] ret_from_fork+0x31/0x70 [ 369.976390][ T43] ? __pfx_kthread+0x10/0x10 [ 369.976511][ T43] ret_from_fork_asm+0x1a/0x30 [ 369.976639][ T43] [ 369.976735][ T43] INFO: task restore_ipv4:233 blocked for more than 245 seconds. [ 369.976899][ T43] Not tainted 6.12.0-rc5-virtme #1 [ 369.977015][ T43] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 369.977206][ T43] task:restore_ipv4 state:D stack:25712 pid:233 tgid:233 ppid:232 flags:0x00004006 [ 369.977444][ T43] Call Trace: [ 369.977553][ T43] [ 369.977618][ T43] __schedule+0xa19/0x1dc0 [ 369.977736][ T43] ? __pfx___schedule+0x10/0x10 [ 369.977852][ T43] ? trace_lock_acquire+0x14d/0x1f0 [ 369.977969][ T43] ? trace_lock_release+0x10e/0x180 [ 369.978086][ T43] schedule+0xdf/0x210 [ 369.978172][ T43] schedule_preempt_disabled+0x15/0x30 [ 369.978293][ T43] __mutex_lock+0x634/0xac0 [ 369.978410][ T43] ? rtnl_newlink+0x64b/0xa30 [ 369.978537][ T43] ? __pfx___mutex_lock+0x10/0x10 [ 369.978652][ T43] ? trace_lock_acquire+0x14d/0x1f0 [ 369.978769][ T43] ? rtnl_newlink+0x64b/0xa30 [ 369.978882][ T43] rtnl_newlink+0x64b/0xa30 [ 369.978998][ T43] ? __pfx_rtnl_newlink+0x10/0x10 [ 369.979116][ T43] ? find_held_lock+0x2c/0x110 [ 369.979231][ T43] ? __pfx___lock_release+0x10/0x10 [ 369.979359][ T43] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 369.979474][ T43] ? __pfx_rtnl_newlink+0x10/0x10 [ 369.979595][ T43] rtnetlink_rcv_msg+0x712/0xc10 [ 369.979710][ T43] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 369.979822][ T43] ? hlock_class+0x4e/0x130 [ 369.979935][ T43] ? mark_lock+0x38/0x3e0 [ 369.980026][ T43] ? __lock_acquire+0xb3f/0x1580 [ 369.980142][ T43] netlink_rcv_skb+0x130/0x360 [ 369.980273][ T43] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 369.980416][ T43] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 369.980541][ T43] ? netlink_deliver_tap+0x13e/0x340 [ 369.980664][ T43] ? netlink_deliver_tap+0xc3/0x340 [ 369.980785][ T43] netlink_unicast+0x44b/0x710 [ 369.980901][ T43] ? __pfx_netlink_unicast+0x10/0x10 [ 369.981019][ T43] ? netlink_autobind.isra.0+0xa5/0x270 [ 369.981138][ T43] ? netlink_autobind.isra.0+0x18a/0x270 [ 369.981264][ T43] netlink_sendmsg+0x723/0xbe0 [ 369.981380][ T43] ? __pfx_netlink_sendmsg+0x10/0x10 [ 369.981501][ T43] ? fdget+0x52/0x1e0 [ 369.981609][ T43] __sys_sendto+0x377/0x400 [ 369.981729][ T43] ? __pfx___sys_sendto+0x10/0x10 [ 369.981844][ T43] ? find_held_lock+0x2c/0x110 [ 369.981961][ T43] ? __might_fault+0xc3/0x170 [ 369.982078][ T43] ? lock_acquire+0x32/0xc0 [ 369.982195][ T43] ? trace_rseq_update+0xe2/0x140 [ 369.982322][ T43] ? rseq_update_cpu_node_id+0xe6/0x140 [ 369.982442][ T43] ? __rseq_handle_notify_resume+0x288/0x3e0 [ 369.982583][ T43] ? do_user_addr_fault+0x374/0xe30 [ 369.982704][ T43] ? __pfx___rseq_handle_notify_resume+0x10/0x10 [ 369.982848][ T43] __x64_sys_sendto+0xe0/0x1c0 [ 369.982966][ T43] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 369.983112][ T43] do_syscall_64+0xc1/0x1d0 [ 369.983232][ T43] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 369.983390][ T43] RIP: 0033:0x7fd764ddf700 [ 369.983515][ T43] RSP: 002b:00007fffec04df38 EFLAGS: 00000246 ORIG_RAX: 000000000000002c [ 369.983691][ T43] RAX: ffffffffffffffda RBX: 00007fffec04dfb8 RCX: 00007fd764ddf700 [ 369.983861][ T43] RDX: 0000000000000078 RSI: 00007fffec04df80 RDI: 0000000000000008 [ 369.984032][ T43] RBP: 00007fffec04df80 R08: 0000000000000000 R09: 0000000000000000 [ 369.984204][ T43] R10: 0000000000000000 R11: 0000000000000246 R12: 000000000040edf8 [ 369.984406][ T43] R13: 0000000000000048 R14: 000000000000004c R15: 0000000000000008 [ 369.984634][ T43] [ 369.984726][ T43] INFO: lockdep is turned off. HARD STOP (377.734226) WAIT TIMEOUT stderr Ctrl-C stderr Ctrl-C stderr WAIT TIMEOUT stderr