[ 188.921624][ T2048] lag2: Mode changed to "loadbalance" [ 189.092520][ T2051] [ 189.092661][ T2051] ====================================================== [ 189.092866][ T2051] WARNING: possible circular locking dependency detected [ 189.093073][ T2051] 6.14.0-rc2-virtme #1 Not tainted [ 189.093233][ T2051] ------------------------------------------------------ [ 189.093429][ T2051] ip/2051 is trying to acquire lock: [ 189.093591][ T2051] ffff88800863ccb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 189.093844][ T2051] [ 189.093844][ T2051] but task is already holding lock: [ 189.094086][ T2051] ffff88800a402d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 189.094372][ T2051] [ 189.094372][ T2051] which lock already depends on the new lock. [ 189.094372][ T2051] [ 189.094682][ T2051] [ 189.094682][ T2051] the existing dependency chain (in reverse order) is: [ 189.094952][ T2051] [ 189.094952][ T2051] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 189.095207][ T2051] __lock_acquire+0xb9a/0x1680 [ 189.095374][ T2051] lock_acquire.part.0+0xeb/0x330 [ 189.095532][ T2051] __mutex_lock+0x169/0xc40 [ 189.095693][ T2051] team_set_mac_address+0x120/0x250 [ 189.095851][ T2051] netif_set_mac_address+0x28a/0x410 [ 189.096047][ T2051] do_setlink.constprop.0+0x1980/0x25f0 [ 189.096249][ T2051] rtnl_setlink+0x2b5/0x5a0 [ 189.096409][ T2051] rtnetlink_rcv_msg+0x712/0xc10 [ 189.096569][ T2051] netlink_rcv_skb+0x130/0x360 [ 189.096733][ T2051] netlink_unicast+0x44b/0x710 [ 189.096891][ T2051] netlink_sendmsg+0x723/0xbe0 [ 189.097048][ T2051] __sys_sendto+0x3c3/0x450 [ 189.097212][ T2051] __x64_sys_sendto+0xe0/0x1c0 [ 189.097374][ T2051] do_syscall_64+0xc1/0x1d0 [ 189.097533][ T2051] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 189.097734][ T2051] [ 189.097734][ T2051] -> #0 (&dev->lock){+.+.}-{4:4}: [ 189.097974][ T2051] check_prev_add+0x182/0xce0 [ 189.098136][ T2051] validate_chain+0x7bd/0xae0 [ 189.098291][ T2051] __lock_acquire+0xb9a/0x1680 [ 189.098448][ T2051] lock_acquire.part.0+0xeb/0x330 [ 189.098595][ T2051] __mutex_lock+0x169/0xc40 [ 189.098744][ T2051] __dev_open+0x57e/0x710 [ 189.098891][ T2051] netif_open+0xc9/0x130 [ 189.099040][ T2051] dev_open+0x9f/0x1a0 [ 189.099190][ T2051] team_port_add+0x90a/0x1ce0 [ 189.099340][ T2051] team_add_slave+0x41/0x80 [ 189.099492][ T2051] do_set_master+0x302/0x610 [ 189.099646][ T2051] do_setlink.constprop.0+0x87b/0x25f0 [ 189.099831][ T2051] rtnl_newlink+0x69c/0xa70 [ 189.099985][ T2051] rtnetlink_rcv_msg+0x712/0xc10 [ 189.100138][ T2051] netlink_rcv_skb+0x130/0x360 [ 189.100290][ T2051] netlink_unicast+0x44b/0x710 [ 189.100437][ T2051] netlink_sendmsg+0x723/0xbe0 [ 189.100592][ T2051] ____sys_sendmsg+0x7ac/0xa10 [ 189.100740][ T2051] ___sys_sendmsg+0xee/0x170 [ 189.100891][ T2051] __sys_sendmsg+0x109/0x1a0 [ 189.101039][ T2051] do_syscall_64+0xc1/0x1d0 [ 189.101187][ T2051] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 189.101373][ T2051] [ 189.101373][ T2051] other info that might help us debug this: [ 189.101373][ T2051] [ 189.101671][ T2051] Possible unsafe locking scenario: [ 189.101671][ T2051] [ 189.101891][ T2051] CPU0 CPU1 [ 189.102040][ T2051] ---- ---- [ 189.102190][ T2051] lock(team->team_lock_key); [ 189.102341][ T2051] lock(&dev->lock); [ 189.102527][ T2051] lock(team->team_lock_key); [ 189.102753][ T2051] lock(&dev->lock); [ 189.102868][ T2051] [ 189.102868][ T2051] *** DEADLOCK *** [ 189.102868][ T2051] [ 189.103083][ T2051] 2 locks held by ip/2051: [ 189.103236][ T2051] #0: ffffffff8ffeeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 189.103506][ T2051] #1: ffff88800a402d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 189.103775][ T2051] [ 189.103775][ T2051] stack backtrace: [ 189.103961][ T2051] CPU: 1 UID: 0 PID: 2051 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 189.103966][ T2051] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 189.103968][ T2051] Call Trace: [ 189.103970][ T2051] [ 189.103972][ T2051] dump_stack_lvl+0x82/0xd0 [ 189.103981][ T2051] print_circular_bug+0x1b7/0x240 [ 189.103986][ T2051] check_noncircular+0x2f9/0x3e0 [ 189.103990][ T2051] ? __pfx_check_noncircular+0x10/0x10 [ 189.103994][ T2051] ? find_held_lock+0x2c/0x110 [ 189.104001][ T2051] ? alloc_chain_hlocks+0x4e0/0x720 [ 189.104005][ T2051] check_prev_add+0x182/0xce0 [ 189.104010][ T2051] validate_chain+0x7bd/0xae0 [ 189.104015][ T2051] ? stack_depot_save_flags+0x27e/0x440 [ 189.104022][ T2051] ? __pfx_validate_chain+0x10/0x10 [ 189.104025][ T2051] ? hlock_class+0x4e/0x130 [ 189.104027][ T2051] ? mark_lock+0x38/0x3e0 [ 189.104032][ T2051] __lock_acquire+0xb9a/0x1680 [ 189.104038][ T2051] lock_acquire.part.0+0xeb/0x330 [ 189.104041][ T2051] ? __dev_open+0x57e/0x710 [ 189.104044][ T2051] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 189.104048][ T2051] ? trace_lock_acquire+0x14c/0x1f0 [ 189.104051][ T2051] ? lock_acquire+0x32/0xc0 [ 189.104054][ T2051] ? __dev_open+0x57e/0x710 [ 189.104057][ T2051] __mutex_lock+0x169/0xc40 [ 189.104059][ T2051] ? __dev_open+0x57e/0x710 [ 189.104062][ T2051] ? __dev_open+0x57e/0x710 [ 189.104065][ T2051] ? __pfx___mutex_lock+0x10/0x10 [ 189.104072][ T2051] ? mutex_is_locked+0x1c/0x60 [ 189.104075][ T2051] ? rtnl_is_locked+0x15/0x20 [ 189.104081][ T2051] ? mirred_device_event+0x3d/0x1e0 [act_mirred] [ 189.104090][ T2051] ? __dev_open+0x57e/0x710 [ 189.104092][ T2051] __dev_open+0x57e/0x710 [ 189.104095][ T2051] ? mark_held_locks+0x9e/0xe0 [ 189.104098][ T2051] ? __pfx___dev_open+0x10/0x10 [ 189.104100][ T2051] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 189.104108][ T2051] netif_open+0xc9/0x130 [ 189.104111][ T2051] ? __pfx_netif_open+0x10/0x10 [ 189.104115][ T2051] dev_open+0x9f/0x1a0 [ 189.104120][ T2051] team_port_add+0x90a/0x1ce0 [ 189.104125][ T2051] ? __pfx_team_port_add+0x10/0x10 [ 189.104128][ T2051] ? rcu_read_lock_any_held+0x43/0xb0 [ 189.104135][ T2051] ? validate_chain+0x1fe/0xae0 [ 189.104140][ T2051] team_add_slave+0x41/0x80 [ 189.104144][ T2051] do_set_master+0x302/0x610 [ 189.104149][ T2051] do_setlink.constprop.0+0x87b/0x25f0 [ 189.104154][ T2051] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 189.104158][ T2051] ? lock_acquire.part.0+0xeb/0x330 [ 189.104161][ T2051] ? rtnl_newlink+0x653/0xa70 [ 189.104164][ T2051] ? rtnl_newlink+0xb9/0xa70 [ 189.104166][ T2051] ? rtnetlink_rcv_msg+0x712/0xc10 [ 189.104169][ T2051] ? __mutex_trylock_common+0xfa/0x260 [ 189.104173][ T2051] ? __pfx___mutex_trylock_common+0x10/0x10 [ 189.104177][ T2051] ? lock_acquire+0x32/0xc0 [ 189.104181][ T2051] ? trace_contention_end+0xef/0x150 [ 189.104184][ T2051] ? __mutex_lock+0x190/0xc40 [ 189.104187][ T2051] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 189.104191][ T2051] ? rtnl_newlink+0x653/0xa70 [ 189.104195][ T2051] ? __pfx___mutex_lock+0x10/0x10 [ 189.104197][ T2051] ? __pfx_validate_nla+0x10/0x10 [ 189.104202][ T2051] ? trace_cap_capable+0x11e/0x1a0 [ 189.104209][ T2051] ? __rtnl_newlink+0x3f2/0xa80 [ 189.104214][ T2051] rtnl_newlink+0x69c/0xa70 [ 189.104218][ T2051] ? __pfx_rtnl_newlink+0x10/0x10 [ 189.104221][ T2051] ? find_held_lock+0x2c/0x110 [ 189.104226][ T2051] ? __pfx___lock_release+0x10/0x10 [ 189.104229][ T2051] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 189.104234][ T2051] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 189.104237][ T2051] ? __pfx_rtnl_newlink+0x10/0x10 [ 189.104240][ T2051] rtnetlink_rcv_msg+0x712/0xc10 [ 189.104244][ T2051] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 189.104246][ T2051] ? hlock_class+0x4e/0x130 [ 189.104249][ T2051] ? mark_lock+0x38/0x3e0 [ 189.104253][ T2051] ? __lock_acquire+0xb9a/0x1680 [ 189.104257][ T2051] netlink_rcv_skb+0x130/0x360 [ 189.104260][ T2051] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 189.104264][ T2051] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 189.104271][ T2051] ? netlink_deliver_tap+0x13e/0x340 [ 189.104275][ T2051] ? netlink_deliver_tap+0xc3/0x340 [ 189.104278][ T2051] netlink_unicast+0x44b/0x710 [ 189.104282][ T2051] ? __pfx_netlink_unicast+0x10/0x10 [ 189.104286][ T2051] ? find_held_lock+0x2c/0x110 [ 189.104291][ T2051] netlink_sendmsg+0x723/0xbe0 [ 189.104295][ T2051] ? __pfx_netlink_sendmsg+0x10/0x10 [ 189.104301][ T2051] ____sys_sendmsg+0x7ac/0xa10 [ 189.104305][ T2051] ? __pfx_____sys_sendmsg+0x10/0x10 [ 189.104307][ T2051] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 189.104314][ T2051] ___sys_sendmsg+0xee/0x170 [ 189.104318][ T2051] ? __pfx____sys_sendmsg+0x10/0x10 [ 189.104322][ T2051] ? kasan_save_stack+0x34/0x50 [ 189.104328][ T2051] ? kasan_save_stack+0x24/0x50 [ 189.104331][ T2051] ? kasan_record_aux_stack+0x8c/0xa0 [ 189.104335][ T2051] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 189.104341][ T2051] ? __x64_sys_close+0x7c/0xd0 [ 189.104346][ T2051] ? do_syscall_64+0xc1/0x1d0 [ 189.104348][ T2051] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 189.104351][ T2051] ? __lock_acquire+0xb9a/0x1680 [ 189.104354][ T2051] ? lock_downgrade+0x52/0x110 [ 189.104358][ T2051] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 189.104362][ T2051] ? find_held_lock+0x2c/0x110 [ 189.104366][ T2051] ? __lock_release+0x103/0x460 [ 189.104369][ T2051] ? __virt_addr_valid+0x22b/0x430 [ 189.104374][ T2051] ? __pfx___lock_release+0x10/0x10 [ 189.104376][ T2051] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 189.104381][ T2051] __sys_sendmsg+0x109/0x1a0 [ 189.104385][ T2051] ? __pfx___sys_sendmsg+0x10/0x10 [ 189.104393][ T2051] do_syscall_64+0xc1/0x1d0 [ 189.104395][ T2051] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 189.104398][ T2051] RIP: 0033:0x7f66494979a7 [ 189.104402][ T2051] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 189.104405][ T2051] RSP: 002b:00007ffd4fe25388 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 189.104409][ T2051] RAX: ffffffffffffffda RBX: 00007ffd4fe25ab0 RCX: 00007f66494979a7 [ 189.104411][ T2051] RDX: 0000000000000000 RSI: 00007ffd4fe253f0 RDI: 0000000000000005 [ 189.104413][ T2051] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 189.104414][ T2051] R10: 00000000036f8910 R11: 0000000000000246 R12: 0000000000000004 [ 189.104416][ T2051] R13: 0000000067b302ad R14: 0000000000498600 R15: 0000000000000000 [ 189.104421][ T2051] [ 189.136394][ T2051] lag2: Port device veth3 added [ 189.353152][ T2062] lag2: Port device veth5 added [ 189.467341][ T2064] 8021q: adding VLAN 0 to HW filter on device lag2 [ 189.540541][ T2065] 8021q: adding VLAN 0 to HW filter on device lag2 [ 190.980369][ T2092] lag1: Mode changed to "loadbalance" [ 191.112824][ T2095] lag1: Port device veth2 added [ 191.325791][ T2098] lag1: Port device veth4 added [ 191.448806][ T2100] 8021q: adding VLAN 0 to HW filter on device lag1 [ 197.458340][ T2126] lag2: Port device veth5 removed [ 201.429218][ T2136] lag2: Port device veth3 removed [ 206.291334][ T2166] lag2: Mode changed to "loadbalance" [ 206.432421][ T2169] lag2: Port device veth3 added [ 206.665925][ T2174] lag2: Port device veth5 added [ 206.790650][ T2176] 8021q: adding VLAN 0 to HW filter on device lag2 [ 206.852503][ T2177] 8021q: adding VLAN 0 to HW filter on device lag2 [ 212.943221][ T2211] lag2: Port device veth3 removed [ 216.891180][ T2221] lag2: Port device veth5 removed [ 221.740472][ T2250] lag2: Mode changed to "loadbalance" [ 221.874366][ T2253] lag2: Port device veth3 added [ 222.078472][ T2259] lag2: Port device veth5 added [ 222.204551][ T2261] 8021q: adding VLAN 0 to HW filter on device lag2 [ 222.279456][ T2262] 8021q: adding VLAN 0 to HW filter on device lag2 [ 228.269328][ T2092] lag1: Port device veth4 removed [ 228.275274][ T2092] lag1: Port device veth2 removed [ 229.632811][ T2250] lag2: Port device veth5 removed [ 229.635320][ T2250] lag2: Port device veth3 removed