[ 140.433564][ T1480] lag1: Mode changed to "loadbalance" [ 140.533494][ T1482] 8021q: adding VLAN 0 to HW filter on device lag1 [ 140.861842][ T1489] [ 140.861960][ T1489] ====================================================== [ 140.862155][ T1489] WARNING: possible circular locking dependency detected [ 140.862334][ T1489] 6.14.0-rc2-virtme #1 Not tainted [ 140.862518][ T1489] ------------------------------------------------------ [ 140.862707][ T1489] ip/1489 is trying to acquire lock: [ 140.862852][ T1489] ffff888008a79cb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 140.863087][ T1489] [ 140.863087][ T1489] but task is already holding lock: [ 140.863309][ T1489] ffff888015682d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 140.863579][ T1489] [ 140.863579][ T1489] which lock already depends on the new lock. [ 140.863579][ T1489] [ 140.863867][ T1489] [ 140.863867][ T1489] the existing dependency chain (in reverse order) is: [ 140.864125][ T1489] [ 140.864125][ T1489] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 140.864347][ T1489] __lock_acquire+0xb9a/0x1680 [ 140.864508][ T1489] lock_acquire.part.0+0xeb/0x330 [ 140.864657][ T1489] __mutex_lock+0x169/0xc40 [ 140.864810][ T1489] team_set_mac_address+0x120/0x250 [ 140.864962][ T1489] netif_set_mac_address+0x28a/0x410 [ 140.865143][ T1489] do_setlink.constprop.0+0x1980/0x25f0 [ 140.865324][ T1489] rtnl_setlink+0x2b5/0x5a0 [ 140.865470][ T1489] rtnetlink_rcv_msg+0x712/0xc10 [ 140.865617][ T1489] netlink_rcv_skb+0x130/0x360 [ 140.865764][ T1489] netlink_unicast+0x44b/0x710 [ 140.865914][ T1489] netlink_sendmsg+0x723/0xbe0 [ 140.866060][ T1489] __sys_sendto+0x3c3/0x450 [ 140.866209][ T1489] __x64_sys_sendto+0xe0/0x1c0 [ 140.866361][ T1489] do_syscall_64+0xc1/0x1d0 [ 140.866534][ T1489] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 140.866718][ T1489] [ 140.866718][ T1489] -> #0 (&dev->lock){+.+.}-{4:4}: [ 140.866940][ T1489] check_prev_add+0x182/0xce0 [ 140.867096][ T1489] validate_chain+0x7bd/0xae0 [ 140.867242][ T1489] __lock_acquire+0xb9a/0x1680 [ 140.867390][ T1489] lock_acquire.part.0+0xeb/0x330 [ 140.867537][ T1489] __mutex_lock+0x169/0xc40 [ 140.867682][ T1489] __dev_open+0x57e/0x710 [ 140.867840][ T1489] netif_open+0xc9/0x130 [ 140.867996][ T1489] dev_open+0x9f/0x1a0 [ 140.868146][ T1489] team_port_add+0x90a/0x1ce0 [ 140.868293][ T1489] team_add_slave+0x41/0x80 [ 140.868441][ T1489] do_set_master+0x302/0x610 [ 140.868588][ T1489] do_setlink.constprop.0+0x87b/0x25f0 [ 140.868771][ T1489] rtnl_newlink+0x69c/0xa70 [ 140.868917][ T1489] rtnetlink_rcv_msg+0x712/0xc10 [ 140.869065][ T1489] netlink_rcv_skb+0x130/0x360 [ 140.869217][ T1489] netlink_unicast+0x44b/0x710 [ 140.869363][ T1489] netlink_sendmsg+0x723/0xbe0 [ 140.869509][ T1489] ____sys_sendmsg+0x7ac/0xa10 [ 140.869655][ T1489] ___sys_sendmsg+0xee/0x170 [ 140.869821][ T1489] __sys_sendmsg+0x109/0x1a0 [ 140.869967][ T1489] do_syscall_64+0xc1/0x1d0 [ 140.870118][ T1489] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 140.870302][ T1489] [ 140.870302][ T1489] other info that might help us debug this: [ 140.870302][ T1489] [ 140.870608][ T1489] Possible unsafe locking scenario: [ 140.870608][ T1489] [ 140.870825][ T1489] CPU0 CPU1 [ 140.870986][ T1489] ---- ---- [ 140.871138][ T1489] lock(team->team_lock_key); [ 140.871301][ T1489] lock(&dev->lock); [ 140.871512][ T1489] lock(team->team_lock_key); [ 140.871734][ T1489] lock(&dev->lock); [ 140.871846][ T1489] [ 140.871846][ T1489] *** DEADLOCK *** [ 140.871846][ T1489] [ 140.872059][ T1489] 2 locks held by ip/1489: [ 140.872216][ T1489] #0: ffffffff87beeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 140.872485][ T1489] #1: ffff888015682d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 140.872748][ T1489] [ 140.872748][ T1489] stack backtrace: [ 140.872929][ T1489] CPU: 0 UID: 0 PID: 1489 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 140.872934][ T1489] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 140.872936][ T1489] Call Trace: [ 140.872938][ T1489] [ 140.872940][ T1489] dump_stack_lvl+0x82/0xd0 [ 140.872947][ T1489] print_circular_bug+0x1b7/0x240 [ 140.872953][ T1489] check_noncircular+0x2f9/0x3e0 [ 140.872957][ T1489] ? __pfx_check_noncircular+0x10/0x10 [ 140.872961][ T1489] ? find_held_lock+0x2c/0x110 [ 140.872970][ T1489] ? alloc_chain_hlocks+0x4e0/0x720 [ 140.872976][ T1489] check_prev_add+0x182/0xce0 [ 140.872984][ T1489] validate_chain+0x7bd/0xae0 [ 140.872991][ T1489] ? stack_depot_save_flags+0x27e/0x440 [ 140.872999][ T1489] ? __pfx_validate_chain+0x10/0x10 [ 140.873004][ T1489] ? hlock_class+0x4e/0x130 [ 140.873007][ T1489] ? mark_lock+0x38/0x3e0 [ 140.873011][ T1489] __lock_acquire+0xb9a/0x1680 [ 140.873017][ T1489] lock_acquire.part.0+0xeb/0x330 [ 140.873021][ T1489] ? __dev_open+0x57e/0x710 [ 140.873025][ T1489] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 140.873028][ T1489] ? trace_lock_acquire+0x14c/0x1f0 [ 140.873031][ T1489] ? lock_acquire+0x32/0xc0 [ 140.873034][ T1489] ? __dev_open+0x57e/0x710 [ 140.873037][ T1489] __mutex_lock+0x169/0xc40 [ 140.873040][ T1489] ? __dev_open+0x57e/0x710 [ 140.873043][ T1489] ? __dev_open+0x57e/0x710 [ 140.873046][ T1489] ? __pfx___mutex_lock+0x10/0x10 [ 140.873052][ T1489] ? packet_notifier+0x3b0/0x810 [ 140.873060][ T1489] ? __dev_open+0x57e/0x710 [ 140.873062][ T1489] __dev_open+0x57e/0x710 [ 140.873064][ T1489] ? mark_held_locks+0x9e/0xe0 [ 140.873067][ T1489] ? __pfx___dev_open+0x10/0x10 [ 140.873070][ T1489] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 140.873076][ T1489] netif_open+0xc9/0x130 [ 140.873079][ T1489] ? __pfx_netif_open+0x10/0x10 [ 140.873083][ T1489] dev_open+0x9f/0x1a0 [ 140.873087][ T1489] team_port_add+0x90a/0x1ce0 [ 140.873092][ T1489] ? __pfx_team_port_add+0x10/0x10 [ 140.873096][ T1489] ? rcu_read_lock_any_held+0x43/0xb0 [ 140.873101][ T1489] ? validate_chain+0x1fe/0xae0 [ 140.873105][ T1489] team_add_slave+0x41/0x80 [ 140.873110][ T1489] do_set_master+0x302/0x610 [ 140.873114][ T1489] do_setlink.constprop.0+0x87b/0x25f0 [ 140.873119][ T1489] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 140.873122][ T1489] ? lock_acquire.part.0+0xeb/0x330 [ 140.873125][ T1489] ? rtnl_newlink+0x653/0xa70 [ 140.873128][ T1489] ? rtnl_newlink+0xb9/0xa70 [ 140.873131][ T1489] ? rtnetlink_rcv_msg+0x712/0xc10 [ 140.873134][ T1489] ? __mutex_trylock_common+0xfa/0x260 [ 140.873138][ T1489] ? __pfx___mutex_trylock_common+0x10/0x10 [ 140.873142][ T1489] ? lock_acquire+0x32/0xc0 [ 140.873145][ T1489] ? trace_contention_end+0xef/0x150 [ 140.873148][ T1489] ? __mutex_lock+0x190/0xc40 [ 140.873151][ T1489] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 140.873155][ T1489] ? rtnl_newlink+0x653/0xa70 [ 140.873158][ T1489] ? __pfx___mutex_lock+0x10/0x10 [ 140.873161][ T1489] ? __pfx_validate_nla+0x10/0x10 [ 140.873165][ T1489] ? trace_cap_capable+0x11e/0x1a0 [ 140.873171][ T1489] ? __rtnl_newlink+0x3f2/0xa80 [ 140.873175][ T1489] rtnl_newlink+0x69c/0xa70 [ 140.873180][ T1489] ? __pfx_rtnl_newlink+0x10/0x10 [ 140.873182][ T1489] ? find_held_lock+0x2c/0x110 [ 140.873187][ T1489] ? __pfx___lock_release+0x10/0x10 [ 140.873190][ T1489] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 140.873195][ T1489] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 140.873199][ T1489] ? __pfx_rtnl_newlink+0x10/0x10 [ 140.873202][ T1489] rtnetlink_rcv_msg+0x712/0xc10 [ 140.873205][ T1489] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 140.873208][ T1489] ? hlock_class+0x4e/0x130 [ 140.873210][ T1489] ? mark_lock+0x38/0x3e0 [ 140.873215][ T1489] ? __lock_acquire+0xb9a/0x1680 [ 140.873218][ T1489] netlink_rcv_skb+0x130/0x360 [ 140.873222][ T1489] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 140.873226][ T1489] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 140.873233][ T1489] ? netlink_deliver_tap+0x13e/0x340 [ 140.873237][ T1489] ? netlink_deliver_tap+0xc3/0x340 [ 140.873240][ T1489] netlink_unicast+0x44b/0x710 [ 140.873245][ T1489] ? __pfx_netlink_unicast+0x10/0x10 [ 140.873248][ T1489] ? find_held_lock+0x2c/0x110 [ 140.873253][ T1489] netlink_sendmsg+0x723/0xbe0 [ 140.873257][ T1489] ? __pfx_netlink_sendmsg+0x10/0x10 [ 140.873263][ T1489] ____sys_sendmsg+0x7ac/0xa10 [ 140.873267][ T1489] ? __pfx_____sys_sendmsg+0x10/0x10 [ 140.873270][ T1489] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 140.873277][ T1489] ___sys_sendmsg+0xee/0x170 [ 140.873281][ T1489] ? __pfx____sys_sendmsg+0x10/0x10 [ 140.873285][ T1489] ? kasan_save_stack+0x34/0x50 [ 140.873289][ T1489] ? kasan_save_stack+0x24/0x50 [ 140.873292][ T1489] ? kasan_record_aux_stack+0x8c/0xa0 [ 140.873294][ T1489] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 140.873298][ T1489] ? __x64_sys_close+0x7c/0xd0 [ 140.873301][ T1489] ? do_syscall_64+0xc1/0x1d0 [ 140.873303][ T1489] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 140.873307][ T1489] ? __lock_acquire+0xb9a/0x1680 [ 140.873310][ T1489] ? lock_downgrade+0x52/0x110 [ 140.873314][ T1489] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 140.873318][ T1489] ? find_held_lock+0x2c/0x110 [ 140.873322][ T1489] ? __lock_release+0x103/0x460 [ 140.873325][ T1489] ? __virt_addr_valid+0x22b/0x430 [ 140.873330][ T1489] ? __pfx___lock_release+0x10/0x10 [ 140.873332][ T1489] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 140.873337][ T1489] __sys_sendmsg+0x109/0x1a0 [ 140.873340][ T1489] ? __pfx___sys_sendmsg+0x10/0x10 [ 140.873348][ T1489] do_syscall_64+0xc1/0x1d0 [ 140.873351][ T1489] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 140.873354][ T1489] RIP: 0033:0x7f4142fde9a7 [ 140.873359][ T1489] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 140.873362][ T1489] RSP: 002b:00007ffcdb3af3a8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 140.873365][ T1489] RAX: ffffffffffffffda RBX: 00007ffcdb3afad0 RCX: 00007f4142fde9a7 [ 140.873367][ T1489] RDX: 0000000000000000 RSI: 00007ffcdb3af410 RDI: 0000000000000005 [ 140.873369][ T1489] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 140.873370][ T1489] R10: 0000000027087910 R11: 0000000000000246 R12: 0000000000000004 [ 140.873372][ T1489] R13: 0000000067b2d8c8 R14: 0000000000498600 R15: 0000000000000000 [ 140.873377][ T1489] [ 140.892188][ T1489] lag1: Port device veth0 added [ 140.897451][ T1489] ip (1489) used greatest stack depth: 23544 bytes left [ 140.945872][ T1490] lag1: Port device veth6 added [ 141.244570][ T1496] 8021q: adding VLAN 0 to HW filter on device lag1 [ 141.722894][ T1507] lag4: Mode changed to "loadbalance" [ 141.779915][ T1509] 8021q: adding VLAN 0 to HW filter on device lag4 [ 142.035372][ T1514] lag4: Port device veth3 added [ 142.105000][ T1515] lag4: Port device veth5 added [ 142.438586][ T1521] 8021q: adding VLAN 0 to HW filter on device lag4 [ 142.940505][ T1532] lag2: Mode changed to "loadbalance" [ 143.001338][ T1534] 8021q: adding VLAN 0 to HW filter on device lag2 [ 143.218341][ T1539] lag2: Port device veth1 added [ 143.286938][ T1540] lag2: Port device veth7 added [ 143.484803][ T1546] br1: port 1(lag2) entered blocking state [ 143.485089][ T1546] br1: port 1(lag2) entered disabled state [ 143.485341][ T1546] lag2: entered allmulticast mode [ 143.485515][ T1546] veth1: entered allmulticast mode [ 143.485689][ T1546] veth7: entered allmulticast mode [ 143.487663][ T1546] veth1: entered promiscuous mode [ 143.487875][ T1546] veth7: entered promiscuous mode [ 143.668151][ T1549] br1: port 1(lag2) entered blocking state [ 143.668398][ T1549] br1: port 1(lag2) entered forwarding state [ 143.896045][ T1555] lag3: Mode changed to "loadbalance" [ 143.964390][ T1557] 8021q: adding VLAN 0 to HW filter on device lag3 [ 144.209764][ T1562] lag3: Port device veth2 added [ 144.280490][ T1563] lag3: Port device veth4 added [ 153.057814][ T1626] veth7: left allmulticast mode [ 153.059971][ T1626] lag2: Port device veth7 removed [ 153.121117][ T1627] veth7: left promiscuous mode [ 165.994026][ T1677] veth7: entered allmulticast mode [ 165.994410][ T1677] veth7: entered promiscuous mode [ 165.995616][ T1677] lag2: Port device veth7 added [ 166.242761][ T1688] veth1: left allmulticast mode [ 166.246657][ T1688] lag2: Port device veth1 removed [ 166.328686][ T1689] veth1: left promiscuous mode [ 179.092267][ T38] br1: port 1(lag2) entered disabled state [ 179.148432][ T1739] veth7: left allmulticast mode [ 179.150257][ T1739] lag2: Port device veth7 removed [ 179.217898][ T1740] veth7: left promiscuous mode [ 179.386475][ T1750] veth1: entered allmulticast mode [ 179.386701][ T1750] veth1: entered promiscuous mode [ 179.387487][ T1750] lag2: Port device veth1 added [ 179.400606][ T1507] br1: port 1(lag2) entered blocking state [ 179.400863][ T1507] br1: port 1(lag2) entered forwarding state [ 179.633966][ T1761] veth7: entered allmulticast mode [ 179.634212][ T1761] veth7: entered promiscuous mode [ 179.634979][ T1761] lag2: Port device veth7 added [ 192.466418][ T1811] lag2: left allmulticast mode [ 192.466635][ T1811] veth1: left allmulticast mode [ 192.466804][ T1811] veth7: left allmulticast mode [ 192.466988][ T1811] veth1: left promiscuous mode [ 192.467179][ T1811] veth7: left promiscuous mode [ 192.467341][ T1811] br1: port 1(lag2) entered disabled state [ 194.570503][ T1813] br1: port 1(lag2) entered blocking state [ 194.570810][ T1813] br1: port 1(lag2) entered disabled state [ 194.571104][ T1813] lag2: entered allmulticast mode [ 194.572117][ T1813] veth1: entered allmulticast mode [ 194.572384][ T1813] veth7: entered allmulticast mode [ 194.574089][ T1813] veth1: entered promiscuous mode [ 194.574336][ T1813] veth7: entered promiscuous mode [ 194.575027][ T1813] br1: port 1(lag2) entered blocking state [ 194.575278][ T1813] br1: port 1(lag2) entered forwarding state [ 207.449952][ T1863] lag3: Port device veth2 removed [ 220.282614][ T1914] lag3: Port device veth2 added [ 220.514332][ T1925] lag3: Port device veth4 removed [ 233.330472][ T1976] lag3: Port device veth2 removed [ 233.531600][ T1987] lag3: Port device veth4 added [ 233.764436][ T1998] lag3: Port device veth2 added [ 246.519811][ T2048] br1: port 2(lag3) entered blocking state [ 246.520045][ T2048] br1: port 2(lag3) entered disabled state [ 246.521076][ T2048] lag3: entered allmulticast mode [ 246.521234][ T2048] veth4: entered allmulticast mode [ 246.521390][ T2048] veth2: entered allmulticast mode [ 246.522929][ T2048] lag3: entered promiscuous mode [ 246.523085][ T2048] veth4: entered promiscuous mode [ 246.523453][ T2048] veth2: entered promiscuous mode [ 246.523935][ T2048] lag2: entered promiscuous mode [ 246.525030][ T2048] br1: port 2(lag3) entered blocking state [ 246.525243][ T2048] br1: port 2(lag3) entered forwarding state [ 248.618660][ T2050] lag3: left allmulticast mode [ 248.618885][ T2050] veth4: left allmulticast mode [ 248.619050][ T2050] veth2: left allmulticast mode [ 248.619878][ T2050] lag3: left promiscuous mode [ 248.620040][ T2050] veth4: left promiscuous mode [ 248.620471][ T2050] veth2: left promiscuous mode [ 248.621257][ T2050] br1: port 2(lag3) entered disabled state [ 248.622403][ T2050] lag2: left promiscuous mode [ 261.608044][ T2103] lag3: Port device veth4 removed [ 261.666956][ T2104] lag3: Port device veth2 removed [ 262.238743][ T45] br1: port 1(lag2) entered disabled state [ 262.344739][ T2119] lag2: left allmulticast mode [ 262.344961][ T2119] veth1: left allmulticast mode [ 262.345121][ T2119] veth7: left allmulticast mode [ 262.345321][ T2119] br1: port 1(lag2) entered disabled state [ 262.518822][ T2121] lag2: Port device veth7 removed [ 262.572272][ T2122] lag2: Port device veth1 removed [ 263.627265][ T2137] lag4: Port device veth5 removed [ 263.682250][ T2138] lag4: Port device veth3 removed [ 264.734307][ T2151] lag1: Port device veth6 removed [ 264.790146][ T2152] lag1: Port device veth0 removed