[ 834.080405][ T4467] lag1: Mode changed to "loadbalance" [ 834.188976][ T4469] 8021q: adding VLAN 0 to HW filter on device lag1 [ 834.197261][ T4469] ip (4469) used greatest stack depth: 23664 bytes left [ 834.585006][ T4476] [ 834.585154][ T4476] ====================================================== [ 834.585384][ T4476] WARNING: possible circular locking dependency detected [ 834.585589][ T4476] 6.14.0-rc2-virtme #1 Not tainted [ 834.585756][ T4476] ------------------------------------------------------ [ 834.585968][ T4476] ip/4476 is trying to acquire lock: [ 834.586140][ T4476] ffff888007961cb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 834.586412][ T4476] [ 834.586412][ T4476] but task is already holding lock: [ 834.586672][ T4476] ffff88801309ad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 834.586974][ T4476] [ 834.586974][ T4476] which lock already depends on the new lock. [ 834.586974][ T4476] [ 834.587298][ T4476] [ 834.587298][ T4476] the existing dependency chain (in reverse order) is: [ 834.587587][ T4476] [ 834.587587][ T4476] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 834.587823][ T4476] __lock_acquire+0xb9a/0x1680 [ 834.587976][ T4476] lock_acquire.part.0+0xeb/0x330 [ 834.588122][ T4476] __mutex_lock+0x169/0xc40 [ 834.588275][ T4476] team_set_mac_address+0x120/0x250 [ 834.588434][ T4476] netif_set_mac_address+0x28a/0x410 [ 834.588653][ T4476] do_setlink.constprop.0+0x1980/0x25f0 [ 834.588845][ T4476] rtnl_setlink+0x2b5/0x5a0 [ 834.588991][ T4476] rtnetlink_rcv_msg+0x712/0xc10 [ 834.589136][ T4476] netlink_rcv_skb+0x130/0x360 [ 834.589294][ T4476] netlink_unicast+0x44b/0x710 [ 834.589446][ T4476] netlink_sendmsg+0x723/0xbe0 [ 834.589605][ T4476] __sys_sendto+0x3c3/0x450 [ 834.589759][ T4476] __x64_sys_sendto+0xe0/0x1c0 [ 834.589905][ T4476] do_syscall_64+0xc1/0x1d0 [ 834.590055][ T4476] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 834.590238][ T4476] [ 834.590238][ T4476] -> #0 (&dev->lock){+.+.}-{4:4}: [ 834.590460][ T4476] check_prev_add+0x182/0xce0 [ 834.590612][ T4476] validate_chain+0x7bd/0xae0 [ 834.590770][ T4476] __lock_acquire+0xb9a/0x1680 [ 834.590918][ T4476] lock_acquire.part.0+0xeb/0x330 [ 834.591064][ T4476] __mutex_lock+0x169/0xc40 [ 834.591219][ T4476] __dev_open+0x57e/0x710 [ 834.591369][ T4476] netif_open+0xc9/0x130 [ 834.591515][ T4476] dev_open+0x9f/0x1a0 [ 834.591677][ T4476] team_port_add+0x90a/0x1ce0 [ 834.591828][ T4476] team_add_slave+0x41/0x80 [ 834.591976][ T4476] do_set_master+0x302/0x610 [ 834.592123][ T4476] do_setlink.constprop.0+0x87b/0x25f0 [ 834.592319][ T4476] rtnl_newlink+0x69c/0xa70 [ 834.592478][ T4476] rtnetlink_rcv_msg+0x712/0xc10 [ 834.592627][ T4476] netlink_rcv_skb+0x130/0x360 [ 834.592792][ T4476] netlink_unicast+0x44b/0x710 [ 834.592954][ T4476] netlink_sendmsg+0x723/0xbe0 [ 834.593104][ T4476] ____sys_sendmsg+0x7ac/0xa10 [ 834.593258][ T4476] ___sys_sendmsg+0xee/0x170 [ 834.593415][ T4476] __sys_sendmsg+0x109/0x1a0 [ 834.593572][ T4476] do_syscall_64+0xc1/0x1d0 [ 834.593734][ T4476] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 834.593918][ T4476] [ 834.593918][ T4476] other info that might help us debug this: [ 834.593918][ T4476] [ 834.594231][ T4476] Possible unsafe locking scenario: [ 834.594231][ T4476] [ 834.594465][ T4476] CPU0 CPU1 [ 834.594625][ T4476] ---- ---- [ 834.594782][ T4476] lock(team->team_lock_key); [ 834.594941][ T4476] lock(&dev->lock); [ 834.595128][ T4476] lock(team->team_lock_key); [ 834.595370][ T4476] lock(&dev->lock); [ 834.595484][ T4476] [ 834.595484][ T4476] *** DEADLOCK *** [ 834.595484][ T4476] [ 834.595701][ T4476] 2 locks held by ip/4476: [ 834.595852][ T4476] #0: ffffffffb8deeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 834.596123][ T4476] #1: ffff88801309ad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 834.596401][ T4476] [ 834.596401][ T4476] stack backtrace: [ 834.596583][ T4476] CPU: 2 UID: 0 PID: 4476 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 834.596588][ T4476] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 834.596591][ T4476] Call Trace: [ 834.596594][ T4476] [ 834.596596][ T4476] dump_stack_lvl+0x82/0xd0 [ 834.596605][ T4476] print_circular_bug+0x1b7/0x240 [ 834.596611][ T4476] check_noncircular+0x2f9/0x3e0 [ 834.596615][ T4476] ? __pfx_check_noncircular+0x10/0x10 [ 834.596619][ T4476] ? find_held_lock+0x2c/0x110 [ 834.596625][ T4476] ? alloc_chain_hlocks+0x4e0/0x720 [ 834.596630][ T4476] check_prev_add+0x182/0xce0 [ 834.596634][ T4476] validate_chain+0x7bd/0xae0 [ 834.596639][ T4476] ? stack_depot_save_flags+0x27e/0x440 [ 834.596646][ T4476] ? __pfx_validate_chain+0x10/0x10 [ 834.596650][ T4476] ? hlock_class+0x4e/0x130 [ 834.596652][ T4476] ? mark_lock+0x38/0x3e0 [ 834.596656][ T4476] __lock_acquire+0xb9a/0x1680 [ 834.596661][ T4476] ? mark_lock+0x38/0x3e0 [ 834.596664][ T4476] lock_acquire.part.0+0xeb/0x330 [ 834.596667][ T4476] ? __dev_open+0x57e/0x710 [ 834.596670][ T4476] ? validate_chain+0x162/0xae0 [ 834.596673][ T4476] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 834.596677][ T4476] ? trace_lock_acquire+0x14c/0x1f0 [ 834.596680][ T4476] ? lock_acquire+0x32/0xc0 [ 834.596682][ T4476] ? __dev_open+0x57e/0x710 [ 834.596686][ T4476] __mutex_lock+0x169/0xc40 [ 834.596688][ T4476] ? __dev_open+0x57e/0x710 [ 834.596691][ T4476] ? __dev_open+0x57e/0x710 [ 834.596694][ T4476] ? __pfx___mutex_lock+0x10/0x10 [ 834.596700][ T4476] ? packet_notifier+0x3b0/0x810 [ 834.596707][ T4476] ? __dev_open+0x57e/0x710 [ 834.596709][ T4476] __dev_open+0x57e/0x710 [ 834.596711][ T4476] ? mark_held_locks+0x9e/0xe0 [ 834.596714][ T4476] ? __pfx___dev_open+0x10/0x10 [ 834.596717][ T4476] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 834.596724][ T4476] netif_open+0xc9/0x130 [ 834.596727][ T4476] ? __pfx_netif_open+0x10/0x10 [ 834.596731][ T4476] dev_open+0x9f/0x1a0 [ 834.596735][ T4476] team_port_add+0x90a/0x1ce0 [ 834.596740][ T4476] ? __pfx_team_port_add+0x10/0x10 [ 834.596744][ T4476] ? rcu_read_lock_any_held+0x43/0xb0 [ 834.596750][ T4476] ? validate_chain+0x1fe/0xae0 [ 834.596755][ T4476] team_add_slave+0x41/0x80 [ 834.596759][ T4476] do_set_master+0x302/0x610 [ 834.596763][ T4476] do_setlink.constprop.0+0x87b/0x25f0 [ 834.596767][ T4476] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 834.596771][ T4476] ? lock_acquire.part.0+0xeb/0x330 [ 834.596774][ T4476] ? rtnl_newlink+0x653/0xa70 [ 834.596777][ T4476] ? rtnl_newlink+0xb9/0xa70 [ 834.596779][ T4476] ? rtnetlink_rcv_msg+0x712/0xc10 [ 834.596783][ T4476] ? __mutex_trylock_common+0xfa/0x260 [ 834.596787][ T4476] ? __pfx___mutex_trylock_common+0x10/0x10 [ 834.596790][ T4476] ? lock_acquire+0x32/0xc0 [ 834.596794][ T4476] ? trace_contention_end+0xef/0x150 [ 834.596798][ T4476] ? __mutex_lock+0x190/0xc40 [ 834.596801][ T4476] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 834.596804][ T4476] ? rtnl_newlink+0x653/0xa70 [ 834.596808][ T4476] ? __pfx___mutex_lock+0x10/0x10 [ 834.596810][ T4476] ? __pfx_validate_nla+0x10/0x10 [ 834.596816][ T4476] ? trace_cap_capable+0x11e/0x1a0 [ 834.596823][ T4476] ? __rtnl_newlink+0x3f2/0xa80 [ 834.596828][ T4476] rtnl_newlink+0x69c/0xa70 [ 834.596833][ T4476] ? __pfx_rtnl_newlink+0x10/0x10 [ 834.596835][ T4476] ? find_held_lock+0x2c/0x110 [ 834.596840][ T4476] ? __pfx___lock_release+0x10/0x10 [ 834.596843][ T4476] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 834.596848][ T4476] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 834.596851][ T4476] ? __pfx_rtnl_newlink+0x10/0x10 [ 834.596854][ T4476] rtnetlink_rcv_msg+0x712/0xc10 [ 834.596857][ T4476] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 834.596861][ T4476] ? hlock_class+0x4e/0x130 [ 834.596863][ T4476] ? mark_lock+0x38/0x3e0 [ 834.596867][ T4476] ? __lock_acquire+0xb9a/0x1680 [ 834.596871][ T4476] netlink_rcv_skb+0x130/0x360 [ 834.596874][ T4476] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 834.596878][ T4476] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 834.596885][ T4476] ? netlink_deliver_tap+0x13e/0x340 [ 834.596889][ T4476] ? netlink_deliver_tap+0xc3/0x340 [ 834.596893][ T4476] netlink_unicast+0x44b/0x710 [ 834.596897][ T4476] ? __pfx_netlink_unicast+0x10/0x10 [ 834.596900][ T4476] ? find_held_lock+0x2c/0x110 [ 834.596905][ T4476] netlink_sendmsg+0x723/0xbe0 [ 834.596909][ T4476] ? __pfx_netlink_sendmsg+0x10/0x10 [ 834.596915][ T4476] ____sys_sendmsg+0x7ac/0xa10 [ 834.596919][ T4476] ? __pfx_____sys_sendmsg+0x10/0x10 [ 834.596922][ T4476] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 834.596929][ T4476] ___sys_sendmsg+0xee/0x170 [ 834.596933][ T4476] ? __pfx____sys_sendmsg+0x10/0x10 [ 834.596937][ T4476] ? kasan_save_stack+0x34/0x50 [ 834.596942][ T4476] ? kasan_save_stack+0x24/0x50 [ 834.596945][ T4476] ? kasan_record_aux_stack+0x8c/0xa0 [ 834.596949][ T4476] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 834.596953][ T4476] ? __x64_sys_close+0x7c/0xd0 [ 834.596956][ T4476] ? do_syscall_64+0xc1/0x1d0 [ 834.596958][ T4476] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 834.596962][ T4476] ? __lock_acquire+0xb9a/0x1680 [ 834.596965][ T4476] ? lock_downgrade+0x52/0x110 [ 834.596968][ T4476] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 834.596972][ T4476] ? find_held_lock+0x2c/0x110 [ 834.596976][ T4476] ? __lock_release+0x103/0x460 [ 834.596979][ T4476] ? __virt_addr_valid+0x22b/0x430 [ 834.596985][ T4476] ? __pfx___lock_release+0x10/0x10 [ 834.596988][ T4476] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 834.596992][ T4476] __sys_sendmsg+0x109/0x1a0 [ 834.596996][ T4476] ? __pfx___sys_sendmsg+0x10/0x10 [ 834.597004][ T4476] do_syscall_64+0xc1/0x1d0 [ 834.597007][ T4476] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 834.597010][ T4476] RIP: 0033:0x7f91f22669a7 [ 834.597015][ T4476] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 834.597018][ T4476] RSP: 002b:00007ffe0d96cbf8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 834.597022][ T4476] RAX: ffffffffffffffda RBX: 00007ffe0d96d320 RCX: 00007f91f22669a7 [ 834.597024][ T4476] RDX: 0000000000000000 RSI: 00007ffe0d96cc60 RDI: 0000000000000005 [ 834.597026][ T4476] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 834.597027][ T4476] R10: 000000000f3e3910 R11: 0000000000000246 R12: 0000000000000004 [ 834.597029][ T4476] R13: 0000000067b2d691 R14: 0000000000498600 R15: 0000000000000000 [ 834.597035][ T4476] [ 834.624095][ T4476] lag1: Port device veth0 added [ 834.631111][ T4476] ip (4476) used greatest stack depth: 23544 bytes left [ 834.702035][ T4477] lag1: Port device veth6 added [ 835.018148][ T4483] 8021q: adding VLAN 0 to HW filter on device lag1 [ 836.265091][ T4506] lag4: Mode changed to "loadbalance" [ 836.333263][ T4508] 8021q: adding VLAN 0 to HW filter on device lag4 [ 836.632060][ T4514] lag4: Port device veth3 added [ 836.711680][ T4515] lag4: Port device veth5 added [ 837.076778][ T4521] 8021q: adding VLAN 0 to HW filter on device lag4 [ 838.455245][ T4544] lag2: Mode changed to "loadbalance" [ 838.540651][ T4546] 8021q: adding VLAN 0 to HW filter on device lag2 [ 838.860998][ T4552] lag2: Port device veth1 added [ 838.948784][ T4553] lag2: Port device veth7 added [ 839.575528][ T4566] br1: port 1(lag2.100) entered blocking state [ 839.575790][ T4566] br1: port 1(lag2.100) entered disabled state [ 839.576028][ T4566] lag2.100: entered allmulticast mode [ 839.577033][ T4566] lag2: entered allmulticast mode [ 839.577283][ T4566] veth1: entered allmulticast mode [ 839.577444][ T4566] veth7: entered allmulticast mode [ 839.579394][ T4566] lag2.100: entered promiscuous mode [ 839.579567][ T4566] lag2: entered promiscuous mode [ 839.579730][ T4566] veth1: entered promiscuous mode [ 839.580074][ T4566] veth7: entered promiscuous mode [ 839.909044][ T4573] br2: port 1(lag2.200) entered blocking state [ 839.909377][ T4573] br2: port 1(lag2.200) entered disabled state [ 839.909658][ T4573] lag2.200: entered allmulticast mode [ 839.912603][ T4573] lag2.200: entered promiscuous mode [ 840.106746][ T4576] br1: port 1(lag2.100) entered blocking state [ 840.107021][ T4576] br1: port 1(lag2.100) entered forwarding state [ 840.180183][ T4577] br2: port 1(lag2.200) entered blocking state [ 840.180442][ T4577] br2: port 1(lag2.200) entered forwarding state [ 840.600416][ T4585] lag3: Mode changed to "loadbalance" [ 840.672757][ T4587] 8021q: adding VLAN 0 to HW filter on device lag3 [ 841.024926][ T4593] lag3: Port device veth2 added [ 841.113951][ T4594] lag3: Port device veth4 added [ 853.082444][ T4676] veth7: left promiscuous mode [ 853.082911][ T4676] veth7: left allmulticast mode [ 853.085017][ T4676] lag2: Port device veth7 removed [ 868.456102][ T4737] veth7: entered promiscuous mode [ 868.456494][ T4737] veth7: entered allmulticast mode [ 868.457291][ T4737] lag2: Port device veth7 added [ 868.741831][ T4748] veth1: left promiscuous mode [ 868.742417][ T4748] veth1: left allmulticast mode [ 868.745063][ T4748] lag2: Port device veth1 removed [ 884.027730][ T40] br1: port 1(lag2.100) entered disabled state [ 884.028846][ T40] br2: port 1(lag2.200) entered disabled state [ 884.093983][ T4809] veth7: left promiscuous mode [ 884.094423][ T4809] veth7: left allmulticast mode [ 884.095594][ T4809] lag2: Port device veth7 removed [ 884.377851][ T4820] veth1: entered promiscuous mode [ 884.378242][ T4820] veth1: entered allmulticast mode [ 884.379081][ T4820] lag2: Port device veth1 added [ 884.401306][ T4434] br1: port 1(lag2.100) entered blocking state [ 884.401615][ T4434] br1: port 1(lag2.100) entered forwarding state [ 884.402308][ T4434] br2: port 1(lag2.200) entered blocking state [ 884.402515][ T4434] br2: port 1(lag2.200) entered forwarding state [ 884.648931][ T4831] veth7: entered promiscuous mode [ 884.650454][ T4831] veth7: entered allmulticast mode [ 884.651318][ T4831] lag2: Port device veth7 added [ 899.909759][ T4891] lag2.200: left allmulticast mode [ 899.910033][ T4891] lag2.200: left promiscuous mode [ 899.911033][ T4891] br2: port 1(lag2.200) entered disabled state [ 900.001004][ T4892] lag2.100: left allmulticast mode [ 900.001370][ T4892] lag2: left allmulticast mode [ 900.001602][ T4892] veth1: left allmulticast mode [ 900.001842][ T4892] veth7: left allmulticast mode [ 900.002086][ T4892] lag2.100: left promiscuous mode [ 900.002323][ T4892] lag2: left promiscuous mode [ 900.002548][ T4892] veth1: left promiscuous mode [ 900.003112][ T4892] veth7: left promiscuous mode [ 900.004134][ T4892] br1: port 1(lag2.100) entered disabled state [ 902.136845][ T4894] br1: port 1(lag2.100) entered blocking state [ 902.137137][ T4894] br1: port 1(lag2.100) entered disabled state [ 902.137403][ T4894] lag2.100: entered allmulticast mode [ 902.137579][ T4894] lag2: entered allmulticast mode [ 902.137773][ T4894] veth1: entered allmulticast mode [ 902.137967][ T4894] veth7: entered allmulticast mode [ 902.141062][ T4894] lag2.100: entered promiscuous mode [ 902.141296][ T4894] lag2: entered promiscuous mode [ 902.141471][ T4894] veth1: entered promiscuous mode [ 902.141854][ T4894] veth7: entered promiscuous mode [ 902.143020][ T4894] br1: port 1(lag2.100) entered blocking state [ 902.143299][ T4894] br1: port 1(lag2.100) entered forwarding state [ 902.208389][ T4895] br2: port 1(lag2.200) entered blocking state [ 902.208692][ T4895] br2: port 1(lag2.200) entered disabled state [ 902.209039][ T4895] lag2.200: entered allmulticast mode [ 902.210732][ T4895] lag2.200: entered promiscuous mode [ 902.211950][ T4895] br2: port 1(lag2.200) entered blocking state [ 902.212238][ T4895] br2: port 1(lag2.200) entered forwarding state [ 917.397921][ T4955] lag3: Port device veth2 removed [ 932.662223][ T5016] lag3: Port device veth2 added [ 932.961945][ T5027] lag3: Port device veth4 removed [ 948.255991][ T5088] lag3: Port device veth2 removed [ 948.543007][ T5099] lag3: Port device veth4 added [ 948.821104][ T5110] lag3: Port device veth2 added [ 964.669910][ T5180] lag3: Port device veth4 removed [ 964.728840][ T5181] lag3: Port device veth2 removed [ 965.342472][ T5193] br2: port 1(lag2.200) entered disabled state [ 965.415818][ T5194] br1: port 1(lag2.100) entered disabled state [ 965.613270][ T5197] lag2.200: left allmulticast mode [ 965.613507][ T5197] lag2.200: left promiscuous mode [ 965.614043][ T5197] br2: port 1(lag2.200) entered disabled state [ 965.797408][ T5199] lag2.100: left allmulticast mode [ 965.797616][ T5199] lag2: left allmulticast mode [ 965.797786][ T5199] veth1: left allmulticast mode [ 965.797965][ T5199] veth7: left allmulticast mode [ 965.798148][ T5199] lag2.100: left promiscuous mode [ 965.798327][ T5199] lag2: left promiscuous mode [ 965.798489][ T5199] veth1: left promiscuous mode [ 965.798886][ T5199] veth7: left promiscuous mode [ 965.799562][ T5199] br1: port 1(lag2.100) entered disabled state [ 966.151924][ T5203] lag2: Port device veth7 removed [ 966.209411][ T5204] lag2: Port device veth1 removed [ 967.624469][ T5220] lag4: Port device veth5 removed [ 967.694767][ T5221] lag4: Port device veth3 removed [ 969.198639][ T5236] lag1: Port device veth6 removed [ 969.289242][ T5237] lag1: Port device veth0 removed