[ 832.154693][ T4561] lag1: Mode changed to "loadbalance" [ 832.257438][ T4562] 8021q: adding VLAN 0 to HW filter on device lag1 [ 832.678945][ T4575] [ 832.679084][ T4575] ====================================================== [ 832.679287][ T4575] WARNING: possible circular locking dependency detected [ 832.679505][ T4575] 6.14.0-rc2-virtme #1 Not tainted [ 832.679672][ T4575] ------------------------------------------------------ [ 832.679872][ T4575] ip/4575 is trying to acquire lock: [ 832.680038][ T4575] ffff888005dd1cb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 832.680298][ T4575] [ 832.680298][ T4575] but task is already holding lock: [ 832.680545][ T4575] ffff88800e752d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 832.680850][ T4575] [ 832.680850][ T4575] which lock already depends on the new lock. [ 832.680850][ T4575] [ 832.681186][ T4575] [ 832.681186][ T4575] the existing dependency chain (in reverse order) is: [ 832.681445][ T4575] [ 832.681445][ T4575] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 832.681681][ T4575] __lock_acquire+0xb9a/0x1680 [ 832.681832][ T4575] lock_acquire.part.0+0xeb/0x330 [ 832.681981][ T4575] __mutex_lock+0x169/0xc40 [ 832.682129][ T4575] team_set_mac_address+0x120/0x250 [ 832.682274][ T4575] netif_set_mac_address+0x28a/0x410 [ 832.682453][ T4575] do_setlink.constprop.0+0x1980/0x25f0 [ 832.682647][ T4575] rtnl_setlink+0x2b5/0x5a0 [ 832.682797][ T4575] rtnetlink_rcv_msg+0x712/0xc10 [ 832.682943][ T4575] netlink_rcv_skb+0x130/0x360 [ 832.683092][ T4575] netlink_unicast+0x44b/0x710 [ 832.683240][ T4575] netlink_sendmsg+0x723/0xbe0 [ 832.683387][ T4575] __sys_sendto+0x3c3/0x450 [ 832.683534][ T4575] __x64_sys_sendto+0xe0/0x1c0 [ 832.683685][ T4575] do_syscall_64+0xc1/0x1d0 [ 832.683834][ T4575] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 832.684018][ T4575] [ 832.684018][ T4575] -> #0 (&dev->lock){+.+.}-{4:4}: [ 832.684238][ T4575] check_prev_add+0x182/0xce0 [ 832.684389][ T4575] validate_chain+0x7bd/0xae0 [ 832.684535][ T4575] __lock_acquire+0xb9a/0x1680 [ 832.684687][ T4575] lock_acquire.part.0+0xeb/0x330 [ 832.684834][ T4575] __mutex_lock+0x169/0xc40 [ 832.684980][ T4575] __dev_open+0x57e/0x710 [ 832.685125][ T4575] netif_open+0xc9/0x130 [ 832.685273][ T4575] dev_open+0x9f/0x1a0 [ 832.685420][ T4575] team_port_add+0x90a/0x1ce0 [ 832.685570][ T4575] team_add_slave+0x41/0x80 [ 832.685717][ T4575] do_set_master+0x302/0x610 [ 832.685868][ T4575] do_setlink.constprop.0+0x87b/0x25f0 [ 832.686049][ T4575] rtnl_newlink+0x69c/0xa70 [ 832.686195][ T4575] rtnetlink_rcv_msg+0x712/0xc10 [ 832.686345][ T4575] netlink_rcv_skb+0x130/0x360 [ 832.686504][ T4575] netlink_unicast+0x44b/0x710 [ 832.686650][ T4575] netlink_sendmsg+0x723/0xbe0 [ 832.686805][ T4575] ____sys_sendmsg+0x7ac/0xa10 [ 832.686952][ T4575] ___sys_sendmsg+0xee/0x170 [ 832.687098][ T4575] __sys_sendmsg+0x109/0x1a0 [ 832.687243][ T4575] do_syscall_64+0xc1/0x1d0 [ 832.687391][ T4575] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 832.687571][ T4575] [ 832.687571][ T4575] other info that might help us debug this: [ 832.687571][ T4575] [ 832.687855][ T4575] Possible unsafe locking scenario: [ 832.687855][ T4575] [ 832.688075][ T4575] CPU0 CPU1 [ 832.688222][ T4575] ---- ---- [ 832.688365][ T4575] lock(team->team_lock_key); [ 832.688513][ T4575] lock(&dev->lock); [ 832.688696][ T4575] lock(team->team_lock_key); [ 832.688917][ T4575] lock(&dev->lock); [ 832.689030][ T4575] [ 832.689030][ T4575] *** DEADLOCK *** [ 832.689030][ T4575] [ 832.689245][ T4575] 2 locks held by ip/4575: [ 832.689397][ T4575] #0: ffffffffb53eeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 832.689660][ T4575] #1: ffff88800e752d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 832.689926][ T4575] [ 832.689926][ T4575] stack backtrace: [ 832.690108][ T4575] CPU: 1 UID: 0 PID: 4575 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 832.690113][ T4575] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 832.690115][ T4575] Call Trace: [ 832.690117][ T4575] [ 832.690119][ T4575] dump_stack_lvl+0x82/0xd0 [ 832.690126][ T4575] print_circular_bug+0x1b7/0x240 [ 832.690131][ T4575] check_noncircular+0x2f9/0x3e0 [ 832.690134][ T4575] ? __pfx_check_noncircular+0x10/0x10 [ 832.690138][ T4575] ? find_held_lock+0x2c/0x110 [ 832.690144][ T4575] ? alloc_chain_hlocks+0x4e0/0x720 [ 832.690148][ T4575] check_prev_add+0x182/0xce0 [ 832.690152][ T4575] validate_chain+0x7bd/0xae0 [ 832.690157][ T4575] ? stack_depot_save_flags+0x27e/0x440 [ 832.690162][ T4575] ? __pfx_validate_chain+0x10/0x10 [ 832.690165][ T4575] ? hlock_class+0x4e/0x130 [ 832.690167][ T4575] ? mark_lock+0x38/0x3e0 [ 832.690171][ T4575] __lock_acquire+0xb9a/0x1680 [ 832.690176][ T4575] ? mark_lock+0x38/0x3e0 [ 832.690179][ T4575] lock_acquire.part.0+0xeb/0x330 [ 832.690182][ T4575] ? __dev_open+0x57e/0x710 [ 832.690185][ T4575] ? validate_chain+0x162/0xae0 [ 832.690188][ T4575] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 832.690191][ T4575] ? trace_lock_acquire+0x14c/0x1f0 [ 832.690195][ T4575] ? lock_acquire+0x32/0xc0 [ 832.690197][ T4575] ? __dev_open+0x57e/0x710 [ 832.690200][ T4575] __mutex_lock+0x169/0xc40 [ 832.690203][ T4575] ? __dev_open+0x57e/0x710 [ 832.690206][ T4575] ? __dev_open+0x57e/0x710 [ 832.690208][ T4575] ? __pfx___mutex_lock+0x10/0x10 [ 832.690212][ T4575] ? packet_notifier+0x3b0/0x810 [ 832.690221][ T4575] ? __dev_open+0x57e/0x710 [ 832.690223][ T4575] __dev_open+0x57e/0x710 [ 832.690225][ T4575] ? mark_held_locks+0x9e/0xe0 [ 832.690228][ T4575] ? __pfx___dev_open+0x10/0x10 [ 832.690231][ T4575] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 832.690237][ T4575] netif_open+0xc9/0x130 [ 832.690240][ T4575] ? __pfx_netif_open+0x10/0x10 [ 832.690244][ T4575] dev_open+0x9f/0x1a0 [ 832.690247][ T4575] team_port_add+0x90a/0x1ce0 [ 832.690252][ T4575] ? __pfx_team_port_add+0x10/0x10 [ 832.690255][ T4575] ? rcu_read_lock_any_held+0x43/0xb0 [ 832.690260][ T4575] ? validate_chain+0x1fe/0xae0 [ 832.690265][ T4575] team_add_slave+0x41/0x80 [ 832.690269][ T4575] do_set_master+0x302/0x610 [ 832.690273][ T4575] do_setlink.constprop.0+0x87b/0x25f0 [ 832.690277][ T4575] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 832.690281][ T4575] ? lock_acquire.part.0+0xeb/0x330 [ 832.690284][ T4575] ? rtnl_newlink+0x653/0xa70 [ 832.690287][ T4575] ? rtnl_newlink+0xb9/0xa70 [ 832.690289][ T4575] ? rtnetlink_rcv_msg+0x712/0xc10 [ 832.690292][ T4575] ? __mutex_trylock_common+0xfa/0x260 [ 832.690296][ T4575] ? __pfx___mutex_trylock_common+0x10/0x10 [ 832.690300][ T4575] ? lock_acquire+0x32/0xc0 [ 832.690303][ T4575] ? trace_contention_end+0xef/0x150 [ 832.690306][ T4575] ? __mutex_lock+0x190/0xc40 [ 832.690309][ T4575] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 832.690313][ T4575] ? rtnl_newlink+0x653/0xa70 [ 832.690316][ T4575] ? __pfx___mutex_lock+0x10/0x10 [ 832.690318][ T4575] ? __pfx_validate_nla+0x10/0x10 [ 832.690323][ T4575] ? trace_cap_capable+0x11e/0x1a0 [ 832.690329][ T4575] ? __rtnl_newlink+0x3f2/0xa80 [ 832.690333][ T4575] rtnl_newlink+0x69c/0xa70 [ 832.690338][ T4575] ? __pfx_rtnl_newlink+0x10/0x10 [ 832.690340][ T4575] ? find_held_lock+0x2c/0x110 [ 832.690345][ T4575] ? __pfx___lock_release+0x10/0x10 [ 832.690348][ T4575] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 832.690353][ T4575] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 832.690356][ T4575] ? __pfx_rtnl_newlink+0x10/0x10 [ 832.690359][ T4575] rtnetlink_rcv_msg+0x712/0xc10 [ 832.690363][ T4575] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 832.690366][ T4575] ? hlock_class+0x4e/0x130 [ 832.690368][ T4575] ? mark_lock+0x38/0x3e0 [ 832.690372][ T4575] ? __lock_acquire+0xb9a/0x1680 [ 832.690376][ T4575] netlink_rcv_skb+0x130/0x360 [ 832.690379][ T4575] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 832.690383][ T4575] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 832.690390][ T4575] ? netlink_deliver_tap+0x13e/0x340 [ 832.690393][ T4575] ? netlink_deliver_tap+0xc3/0x340 [ 832.690397][ T4575] netlink_unicast+0x44b/0x710 [ 832.690401][ T4575] ? __pfx_netlink_unicast+0x10/0x10 [ 832.690404][ T4575] ? find_held_lock+0x2c/0x110 [ 832.690409][ T4575] netlink_sendmsg+0x723/0xbe0 [ 832.690413][ T4575] ? __pfx_netlink_sendmsg+0x10/0x10 [ 832.690419][ T4575] ____sys_sendmsg+0x7ac/0xa10 [ 832.690423][ T4575] ? __pfx_____sys_sendmsg+0x10/0x10 [ 832.690426][ T4575] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 832.690432][ T4575] ___sys_sendmsg+0xee/0x170 [ 832.690436][ T4575] ? __pfx____sys_sendmsg+0x10/0x10 [ 832.690440][ T4575] ? kasan_save_stack+0x34/0x50 [ 832.690445][ T4575] ? kasan_save_stack+0x24/0x50 [ 832.690447][ T4575] ? kasan_record_aux_stack+0x8c/0xa0 [ 832.690450][ T4575] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 832.690454][ T4575] ? __x64_sys_close+0x7c/0xd0 [ 832.690457][ T4575] ? do_syscall_64+0xc1/0x1d0 [ 832.690460][ T4575] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 832.690462][ T4575] ? __lock_acquire+0xb9a/0x1680 [ 832.690465][ T4575] ? lock_downgrade+0x52/0x110 [ 832.690469][ T4575] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 832.690473][ T4575] ? find_held_lock+0x2c/0x110 [ 832.690477][ T4575] ? __lock_release+0x103/0x460 [ 832.690479][ T4575] ? __virt_addr_valid+0x22b/0x430 [ 832.690484][ T4575] ? __pfx___lock_release+0x10/0x10 [ 832.690487][ T4575] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 832.690491][ T4575] __sys_sendmsg+0x109/0x1a0 [ 832.690494][ T4575] ? __pfx___sys_sendmsg+0x10/0x10 [ 832.690502][ T4575] do_syscall_64+0xc1/0x1d0 [ 832.690505][ T4575] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 832.690508][ T4575] RIP: 0033:0x7fdbe19fd9a7 [ 832.690512][ T4575] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 832.690515][ T4575] RSP: 002b:00007ffd3cb3fca8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 832.690518][ T4575] RAX: ffffffffffffffda RBX: 00007ffd3cb403d0 RCX: 00007fdbe19fd9a7 [ 832.690520][ T4575] RDX: 0000000000000000 RSI: 00007ffd3cb3fd10 RDI: 0000000000000005 [ 832.690522][ T4575] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 832.690524][ T4575] R10: 000000000a7f9910 R11: 0000000000000246 R12: 0000000000000004 [ 832.690525][ T4575] R13: 0000000067b32b22 R14: 0000000000498600 R15: 0000000000000000 [ 832.690530][ T4575] [ 832.711098][ T4575] lag1: Port device veth0 added [ 832.778991][ T4580] lag1: Port device veth6 added [ 833.083100][ T4586] 8021q: adding VLAN 0 to HW filter on device lag1 [ 834.319660][ T4609] lag4: Mode changed to "loadbalance" [ 834.404287][ T4611] 8021q: adding VLAN 0 to HW filter on device lag4 [ 834.703484][ T4617] lag4: Port device veth3 added [ 834.770359][ T4618] lag4: Port device veth5 added [ 835.114867][ T4624] 8021q: adding VLAN 0 to HW filter on device lag4 [ 836.398077][ T4647] lag2: Mode changed to "loadbalance" [ 836.466981][ T4649] 8021q: adding VLAN 0 to HW filter on device lag2 [ 836.752910][ T4655] lag2: Port device veth1 added [ 836.826872][ T4656] lag2: Port device veth7 added [ 837.357858][ T4669] br1: port 1(lag2.100) entered blocking state [ 837.358134][ T4669] br1: port 1(lag2.100) entered disabled state [ 837.358368][ T4669] lag2.100: entered allmulticast mode [ 837.358531][ T4669] lag2: entered allmulticast mode [ 837.358699][ T4669] veth1: entered allmulticast mode [ 837.359278][ T4669] veth7: entered allmulticast mode [ 837.361213][ T4669] lag2.100: entered promiscuous mode [ 837.361415][ T4669] lag2: entered promiscuous mode [ 837.361578][ T4669] veth1: entered promiscuous mode [ 837.361941][ T4669] veth7: entered promiscuous mode [ 837.665735][ T4676] br2: port 1(lag2.200) entered blocking state [ 837.665977][ T4676] br2: port 1(lag2.200) entered disabled state [ 837.666188][ T4676] lag2.200: entered allmulticast mode [ 837.667788][ T4676] lag2.200: entered promiscuous mode [ 837.852326][ T4679] br1: port 1(lag2.100) entered blocking state [ 837.852607][ T4679] br1: port 1(lag2.100) entered forwarding state [ 837.926388][ T4680] br2: port 1(lag2.200) entered blocking state [ 837.926698][ T4680] br2: port 1(lag2.200) entered forwarding state [ 838.320187][ T4688] lag3: Mode changed to "loadbalance" [ 838.406549][ T4690] 8021q: adding VLAN 0 to HW filter on device lag3 [ 838.733397][ T4696] lag3: Port device veth2 added [ 838.817575][ T4698] lag3: Port device veth4 added [ 850.361656][ T4780] veth7: left promiscuous mode [ 850.362092][ T4780] veth7: left allmulticast mode [ 850.363535][ T4780] lag2: Port device veth7 removed [ 865.634607][ T4841] veth7: entered promiscuous mode [ 865.634979][ T4841] veth7: entered allmulticast mode [ 865.635718][ T4841] lag2: Port device veth7 added [ 865.864335][ T4852] veth1: left promiscuous mode [ 865.865237][ T4852] veth1: left allmulticast mode [ 865.866515][ T4852] lag2: Port device veth1 removed [ 881.077643][ T38] br1: port 1(lag2.100) entered disabled state [ 881.078741][ T38] br2: port 1(lag2.200) entered disabled state [ 881.137337][ T4913] veth7: left promiscuous mode [ 881.137829][ T4913] veth7: left allmulticast mode [ 881.139184][ T4913] lag2: Port device veth7 removed [ 881.425265][ T4924] veth1: entered promiscuous mode [ 881.425785][ T4924] veth1: entered allmulticast mode [ 881.426756][ T4924] lag2: Port device veth1 added [ 881.452232][ T69] br1: port 1(lag2.100) entered blocking state [ 881.452532][ T69] br1: port 1(lag2.100) entered forwarding state [ 881.453552][ T69] br2: port 1(lag2.200) entered blocking state [ 881.453826][ T69] br2: port 1(lag2.200) entered forwarding state [ 881.707894][ T4935] veth7: entered promiscuous mode [ 881.708279][ T4935] veth7: entered allmulticast mode [ 881.709062][ T4935] lag2: Port device veth7 added [ 896.847402][ T4995] lag2.200: left allmulticast mode [ 896.847609][ T4995] lag2.200: left promiscuous mode [ 896.848144][ T4995] br2: port 1(lag2.200) entered disabled state [ 896.929581][ T4996] lag2.100: left allmulticast mode [ 896.929897][ T4996] lag2: left allmulticast mode [ 896.930160][ T4996] veth1: left allmulticast mode [ 896.930426][ T4996] veth7: left allmulticast mode [ 896.930718][ T4996] lag2.100: left promiscuous mode [ 896.930961][ T4996] lag2: left promiscuous mode [ 896.931205][ T4996] veth1: left promiscuous mode [ 896.931818][ T4996] veth7: left promiscuous mode [ 896.933195][ T4996] br1: port 1(lag2.100) entered disabled state [ 899.047520][ T4998] br1: port 1(lag2.100) entered blocking state [ 899.047793][ T4998] br1: port 1(lag2.100) entered disabled state [ 899.048041][ T4998] lag2.100: entered allmulticast mode [ 899.048201][ T4998] lag2: entered allmulticast mode [ 899.048364][ T4998] veth1: entered allmulticast mode [ 899.048546][ T4998] veth7: entered allmulticast mode [ 899.050156][ T4998] lag2.100: entered promiscuous mode [ 899.050341][ T4998] lag2: entered promiscuous mode [ 899.050507][ T4998] veth1: entered promiscuous mode [ 899.050900][ T4998] veth7: entered promiscuous mode [ 899.052091][ T4998] br1: port 1(lag2.100) entered blocking state [ 899.052321][ T4998] br1: port 1(lag2.100) entered forwarding state [ 899.125118][ T4999] br2: port 1(lag2.200) entered blocking state [ 899.125350][ T4999] br2: port 1(lag2.200) entered disabled state [ 899.125562][ T4999] lag2.200: entered allmulticast mode [ 899.127897][ T4999] lag2.200: entered promiscuous mode [ 899.128838][ T4999] br2: port 1(lag2.200) entered blocking state [ 899.129031][ T4999] br2: port 1(lag2.200) entered forwarding state [ 914.208642][ T5059] lag3: Port device veth2 removed [ 929.469959][ T5120] lag3: Port device veth2 added [ 929.738231][ T5131] lag3: Port device veth4 removed [ 945.043944][ T5192] lag3: Port device veth2 removed [ 945.300208][ T5203] lag3: Port device veth4 added [ 945.553386][ T5214] lag3: Port device veth2 added [ 961.353890][ T5284] lag3: Port device veth4 removed [ 961.416693][ T5285] lag3: Port device veth2 removed [ 962.108774][ T5297] br2: port 1(lag2.200) entered disabled state [ 962.176222][ T5298] br1: port 1(lag2.100) entered disabled state [ 962.384876][ T5301] lag2.200: left allmulticast mode [ 962.385078][ T5301] lag2.200: left promiscuous mode [ 962.385573][ T5301] br2: port 1(lag2.200) entered disabled state [ 962.542651][ T5303] lag2.100: left allmulticast mode [ 962.542924][ T5303] lag2: left allmulticast mode [ 962.543105][ T5303] veth1: left allmulticast mode [ 962.543274][ T5303] veth7: left allmulticast mode [ 962.543444][ T5303] lag2.100: left promiscuous mode [ 962.543608][ T5303] lag2: left promiscuous mode [ 962.544803][ T5303] veth1: left promiscuous mode [ 962.545260][ T5303] veth7: left promiscuous mode [ 962.545936][ T5303] br1: port 1(lag2.100) entered disabled state [ 962.917829][ T5307] lag2: Port device veth7 removed [ 962.994607][ T5308] lag2: Port device veth1 removed [ 964.279586][ T5324] lag4: Port device veth5 removed [ 964.348338][ T5325] lag4: Port device veth3 removed [ 965.615300][ T5341] lag1: Port device veth6 removed [ 965.673422][ T5342] lag1: Port device veth0 removed