[ 1378.791952][ T8689] lag1: Mode changed to "loadbalance" [ 1378.895359][ T8691] 8021q: adding VLAN 0 to HW filter on device lag1 [ 1379.225422][ T8698] [ 1379.225549][ T8698] ====================================================== [ 1379.225735][ T8698] WARNING: possible circular locking dependency detected [ 1379.225920][ T8698] 6.14.0-rc2-virtme #1 Not tainted [ 1379.226068][ T8698] ------------------------------------------------------ [ 1379.226262][ T8698] ip/8698 is trying to acquire lock: [ 1379.226411][ T8698] ffff888007821cb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 1379.226660][ T8698] [ 1379.226660][ T8698] but task is already holding lock: [ 1379.226882][ T8698] ffff88800ea52d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1379.227168][ T8698] [ 1379.227168][ T8698] which lock already depends on the new lock. [ 1379.227168][ T8698] [ 1379.227456][ T8698] [ 1379.227456][ T8698] the existing dependency chain (in reverse order) is: [ 1379.227714][ T8698] [ 1379.227714][ T8698] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 1379.227942][ T8698] __lock_acquire+0xb9a/0x1680 [ 1379.228101][ T8698] lock_acquire.part.0+0xeb/0x330 [ 1379.228250][ T8698] __mutex_lock+0x169/0xc40 [ 1379.228400][ T8698] team_set_mac_address+0x120/0x250 [ 1379.228549][ T8698] netif_set_mac_address+0x28a/0x410 [ 1379.228732][ T8698] do_setlink.constprop.0+0x1980/0x25f0 [ 1379.228925][ T8698] rtnl_setlink+0x2b5/0x5a0 [ 1379.229075][ T8698] rtnetlink_rcv_msg+0x712/0xc10 [ 1379.229227][ T8698] netlink_rcv_skb+0x130/0x360 [ 1379.229380][ T8698] netlink_unicast+0x44b/0x710 [ 1379.229529][ T8698] netlink_sendmsg+0x723/0xbe0 [ 1379.229679][ T8698] __sys_sendto+0x3c3/0x450 [ 1379.229836][ T8698] __x64_sys_sendto+0xe0/0x1c0 [ 1379.229986][ T8698] do_syscall_64+0xc1/0x1d0 [ 1379.230134][ T8698] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1379.230329][ T8698] [ 1379.230329][ T8698] -> #0 (&dev->lock){+.+.}-{4:4}: [ 1379.230558][ T8698] check_prev_add+0x182/0xce0 [ 1379.230711][ T8698] validate_chain+0x7bd/0xae0 [ 1379.230859][ T8698] __lock_acquire+0xb9a/0x1680 [ 1379.231009][ T8698] lock_acquire.part.0+0xeb/0x330 [ 1379.231158][ T8698] __mutex_lock+0x169/0xc40 [ 1379.231308][ T8698] __dev_open+0x57e/0x710 [ 1379.231460][ T8698] netif_open+0xc9/0x130 [ 1379.231611][ T8698] dev_open+0x9f/0x1a0 [ 1379.231764][ T8698] team_port_add+0x90a/0x1ce0 [ 1379.231920][ T8698] team_add_slave+0x41/0x80 [ 1379.232068][ T8698] do_set_master+0x302/0x610 [ 1379.232217][ T8698] do_setlink.constprop.0+0x87b/0x25f0 [ 1379.232400][ T8698] rtnl_newlink+0x69c/0xa70 [ 1379.232545][ T8698] rtnetlink_rcv_msg+0x712/0xc10 [ 1379.232694][ T8698] netlink_rcv_skb+0x130/0x360 [ 1379.232844][ T8698] netlink_unicast+0x44b/0x710 [ 1379.232994][ T8698] netlink_sendmsg+0x723/0xbe0 [ 1379.233144][ T8698] ____sys_sendmsg+0x7ac/0xa10 [ 1379.233291][ T8698] ___sys_sendmsg+0xee/0x170 [ 1379.233439][ T8698] __sys_sendmsg+0x109/0x1a0 [ 1379.233588][ T8698] do_syscall_64+0xc1/0x1d0 [ 1379.233734][ T8698] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1379.233920][ T8698] [ 1379.233920][ T8698] other info that might help us debug this: [ 1379.233920][ T8698] [ 1379.234218][ T8698] Possible unsafe locking scenario: [ 1379.234218][ T8698] [ 1379.234436][ T8698] CPU0 CPU1 [ 1379.234582][ T8698] ---- ---- [ 1379.234727][ T8698] lock(team->team_lock_key); [ 1379.234875][ T8698] lock(&dev->lock); [ 1379.235059][ T8698] lock(team->team_lock_key); [ 1379.235282][ T8698] lock(&dev->lock); [ 1379.235395][ T8698] [ 1379.235395][ T8698] *** DEADLOCK *** [ 1379.235395][ T8698] [ 1379.235610][ T8698] 2 locks held by ip/8698: [ 1379.235761][ T8698] #0: ffffffffb97eeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 1379.236022][ T8698] #1: ffff88800ea52d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1379.236290][ T8698] [ 1379.236290][ T8698] stack backtrace: [ 1379.236471][ T8698] CPU: 3 UID: 0 PID: 8698 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 1379.236475][ T8698] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1379.236478][ T8698] Call Trace: [ 1379.236480][ T8698] [ 1379.236482][ T8698] dump_stack_lvl+0x82/0xd0 [ 1379.236491][ T8698] print_circular_bug+0x1b7/0x240 [ 1379.236495][ T8698] check_noncircular+0x2f9/0x3e0 [ 1379.236499][ T8698] ? __pfx_check_noncircular+0x10/0x10 [ 1379.236503][ T8698] ? find_held_lock+0x2c/0x110 [ 1379.236510][ T8698] ? alloc_chain_hlocks+0x4e0/0x720 [ 1379.236514][ T8698] check_prev_add+0x182/0xce0 [ 1379.236518][ T8698] validate_chain+0x7bd/0xae0 [ 1379.236523][ T8698] ? stack_depot_save_flags+0x27e/0x440 [ 1379.236530][ T8698] ? __pfx_validate_chain+0x10/0x10 [ 1379.236533][ T8698] ? hlock_class+0x4e/0x130 [ 1379.236535][ T8698] ? mark_lock+0x38/0x3e0 [ 1379.236539][ T8698] __lock_acquire+0xb9a/0x1680 [ 1379.236545][ T8698] lock_acquire.part.0+0xeb/0x330 [ 1379.236548][ T8698] ? __dev_open+0x57e/0x710 [ 1379.236552][ T8698] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1379.236555][ T8698] ? trace_lock_acquire+0x14c/0x1f0 [ 1379.236558][ T8698] ? lock_acquire+0x32/0xc0 [ 1379.236561][ T8698] ? __dev_open+0x57e/0x710 [ 1379.236564][ T8698] __mutex_lock+0x169/0xc40 [ 1379.236566][ T8698] ? __dev_open+0x57e/0x710 [ 1379.236573][ T8698] ? __dev_open+0x57e/0x710 [ 1379.236576][ T8698] ? __pfx___mutex_lock+0x10/0x10 [ 1379.236579][ T8698] ? mutex_is_locked+0x1c/0x60 [ 1379.236583][ T8698] ? rtnl_is_locked+0x15/0x20 [ 1379.236589][ T8698] ? mirred_device_event+0x3d/0x1e0 [act_mirred] [ 1379.236597][ T8698] ? __dev_open+0x57e/0x710 [ 1379.236599][ T8698] __dev_open+0x57e/0x710 [ 1379.236602][ T8698] ? mark_held_locks+0x9e/0xe0 [ 1379.236604][ T8698] ? __pfx___dev_open+0x10/0x10 [ 1379.236607][ T8698] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 1379.236614][ T8698] netif_open+0xc9/0x130 [ 1379.236617][ T8698] ? __pfx_netif_open+0x10/0x10 [ 1379.236621][ T8698] dev_open+0x9f/0x1a0 [ 1379.236625][ T8698] team_port_add+0x90a/0x1ce0 [ 1379.236630][ T8698] ? __pfx_team_port_add+0x10/0x10 [ 1379.236633][ T8698] ? rcu_read_lock_any_held+0x43/0xb0 [ 1379.236639][ T8698] ? validate_chain+0x1fe/0xae0 [ 1379.236644][ T8698] team_add_slave+0x41/0x80 [ 1379.236648][ T8698] do_set_master+0x302/0x610 [ 1379.236652][ T8698] do_setlink.constprop.0+0x87b/0x25f0 [ 1379.236657][ T8698] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 1379.236661][ T8698] ? lock_acquire.part.0+0xeb/0x330 [ 1379.236664][ T8698] ? rtnl_newlink+0x653/0xa70 [ 1379.236667][ T8698] ? rtnl_newlink+0xb9/0xa70 [ 1379.236670][ T8698] ? rtnetlink_rcv_msg+0x712/0xc10 [ 1379.236673][ T8698] ? __mutex_trylock_common+0xfa/0x260 [ 1379.236676][ T8698] ? __pfx___mutex_trylock_common+0x10/0x10 [ 1379.236680][ T8698] ? lock_acquire+0x32/0xc0 [ 1379.236683][ T8698] ? trace_contention_end+0xef/0x150 [ 1379.236687][ T8698] ? __mutex_lock+0x190/0xc40 [ 1379.236690][ T8698] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1379.236693][ T8698] ? rtnl_newlink+0x653/0xa70 [ 1379.236696][ T8698] ? __pfx___mutex_lock+0x10/0x10 [ 1379.236699][ T8698] ? __pfx_validate_nla+0x10/0x10 [ 1379.236704][ T8698] ? trace_cap_capable+0x11e/0x1a0 [ 1379.236711][ T8698] ? __rtnl_newlink+0x3f2/0xa80 [ 1379.236715][ T8698] rtnl_newlink+0x69c/0xa70 [ 1379.236720][ T8698] ? __pfx_rtnl_newlink+0x10/0x10 [ 1379.236722][ T8698] ? find_held_lock+0x2c/0x110 [ 1379.236727][ T8698] ? __pfx___lock_release+0x10/0x10 [ 1379.236730][ T8698] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1379.236735][ T8698] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 1379.236738][ T8698] ? __pfx_rtnl_newlink+0x10/0x10 [ 1379.236741][ T8698] rtnetlink_rcv_msg+0x712/0xc10 [ 1379.236744][ T8698] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1379.236747][ T8698] ? hlock_class+0x4e/0x130 [ 1379.236749][ T8698] ? mark_lock+0x38/0x3e0 [ 1379.236753][ T8698] ? __lock_acquire+0xb9a/0x1680 [ 1379.236757][ T8698] netlink_rcv_skb+0x130/0x360 [ 1379.236760][ T8698] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1379.236764][ T8698] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 1379.236771][ T8698] ? netlink_deliver_tap+0x13e/0x340 [ 1379.236774][ T8698] ? netlink_deliver_tap+0xc3/0x340 [ 1379.236778][ T8698] netlink_unicast+0x44b/0x710 [ 1379.236782][ T8698] ? __pfx_netlink_unicast+0x10/0x10 [ 1379.236785][ T8698] ? find_held_lock+0x2c/0x110 [ 1379.236790][ T8698] netlink_sendmsg+0x723/0xbe0 [ 1379.236794][ T8698] ? __pfx_netlink_sendmsg+0x10/0x10 [ 1379.236801][ T8698] ____sys_sendmsg+0x7ac/0xa10 [ 1379.236804][ T8698] ? __pfx_____sys_sendmsg+0x10/0x10 [ 1379.236807][ T8698] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 1379.236814][ T8698] ___sys_sendmsg+0xee/0x170 [ 1379.236818][ T8698] ? __pfx____sys_sendmsg+0x10/0x10 [ 1379.236822][ T8698] ? kasan_save_stack+0x34/0x50 [ 1379.236826][ T8698] ? kasan_save_stack+0x24/0x50 [ 1379.236829][ T8698] ? kasan_record_aux_stack+0x8c/0xa0 [ 1379.236832][ T8698] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 1379.236836][ T8698] ? __x64_sys_close+0x7c/0xd0 [ 1379.236840][ T8698] ? do_syscall_64+0xc1/0x1d0 [ 1379.236842][ T8698] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1379.236845][ T8698] ? __lock_acquire+0xb9a/0x1680 [ 1379.236848][ T8698] ? lock_downgrade+0x52/0x110 [ 1379.236852][ T8698] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1379.236856][ T8698] ? find_held_lock+0x2c/0x110 [ 1379.236860][ T8698] ? __lock_release+0x103/0x460 [ 1379.236862][ T8698] ? __virt_addr_valid+0x22b/0x430 [ 1379.236868][ T8698] ? __pfx___lock_release+0x10/0x10 [ 1379.236871][ T8698] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1379.236875][ T8698] __sys_sendmsg+0x109/0x1a0 [ 1379.236879][ T8698] ? __pfx___sys_sendmsg+0x10/0x10 [ 1379.236886][ T8698] do_syscall_64+0xc1/0x1d0 [ 1379.236889][ T8698] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1379.236892][ T8698] RIP: 0033:0x7f26868c69a7 [ 1379.236896][ T8698] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 1379.236899][ T8698] RSP: 002b:00007ffc40bfbf88 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 1379.236903][ T8698] RAX: ffffffffffffffda RBX: 00007ffc40bfc6b0 RCX: 00007f26868c69a7 [ 1379.236906][ T8698] RDX: 0000000000000000 RSI: 00007ffc40bfbff0 RDI: 0000000000000005 [ 1379.236908][ T8698] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 1379.236909][ T8698] R10: 0000000038471910 R11: 0000000000000246 R12: 0000000000000004 [ 1379.236911][ T8698] R13: 0000000067b3578c R14: 0000000000498600 R15: 0000000000000000 [ 1379.236916][ T8698] [ 1379.256047][ T8698] lag1: Port device veth0 added [ 1379.315606][ T8699] lag1: Port device veth6 added [ 1379.614408][ T8705] 8021q: adding VLAN 0 to HW filter on device lag1 [ 1380.169569][ T8716] lag4: Mode changed to "loadbalance" [ 1380.252347][ T8718] 8021q: adding VLAN 0 to HW filter on device lag4 [ 1380.458487][ T8723] lag4: Port device veth3 added [ 1380.520646][ T8724] lag4: Port device veth5 added [ 1380.857345][ T8730] 8021q: adding VLAN 0 to HW filter on device lag4 [ 1381.370599][ T8741] lag2: Mode changed to "loadbalance" [ 1381.435278][ T8743] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1381.647986][ T8748] lag2: Port device veth1 added [ 1381.721080][ T8749] lag2: Port device veth7 added [ 1381.931539][ T8754] br1: port 1(lag2) entered blocking state [ 1381.931774][ T8754] br1: port 1(lag2) entered disabled state [ 1381.931996][ T8754] lag2: entered allmulticast mode [ 1381.932837][ T8754] veth1: entered allmulticast mode [ 1381.932994][ T8754] veth7: entered allmulticast mode [ 1381.935055][ T8754] veth1: entered promiscuous mode [ 1381.935260][ T8754] veth7: entered promiscuous mode [ 1382.134689][ T8758] br1: port 1(lag2) entered blocking state [ 1382.134976][ T8758] br1: port 1(lag2) entered forwarding state [ 1382.365661][ T8764] lag3: Mode changed to "loadbalance" [ 1382.434787][ T8766] 8021q: adding VLAN 0 to HW filter on device lag3 [ 1382.678613][ T8771] lag3: Port device veth2 added [ 1382.744682][ T8772] lag3: Port device veth4 added [ 1391.481576][ T8835] veth7: left allmulticast mode [ 1391.482910][ T8835] lag2: Port device veth7 removed [ 1391.544340][ T8836] veth7: left promiscuous mode [ 1404.458023][ T8886] veth7: entered allmulticast mode [ 1404.458265][ T8886] veth7: entered promiscuous mode [ 1404.459071][ T8886] lag2: Port device veth7 added [ 1404.700491][ T8897] veth1: left allmulticast mode [ 1404.702248][ T8897] lag2: Port device veth1 removed [ 1404.757381][ T8898] veth1: left promiscuous mode [ 1417.509201][ T412] br1: port 1(lag2) entered disabled state [ 1417.569122][ T8948] veth7: left allmulticast mode [ 1417.570753][ T8948] lag2: Port device veth7 removed [ 1417.636017][ T8949] veth7: left promiscuous mode [ 1417.806451][ T8959] veth1: entered allmulticast mode [ 1417.806687][ T8959] veth1: entered promiscuous mode [ 1417.807673][ T8959] lag2: Port device veth1 added [ 1417.830782][ T8716] br1: port 1(lag2) entered blocking state [ 1417.831076][ T8716] br1: port 1(lag2) entered forwarding state [ 1418.073002][ T8970] veth7: entered allmulticast mode [ 1418.073239][ T8970] veth7: entered promiscuous mode [ 1418.074017][ T8970] lag2: Port device veth7 added [ 1430.922984][ T9020] lag2: left allmulticast mode [ 1430.923205][ T9020] veth1: left allmulticast mode [ 1430.923358][ T9020] veth7: left allmulticast mode [ 1430.923527][ T9020] veth1: left promiscuous mode [ 1430.923690][ T9020] veth7: left promiscuous mode [ 1430.923839][ T9020] br1: port 1(lag2) entered disabled state [ 1433.031478][ T9022] br1: port 1(lag2) entered blocking state [ 1433.031720][ T9022] br1: port 1(lag2) entered disabled state [ 1433.031952][ T9022] lag2: entered allmulticast mode [ 1433.032098][ T9022] veth1: entered allmulticast mode [ 1433.033126][ T9022] veth7: entered allmulticast mode [ 1433.034885][ T9022] veth1: entered promiscuous mode [ 1433.035082][ T9022] veth7: entered promiscuous mode [ 1433.035716][ T9022] br1: port 1(lag2) entered blocking state [ 1433.035920][ T9022] br1: port 1(lag2) entered forwarding state [ 1445.848735][ T9072] lag3: Port device veth2 removed [ 1458.697884][ T9123] lag3: Port device veth2 added [ 1458.927286][ T9134] lag3: Port device veth4 removed [ 1471.729549][ T9185] lag3: Port device veth2 removed [ 1471.948766][ T9196] lag3: Port device veth4 added [ 1472.171252][ T9207] lag3: Port device veth2 added [ 1484.898453][ T9257] br1: port 2(lag3) entered blocking state [ 1484.898724][ T9257] br1: port 2(lag3) entered disabled state [ 1484.898963][ T9257] lag3: entered allmulticast mode [ 1484.899129][ T9257] veth4: entered allmulticast mode [ 1484.899293][ T9257] veth2: entered allmulticast mode [ 1484.900845][ T9257] lag3: entered promiscuous mode [ 1484.901017][ T9257] veth4: entered promiscuous mode [ 1484.901573][ T9257] veth2: entered promiscuous mode [ 1484.902074][ T9257] lag2: entered promiscuous mode [ 1484.903214][ T9257] br1: port 2(lag3) entered blocking state [ 1484.903435][ T9257] br1: port 2(lag3) entered forwarding state [ 1487.005314][ T9259] lag3: left allmulticast mode [ 1487.005516][ T9259] veth4: left allmulticast mode [ 1487.005666][ T9259] veth2: left allmulticast mode [ 1487.005817][ T9259] lag3: left promiscuous mode [ 1487.005957][ T9259] veth4: left promiscuous mode [ 1487.006349][ T9259] veth2: left promiscuous mode [ 1487.006878][ T9259] br1: port 2(lag3) entered disabled state [ 1487.007846][ T9259] lag2: left promiscuous mode [ 1499.988603][ T9312] lag3: Port device veth4 removed [ 1500.056061][ T9313] lag3: Port device veth2 removed [ 1500.545651][ T1593] br1: port 1(lag2) entered disabled state [ 1500.654157][ T9328] lag2: left allmulticast mode [ 1500.654358][ T9328] veth1: left allmulticast mode [ 1500.654506][ T9328] veth7: left allmulticast mode [ 1500.654683][ T9328] br1: port 1(lag2) entered disabled state [ 1500.830770][ T9330] lag2: Port device veth7 removed [ 1500.884175][ T9331] lag2: Port device veth1 removed [ 1501.929812][ T9346] lag4: Port device veth5 removed [ 1501.979841][ T9347] lag4: Port device veth3 removed [ 1503.025721][ T9360] lag1: Port device veth6 removed [ 1503.089314][ T9361] lag1: Port device veth0 removed