[ 874.924074][ T4473] lag1: Mode changed to "loadbalance" [ 875.031716][ T4475] 8021q: adding VLAN 0 to HW filter on device lag1 [ 875.356210][ T4484] [ 875.356364][ T4484] ====================================================== [ 875.356571][ T4484] WARNING: possible circular locking dependency detected [ 875.356803][ T4484] 6.14.0-rc2-virtme #1 Not tainted [ 875.356981][ T4484] ------------------------------------------------------ [ 875.357190][ T4484] ip/4484 is trying to acquire lock: [ 875.357357][ T4484] ffff888008841cb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 875.357621][ T4484] [ 875.357621][ T4484] but task is already holding lock: [ 875.357871][ T4484] ffff888012f3ad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 875.358173][ T4484] [ 875.358173][ T4484] which lock already depends on the new lock. [ 875.358173][ T4484] [ 875.358493][ T4484] [ 875.358493][ T4484] the existing dependency chain (in reverse order) is: [ 875.358780][ T4484] [ 875.358780][ T4484] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 875.359027][ T4484] __lock_acquire+0xb9a/0x1680 [ 875.359200][ T4484] lock_acquire.part.0+0xeb/0x330 [ 875.359361][ T4484] __mutex_lock+0x169/0xc40 [ 875.359522][ T4484] team_set_mac_address+0x120/0x250 [ 875.359684][ T4484] netif_set_mac_address+0x28a/0x410 [ 875.359905][ T4484] do_setlink.constprop.0+0x1980/0x25f0 [ 875.360111][ T4484] rtnl_setlink+0x2b5/0x5a0 [ 875.360272][ T4484] rtnetlink_rcv_msg+0x712/0xc10 [ 875.360443][ T4484] netlink_rcv_skb+0x130/0x360 [ 875.360609][ T4484] netlink_unicast+0x44b/0x710 [ 875.360783][ T4484] netlink_sendmsg+0x723/0xbe0 [ 875.360945][ T4484] __sys_sendto+0x3c3/0x450 [ 875.361110][ T4484] __x64_sys_sendto+0xe0/0x1c0 [ 875.361271][ T4484] do_syscall_64+0xc1/0x1d0 [ 875.361441][ T4484] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 875.361646][ T4484] [ 875.361646][ T4484] -> #0 (&dev->lock){+.+.}-{4:4}: [ 875.361902][ T4484] check_prev_add+0x182/0xce0 [ 875.362082][ T4484] validate_chain+0x7bd/0xae0 [ 875.362241][ T4484] __lock_acquire+0xb9a/0x1680 [ 875.362401][ T4484] lock_acquire.part.0+0xeb/0x330 [ 875.362562][ T4484] __mutex_lock+0x169/0xc40 [ 875.362737][ T4484] __dev_open+0x57e/0x710 [ 875.362991][ T4484] netif_open+0xc9/0x130 [ 875.363158][ T4484] dev_open+0x9f/0x1a0 [ 875.363321][ T4484] team_port_add+0x90a/0x1ce0 [ 875.363486][ T4484] team_add_slave+0x41/0x80 [ 875.363644][ T4484] do_set_master+0x302/0x610 [ 875.363813][ T4484] do_setlink.constprop.0+0x87b/0x25f0 [ 875.364013][ T4484] rtnl_newlink+0x69c/0xa70 [ 875.364181][ T4484] rtnetlink_rcv_msg+0x712/0xc10 [ 875.364342][ T4484] netlink_rcv_skb+0x130/0x360 [ 875.364509][ T4484] netlink_unicast+0x44b/0x710 [ 875.364672][ T4484] netlink_sendmsg+0x723/0xbe0 [ 875.364845][ T4484] ____sys_sendmsg+0x7ac/0xa10 [ 875.365012][ T4484] ___sys_sendmsg+0xee/0x170 [ 875.365178][ T4484] __sys_sendmsg+0x109/0x1a0 [ 875.365343][ T4484] do_syscall_64+0xc1/0x1d0 [ 875.365508][ T4484] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 875.365729][ T4484] [ 875.365729][ T4484] other info that might help us debug this: [ 875.365729][ T4484] [ 875.366051][ T4484] Possible unsafe locking scenario: [ 875.366051][ T4484] [ 875.366294][ T4484] CPU0 CPU1 [ 875.366541][ T4484] ---- ---- [ 875.366849][ T4484] lock(team->team_lock_key); [ 875.367095][ T4484] lock(&dev->lock); [ 875.367296][ T4484] lock(team->team_lock_key); [ 875.367540][ T4484] lock(&dev->lock); [ 875.367668][ T4484] [ 875.367668][ T4484] *** DEADLOCK *** [ 875.367668][ T4484] [ 875.368013][ T4484] 2 locks held by ip/4484: [ 875.368182][ T4484] #0: ffffffff85beeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 875.368570][ T4484] #1: ffff888012f3ad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 875.368859][ T4484] [ 875.368859][ T4484] stack backtrace: [ 875.369066][ T4484] CPU: 2 UID: 0 PID: 4484 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 875.369072][ T4484] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 875.369074][ T4484] Call Trace: [ 875.369076][ T4484] [ 875.369078][ T4484] dump_stack_lvl+0x82/0xd0 [ 875.369088][ T4484] print_circular_bug+0x1b7/0x240 [ 875.369095][ T4484] check_noncircular+0x2f9/0x3e0 [ 875.369099][ T4484] ? __pfx_check_noncircular+0x10/0x10 [ 875.369103][ T4484] ? find_held_lock+0x2c/0x110 [ 875.369109][ T4484] ? alloc_chain_hlocks+0x4e0/0x720 [ 875.369113][ T4484] check_prev_add+0x182/0xce0 [ 875.369118][ T4484] validate_chain+0x7bd/0xae0 [ 875.369123][ T4484] ? stack_depot_save_flags+0x27e/0x440 [ 875.369130][ T4484] ? __pfx_validate_chain+0x10/0x10 [ 875.369133][ T4484] ? hlock_class+0x4e/0x130 [ 875.369135][ T4484] ? mark_lock+0x38/0x3e0 [ 875.369139][ T4484] __lock_acquire+0xb9a/0x1680 [ 875.369144][ T4484] ? mark_lock+0x38/0x3e0 [ 875.369148][ T4484] lock_acquire.part.0+0xeb/0x330 [ 875.369151][ T4484] ? __dev_open+0x57e/0x710 [ 875.369155][ T4484] ? validate_chain+0x162/0xae0 [ 875.369158][ T4484] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 875.369162][ T4484] ? trace_lock_acquire+0x14c/0x1f0 [ 875.369165][ T4484] ? lock_acquire+0x32/0xc0 [ 875.369168][ T4484] ? __dev_open+0x57e/0x710 [ 875.369171][ T4484] __mutex_lock+0x169/0xc40 [ 875.369174][ T4484] ? __dev_open+0x57e/0x710 [ 875.369177][ T4484] ? __dev_open+0x57e/0x710 [ 875.369180][ T4484] ? __pfx___mutex_lock+0x10/0x10 [ 875.369183][ T4484] ? mutex_is_locked+0x1c/0x60 [ 875.369186][ T4484] ? rtnl_is_locked+0x15/0x20 [ 875.369194][ T4484] ? mirred_device_event+0x3d/0x1e0 [act_mirred] [ 875.369205][ T4484] ? __dev_open+0x57e/0x710 [ 875.369207][ T4484] __dev_open+0x57e/0x710 [ 875.369209][ T4484] ? mark_held_locks+0x9e/0xe0 [ 875.369212][ T4484] ? __pfx___dev_open+0x10/0x10 [ 875.369215][ T4484] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 875.369222][ T4484] netif_open+0xc9/0x130 [ 875.369224][ T4484] ? __pfx_netif_open+0x10/0x10 [ 875.369229][ T4484] dev_open+0x9f/0x1a0 [ 875.369234][ T4484] team_port_add+0x90a/0x1ce0 [ 875.369239][ T4484] ? __pfx_team_port_add+0x10/0x10 [ 875.369242][ T4484] ? rcu_read_lock_any_held+0x43/0xb0 [ 875.369249][ T4484] ? validate_chain+0x1fe/0xae0 [ 875.369254][ T4484] team_add_slave+0x41/0x80 [ 875.369258][ T4484] do_set_master+0x302/0x610 [ 875.369263][ T4484] do_setlink.constprop.0+0x87b/0x25f0 [ 875.369268][ T4484] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 875.369272][ T4484] ? lock_acquire.part.0+0xeb/0x330 [ 875.369275][ T4484] ? rtnl_newlink+0x653/0xa70 [ 875.369278][ T4484] ? rtnl_newlink+0xb9/0xa70 [ 875.369280][ T4484] ? rtnetlink_rcv_msg+0x712/0xc10 [ 875.369284][ T4484] ? __mutex_trylock_common+0xfa/0x260 [ 875.369287][ T4484] ? __pfx___mutex_trylock_common+0x10/0x10 [ 875.369291][ T4484] ? lock_acquire+0x32/0xc0 [ 875.369294][ T4484] ? trace_contention_end+0xef/0x150 [ 875.369298][ T4484] ? __mutex_lock+0x190/0xc40 [ 875.369301][ T4484] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 875.369304][ T4484] ? rtnl_newlink+0x653/0xa70 [ 875.369308][ T4484] ? __pfx___mutex_lock+0x10/0x10 [ 875.369310][ T4484] ? __pfx_validate_nla+0x10/0x10 [ 875.369315][ T4484] ? trace_cap_capable+0x11e/0x1a0 [ 875.369322][ T4484] ? __rtnl_newlink+0x3f2/0xa80 [ 875.369326][ T4484] rtnl_newlink+0x69c/0xa70 [ 875.369331][ T4484] ? __pfx_rtnl_newlink+0x10/0x10 [ 875.369334][ T4484] ? find_held_lock+0x2c/0x110 [ 875.369339][ T4484] ? __pfx___lock_release+0x10/0x10 [ 875.369342][ T4484] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 875.369347][ T4484] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 875.369350][ T4484] ? __pfx_rtnl_newlink+0x10/0x10 [ 875.369353][ T4484] rtnetlink_rcv_msg+0x712/0xc10 [ 875.369357][ T4484] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 875.369360][ T4484] ? hlock_class+0x4e/0x130 [ 875.369362][ T4484] ? mark_lock+0x38/0x3e0 [ 875.369366][ T4484] ? __lock_acquire+0xb9a/0x1680 [ 875.369371][ T4484] netlink_rcv_skb+0x130/0x360 [ 875.369375][ T4484] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 875.369378][ T4484] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 875.369386][ T4484] ? netlink_deliver_tap+0x13e/0x340 [ 875.369390][ T4484] ? netlink_deliver_tap+0xc3/0x340 [ 875.369393][ T4484] netlink_unicast+0x44b/0x710 [ 875.369398][ T4484] ? __pfx_netlink_unicast+0x10/0x10 [ 875.369401][ T4484] ? find_held_lock+0x2c/0x110 [ 875.369406][ T4484] netlink_sendmsg+0x723/0xbe0 [ 875.369410][ T4484] ? __pfx_netlink_sendmsg+0x10/0x10 [ 875.369416][ T4484] ____sys_sendmsg+0x7ac/0xa10 [ 875.369421][ T4484] ? __pfx_____sys_sendmsg+0x10/0x10 [ 875.369423][ T4484] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 875.369430][ T4484] ___sys_sendmsg+0xee/0x170 [ 875.369434][ T4484] ? __pfx____sys_sendmsg+0x10/0x10 [ 875.369439][ T4484] ? kasan_save_stack+0x34/0x50 [ 875.369443][ T4484] ? kasan_save_stack+0x24/0x50 [ 875.369446][ T4484] ? kasan_record_aux_stack+0x8c/0xa0 [ 875.369449][ T4484] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 875.369453][ T4484] ? __x64_sys_close+0x7c/0xd0 [ 875.369457][ T4484] ? do_syscall_64+0xc1/0x1d0 [ 875.369459][ T4484] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 875.369463][ T4484] ? __lock_acquire+0xb9a/0x1680 [ 875.369466][ T4484] ? lock_downgrade+0x52/0x110 [ 875.369470][ T4484] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 875.369474][ T4484] ? find_held_lock+0x2c/0x110 [ 875.369478][ T4484] ? __lock_release+0x103/0x460 [ 875.369480][ T4484] ? __virt_addr_valid+0x22b/0x430 [ 875.369486][ T4484] ? __pfx___lock_release+0x10/0x10 [ 875.369489][ T4484] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 875.369493][ T4484] __sys_sendmsg+0x109/0x1a0 [ 875.369497][ T4484] ? __pfx___sys_sendmsg+0x10/0x10 [ 875.369505][ T4484] do_syscall_64+0xc1/0x1d0 [ 875.369508][ T4484] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 875.369511][ T4484] RIP: 0033:0x7f7f6e2249a7 [ 875.369515][ T4484] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 875.369519][ T4484] RSP: 002b:00007fff9b360bf8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 875.369523][ T4484] RAX: ffffffffffffffda RBX: 00007fff9b361320 RCX: 00007f7f6e2249a7 [ 875.369525][ T4484] RDX: 0000000000000000 RSI: 00007fff9b360c60 RDI: 0000000000000005 [ 875.369527][ T4484] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 875.369529][ T4484] R10: 00000000076ef910 R11: 0000000000000246 R12: 0000000000000004 [ 875.369530][ T4484] R13: 0000000067b300a5 R14: 0000000000498600 R15: 0000000000000000 [ 875.369536][ T4484] [ 875.397960][ T4484] lag1: Port device veth0 added [ 875.462885][ T4491] lag1: Port device veth6 added [ 875.798838][ T4497] 8021q: adding VLAN 0 to HW filter on device lag1 [ 876.357129][ T4508] lag4: Mode changed to "loadbalance" [ 876.441650][ T4510] 8021q: adding VLAN 0 to HW filter on device lag4 [ 876.697085][ T4515] lag4: Port device veth3 added [ 876.774820][ T4516] lag4: Port device veth5 added [ 877.122547][ T4522] 8021q: adding VLAN 0 to HW filter on device lag4 [ 877.744528][ T4533] lag2: Mode changed to "loadbalance" [ 877.825404][ T4535] 8021q: adding VLAN 0 to HW filter on device lag2 [ 878.108549][ T4540] lag2: Port device veth1 added [ 878.181636][ T4541] lag2: Port device veth7 added [ 878.429951][ T4546] br1: port 1(lag2) entered blocking state [ 878.430227][ T4546] br1: port 1(lag2) entered disabled state [ 878.430541][ T4546] lag2: entered allmulticast mode [ 878.430719][ T4546] veth1: entered allmulticast mode [ 878.430895][ T4546] veth7: entered allmulticast mode [ 878.432844][ T4546] veth1: entered promiscuous mode [ 878.433065][ T4546] veth7: entered promiscuous mode [ 878.645709][ T4550] br1: port 1(lag2) entered blocking state [ 878.646152][ T4550] br1: port 1(lag2) entered forwarding state [ 878.927566][ T4556] lag3: Mode changed to "loadbalance" [ 879.004883][ T4557] 8021q: adding VLAN 0 to HW filter on device lag3 [ 879.300024][ T4563] lag3: Port device veth2 added [ 879.376060][ T4564] lag3: Port device veth4 added [ 888.328203][ T4628] veth7: left allmulticast mode [ 888.329709][ T4628] lag2: Port device veth7 removed [ 888.396439][ T4629] veth7: left promiscuous mode [ 901.292130][ T4679] veth7: entered allmulticast mode [ 901.292427][ T4679] veth7: entered promiscuous mode [ 901.294380][ T4679] lag2: Port device veth7 added [ 901.544391][ T4690] veth1: left allmulticast mode [ 901.546189][ T4690] lag2: Port device veth1 removed [ 901.612950][ T4691] veth1: left promiscuous mode [ 914.412620][ T68] br1: port 1(lag2) entered disabled state [ 914.481765][ T4741] veth7: left allmulticast mode [ 914.483042][ T4741] lag2: Port device veth7 removed [ 914.542846][ T4742] veth7: left promiscuous mode [ 914.720431][ T4752] veth1: entered allmulticast mode [ 914.720691][ T4752] veth1: entered promiscuous mode [ 914.721467][ T4752] lag2: Port device veth1 added [ 914.744850][ T4473] br1: port 1(lag2) entered blocking state [ 914.745111][ T4473] br1: port 1(lag2) entered forwarding state [ 915.023162][ T4763] veth7: entered allmulticast mode [ 915.023394][ T4763] veth7: entered promiscuous mode [ 915.024225][ T4763] lag2: Port device veth7 added [ 927.978107][ T4813] lag2: left allmulticast mode [ 927.978633][ T4813] veth1: left allmulticast mode [ 927.978809][ T4813] veth7: left allmulticast mode [ 927.978995][ T4813] veth1: left promiscuous mode [ 927.979175][ T4813] veth7: left promiscuous mode [ 927.979350][ T4813] br1: port 1(lag2) entered disabled state [ 930.089260][ T4815] br1: port 1(lag2) entered blocking state [ 930.089578][ T4815] br1: port 1(lag2) entered disabled state [ 930.089836][ T4815] lag2: entered allmulticast mode [ 930.089997][ T4815] veth1: entered allmulticast mode [ 930.090161][ T4815] veth7: entered allmulticast mode [ 930.092130][ T4815] veth1: entered promiscuous mode [ 930.092363][ T4815] veth7: entered promiscuous mode [ 930.092993][ T4815] br1: port 1(lag2) entered blocking state [ 930.093198][ T4815] br1: port 1(lag2) entered forwarding state [ 943.043936][ T4865] lag3: Port device veth2 removed [ 955.991541][ T4916] lag3: Port device veth2 added [ 956.238633][ T4927] lag3: Port device veth4 removed [ 969.281384][ T4978] lag3: Port device veth2 removed [ 969.530561][ T4989] lag3: Port device veth4 added [ 969.791304][ T5000] lag3: Port device veth2 added [ 982.685116][ T5050] br1: port 2(lag3) entered blocking state [ 982.685389][ T5050] br1: port 2(lag3) entered disabled state [ 982.685629][ T5050] lag3: entered allmulticast mode [ 982.685781][ T5050] veth4: entered allmulticast mode [ 982.685934][ T5050] veth2: entered allmulticast mode [ 982.695117][ T5050] lag3: entered promiscuous mode [ 982.695422][ T5050] veth4: entered promiscuous mode [ 982.695996][ T5050] veth2: entered promiscuous mode [ 982.696664][ T5050] lag2: entered promiscuous mode [ 982.697845][ T5050] br1: port 2(lag3) entered blocking state [ 982.698075][ T5050] br1: port 2(lag3) entered forwarding state [ 984.816729][ T5052] lag3: left allmulticast mode [ 984.817010][ T5052] veth4: left allmulticast mode [ 984.817175][ T5052] veth2: left allmulticast mode [ 984.817351][ T5052] lag3: left promiscuous mode [ 984.817511][ T5052] veth4: left promiscuous mode [ 984.817908][ T5052] veth2: left promiscuous mode [ 984.818470][ T5052] br1: port 2(lag3) entered disabled state [ 984.819605][ T5052] lag2: left promiscuous mode [ 998.016265][ T5105] lag3: Port device veth4 removed [ 998.083257][ T5106] lag3: Port device veth2 removed [ 998.741783][ T37] br1: port 1(lag2) entered disabled state [ 998.862135][ T5121] lag2: left allmulticast mode [ 998.862364][ T5121] veth1: left allmulticast mode [ 998.862519][ T5121] veth7: left allmulticast mode [ 998.862695][ T5121] br1: port 1(lag2) entered disabled state [ 999.047374][ T5123] lag2: Port device veth7 removed [ 999.104787][ T5124] lag2: Port device veth1 removed [ 1000.316156][ T5139] lag4: Port device veth5 removed [ 1000.380790][ T5140] lag4: Port device veth3 removed [ 1001.566432][ T5153] lag1: Port device veth6 removed [ 1001.628196][ T5154] lag1: Port device veth0 removed