[ 1361.976349][ T8634] lag1: Mode changed to "loadbalance" [ 1362.058064][ T8636] 8021q: adding VLAN 0 to HW filter on device lag1 [ 1362.370997][ T8646] [ 1362.371132][ T8646] ====================================================== [ 1362.371340][ T8646] WARNING: possible circular locking dependency detected [ 1362.371538][ T8646] 6.14.0-rc2-virtme #1 Not tainted [ 1362.371696][ T8646] ------------------------------------------------------ [ 1362.371902][ T8646] ip/8646 is trying to acquire lock: [ 1362.372062][ T8646] ffff88800a409cb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 1362.372319][ T8646] [ 1362.372319][ T8646] but task is already holding lock: [ 1362.372552][ T8646] ffff88801180ad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1362.372828][ T8646] [ 1362.372828][ T8646] which lock already depends on the new lock. [ 1362.372828][ T8646] [ 1362.373127][ T8646] [ 1362.373127][ T8646] the existing dependency chain (in reverse order) is: [ 1362.373387][ T8646] [ 1362.373387][ T8646] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 1362.373616][ T8646] __lock_acquire+0xb9a/0x1680 [ 1362.373776][ T8646] lock_acquire.part.0+0xeb/0x330 [ 1362.373927][ T8646] __mutex_lock+0x169/0xc40 [ 1362.374078][ T8646] team_set_mac_address+0x120/0x250 [ 1362.374229][ T8646] netif_set_mac_address+0x28a/0x410 [ 1362.374419][ T8646] do_setlink.constprop.0+0x1980/0x25f0 [ 1362.374604][ T8646] rtnl_setlink+0x2b5/0x5a0 [ 1362.374754][ T8646] rtnetlink_rcv_msg+0x712/0xc10 [ 1362.374904][ T8646] netlink_rcv_skb+0x130/0x360 [ 1362.375057][ T8646] netlink_unicast+0x44b/0x710 [ 1362.375209][ T8646] netlink_sendmsg+0x723/0xbe0 [ 1362.375360][ T8646] __sys_sendto+0x3c3/0x450 [ 1362.375517][ T8646] __x64_sys_sendto+0xe0/0x1c0 [ 1362.375668][ T8646] do_syscall_64+0xc1/0x1d0 [ 1362.375819][ T8646] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1362.376009][ T8646] [ 1362.376009][ T8646] -> #0 (&dev->lock){+.+.}-{4:4}: [ 1362.376236][ T8646] check_prev_add+0x182/0xce0 [ 1362.376393][ T8646] validate_chain+0x7bd/0xae0 [ 1362.376546][ T8646] __lock_acquire+0xb9a/0x1680 [ 1362.376698][ T8646] lock_acquire.part.0+0xeb/0x330 [ 1362.376847][ T8646] __mutex_lock+0x169/0xc40 [ 1362.376996][ T8646] __dev_open+0x57e/0x710 [ 1362.377146][ T8646] netif_open+0xc9/0x130 [ 1362.377295][ T8646] dev_open+0x9f/0x1a0 [ 1362.377445][ T8646] team_port_add+0x90a/0x1ce0 [ 1362.377596][ T8646] team_add_slave+0x41/0x80 [ 1362.377749][ T8646] do_set_master+0x302/0x610 [ 1362.377903][ T8646] do_setlink.constprop.0+0x87b/0x25f0 [ 1362.378094][ T8646] rtnl_newlink+0x69c/0xa70 [ 1362.378248][ T8646] rtnetlink_rcv_msg+0x712/0xc10 [ 1362.378406][ T8646] netlink_rcv_skb+0x130/0x360 [ 1362.378565][ T8646] netlink_unicast+0x44b/0x710 [ 1362.378727][ T8646] netlink_sendmsg+0x723/0xbe0 [ 1362.378889][ T8646] ____sys_sendmsg+0x7ac/0xa10 [ 1362.379046][ T8646] ___sys_sendmsg+0xee/0x170 [ 1362.379198][ T8646] __sys_sendmsg+0x109/0x1a0 [ 1362.379351][ T8646] do_syscall_64+0xc1/0x1d0 [ 1362.379501][ T8646] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1362.379692][ T8646] [ 1362.379692][ T8646] other info that might help us debug this: [ 1362.379692][ T8646] [ 1362.379983][ T8646] Possible unsafe locking scenario: [ 1362.379983][ T8646] [ 1362.380204][ T8646] CPU0 CPU1 [ 1362.380357][ T8646] ---- ---- [ 1362.380512][ T8646] lock(team->team_lock_key); [ 1362.380668][ T8646] lock(&dev->lock); [ 1362.380866][ T8646] lock(team->team_lock_key); [ 1362.381108][ T8646] lock(&dev->lock); [ 1362.381227][ T8646] [ 1362.381227][ T8646] *** DEADLOCK *** [ 1362.381227][ T8646] [ 1362.381456][ T8646] 2 locks held by ip/8646: [ 1362.381612][ T8646] #0: ffffffff90feeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 1362.381889][ T8646] #1: ffff88801180ad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1362.382168][ T8646] [ 1362.382168][ T8646] stack backtrace: [ 1362.382359][ T8646] CPU: 2 UID: 0 PID: 8646 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 1362.382364][ T8646] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1362.382367][ T8646] Call Trace: [ 1362.382369][ T8646] [ 1362.382371][ T8646] dump_stack_lvl+0x82/0xd0 [ 1362.382380][ T8646] print_circular_bug+0x1b7/0x240 [ 1362.382386][ T8646] check_noncircular+0x2f9/0x3e0 [ 1362.382390][ T8646] ? __pfx_check_noncircular+0x10/0x10 [ 1362.382394][ T8646] ? find_held_lock+0x2c/0x110 [ 1362.382401][ T8646] ? alloc_chain_hlocks+0x4e0/0x720 [ 1362.382405][ T8646] check_prev_add+0x182/0xce0 [ 1362.382410][ T8646] validate_chain+0x7bd/0xae0 [ 1362.382414][ T8646] ? stack_depot_save_flags+0x27e/0x440 [ 1362.382421][ T8646] ? __pfx_validate_chain+0x10/0x10 [ 1362.382424][ T8646] ? hlock_class+0x4e/0x130 [ 1362.382426][ T8646] ? mark_lock+0x38/0x3e0 [ 1362.382431][ T8646] __lock_acquire+0xb9a/0x1680 [ 1362.382436][ T8646] lock_acquire.part.0+0xeb/0x330 [ 1362.382439][ T8646] ? __dev_open+0x57e/0x710 [ 1362.382443][ T8646] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1362.382446][ T8646] ? trace_lock_acquire+0x14c/0x1f0 [ 1362.382449][ T8646] ? lock_acquire+0x32/0xc0 [ 1362.382452][ T8646] ? __dev_open+0x57e/0x710 [ 1362.382455][ T8646] __mutex_lock+0x169/0xc40 [ 1362.382457][ T8646] ? __dev_open+0x57e/0x710 [ 1362.382463][ T8646] ? __dev_open+0x57e/0x710 [ 1362.382466][ T8646] ? __pfx___mutex_lock+0x10/0x10 [ 1362.382469][ T8646] ? mutex_is_locked+0x1c/0x60 [ 1362.382473][ T8646] ? rtnl_is_locked+0x15/0x20 [ 1362.382479][ T8646] ? mirred_device_event+0x3d/0x1e0 [act_mirred] [ 1362.382489][ T8646] ? __dev_open+0x57e/0x710 [ 1362.382491][ T8646] __dev_open+0x57e/0x710 [ 1362.382493][ T8646] ? mark_held_locks+0x9e/0xe0 [ 1362.382496][ T8646] ? __pfx___dev_open+0x10/0x10 [ 1362.382499][ T8646] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 1362.382505][ T8646] netif_open+0xc9/0x130 [ 1362.382508][ T8646] ? __pfx_netif_open+0x10/0x10 [ 1362.382512][ T8646] dev_open+0x9f/0x1a0 [ 1362.382516][ T8646] team_port_add+0x90a/0x1ce0 [ 1362.382521][ T8646] ? __pfx_team_port_add+0x10/0x10 [ 1362.382524][ T8646] ? rcu_read_lock_any_held+0x43/0xb0 [ 1362.382530][ T8646] ? validate_chain+0x1fe/0xae0 [ 1362.382535][ T8646] team_add_slave+0x41/0x80 [ 1362.382539][ T8646] do_set_master+0x302/0x610 [ 1362.382544][ T8646] do_setlink.constprop.0+0x87b/0x25f0 [ 1362.382549][ T8646] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 1362.382552][ T8646] ? lock_acquire.part.0+0xeb/0x330 [ 1362.382555][ T8646] ? rtnl_newlink+0x653/0xa70 [ 1362.382558][ T8646] ? rtnl_newlink+0xb9/0xa70 [ 1362.382561][ T8646] ? rtnetlink_rcv_msg+0x712/0xc10 [ 1362.382564][ T8646] ? __mutex_trylock_common+0xfa/0x260 [ 1362.382568][ T8646] ? __pfx___mutex_trylock_common+0x10/0x10 [ 1362.382571][ T8646] ? lock_acquire+0x32/0xc0 [ 1362.382575][ T8646] ? trace_contention_end+0xef/0x150 [ 1362.382578][ T8646] ? __mutex_lock+0x190/0xc40 [ 1362.382581][ T8646] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1362.382585][ T8646] ? rtnl_newlink+0x653/0xa70 [ 1362.382588][ T8646] ? __pfx___mutex_lock+0x10/0x10 [ 1362.382590][ T8646] ? __pfx_validate_nla+0x10/0x10 [ 1362.382595][ T8646] ? trace_cap_capable+0x11e/0x1a0 [ 1362.382602][ T8646] ? __rtnl_newlink+0x3f2/0xa80 [ 1362.382606][ T8646] rtnl_newlink+0x69c/0xa70 [ 1362.382611][ T8646] ? __pfx_rtnl_newlink+0x10/0x10 [ 1362.382613][ T8646] ? find_held_lock+0x2c/0x110 [ 1362.382618][ T8646] ? __pfx___lock_release+0x10/0x10 [ 1362.382621][ T8646] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1362.382626][ T8646] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 1362.382629][ T8646] ? __pfx_rtnl_newlink+0x10/0x10 [ 1362.382632][ T8646] rtnetlink_rcv_msg+0x712/0xc10 [ 1362.382635][ T8646] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1362.382638][ T8646] ? hlock_class+0x4e/0x130 [ 1362.382640][ T8646] ? mark_lock+0x38/0x3e0 [ 1362.382644][ T8646] ? __lock_acquire+0xb9a/0x1680 [ 1362.382648][ T8646] netlink_rcv_skb+0x130/0x360 [ 1362.382651][ T8646] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1362.382655][ T8646] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 1362.382662][ T8646] ? netlink_deliver_tap+0x13e/0x340 [ 1362.382666][ T8646] ? netlink_deliver_tap+0xc3/0x340 [ 1362.382669][ T8646] netlink_unicast+0x44b/0x710 [ 1362.382674][ T8646] ? __pfx_netlink_unicast+0x10/0x10 [ 1362.382677][ T8646] ? find_held_lock+0x2c/0x110 [ 1362.382682][ T8646] netlink_sendmsg+0x723/0xbe0 [ 1362.382686][ T8646] ? __pfx_netlink_sendmsg+0x10/0x10 [ 1362.382692][ T8646] ____sys_sendmsg+0x7ac/0xa10 [ 1362.382696][ T8646] ? __pfx_____sys_sendmsg+0x10/0x10 [ 1362.382698][ T8646] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 1362.382705][ T8646] ___sys_sendmsg+0xee/0x170 [ 1362.382709][ T8646] ? __pfx____sys_sendmsg+0x10/0x10 [ 1362.382713][ T8646] ? kasan_save_stack+0x34/0x50 [ 1362.382719][ T8646] ? kasan_save_stack+0x24/0x50 [ 1362.382722][ T8646] ? kasan_record_aux_stack+0x8c/0xa0 [ 1362.382726][ T8646] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 1362.382730][ T8646] ? __x64_sys_close+0x7c/0xd0 [ 1362.382734][ T8646] ? do_syscall_64+0xc1/0x1d0 [ 1362.382736][ T8646] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1362.382739][ T8646] ? __lock_acquire+0xb9a/0x1680 [ 1362.382742][ T8646] ? lock_downgrade+0x52/0x110 [ 1362.382745][ T8646] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1362.382749][ T8646] ? find_held_lock+0x2c/0x110 [ 1362.382753][ T8646] ? __lock_release+0x103/0x460 [ 1362.382756][ T8646] ? __virt_addr_valid+0x22b/0x430 [ 1362.382761][ T8646] ? __pfx___lock_release+0x10/0x10 [ 1362.382764][ T8646] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1362.382769][ T8646] __sys_sendmsg+0x109/0x1a0 [ 1362.382772][ T8646] ? __pfx___sys_sendmsg+0x10/0x10 [ 1362.382780][ T8646] do_syscall_64+0xc1/0x1d0 [ 1362.382782][ T8646] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1362.382785][ T8646] RIP: 0033:0x7f5248eb99a7 [ 1362.382790][ T8646] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 1362.382793][ T8646] RSP: 002b:00007fffc1d3c358 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 1362.382796][ T8646] RAX: ffffffffffffffda RBX: 00007fffc1d3ca80 RCX: 00007f5248eb99a7 [ 1362.382798][ T8646] RDX: 0000000000000000 RSI: 00007fffc1d3c3c0 RDI: 0000000000000005 [ 1362.382800][ T8646] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 1362.382801][ T8646] R10: 000000001bbb3910 R11: 0000000000000246 R12: 0000000000000004 [ 1362.382803][ T8646] R13: 0000000067b32d30 R14: 0000000000498600 R15: 0000000000000000 [ 1362.382808][ T8646] [ 1362.407419][ T8646] lag1: Port device veth0 added [ 1362.469843][ T8652] lag1: Port device veth6 added [ 1362.785853][ T8658] 8021q: adding VLAN 0 to HW filter on device lag1 [ 1363.335059][ T8669] lag4: Mode changed to "loadbalance" [ 1363.423144][ T8671] 8021q: adding VLAN 0 to HW filter on device lag4 [ 1363.644884][ T8676] lag4: Port device veth3 added [ 1363.722980][ T8677] lag4: Port device veth5 added [ 1364.094009][ T8683] 8021q: adding VLAN 0 to HW filter on device lag4 [ 1364.763191][ T8694] lag2: Mode changed to "loadbalance" [ 1364.843944][ T8696] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1365.122071][ T8701] lag2: Port device veth1 added [ 1365.196361][ T8702] lag2: Port device veth7 added [ 1365.434984][ T8707] br1: port 1(lag2) entered blocking state [ 1365.435303][ T8707] br1: port 1(lag2) entered disabled state [ 1365.435572][ T8707] lag2: entered allmulticast mode [ 1365.435748][ T8707] veth1: entered allmulticast mode [ 1365.435928][ T8707] veth7: entered allmulticast mode [ 1365.437807][ T8707] veth1: entered promiscuous mode [ 1365.438047][ T8707] veth7: entered promiscuous mode [ 1365.606580][ T8711] br1: port 1(lag2) entered blocking state [ 1365.606855][ T8711] br1: port 1(lag2) entered forwarding state [ 1365.859759][ T8717] lag3: Mode changed to "loadbalance" [ 1365.937279][ T8719] 8021q: adding VLAN 0 to HW filter on device lag3 [ 1366.175149][ T8724] lag3: Port device veth2 added [ 1366.247572][ T8725] lag3: Port device veth4 added [ 1375.172818][ T8789] veth7: left allmulticast mode [ 1375.182559][ T8789] lag2: Port device veth7 removed [ 1375.242477][ T8790] veth7: left promiscuous mode [ 1388.077667][ T8840] veth7: entered allmulticast mode [ 1388.077928][ T8840] veth7: entered promiscuous mode [ 1388.078961][ T8840] lag2: Port device veth7 added [ 1388.318493][ T8851] veth1: left allmulticast mode [ 1388.320773][ T8851] lag2: Port device veth1 removed [ 1388.385394][ T8852] veth1: left promiscuous mode [ 1401.156361][ T4566] br1: port 1(lag2) entered disabled state [ 1401.209212][ T8902] veth7: left allmulticast mode [ 1401.210465][ T8902] lag2: Port device veth7 removed [ 1401.268744][ T8903] veth7: left promiscuous mode [ 1401.443280][ T8913] veth1: entered allmulticast mode [ 1401.443502][ T8913] veth1: entered promiscuous mode [ 1401.444281][ T8913] lag2: Port device veth1 added [ 1401.460433][ T8669] br1: port 1(lag2) entered blocking state [ 1401.460715][ T8669] br1: port 1(lag2) entered forwarding state [ 1401.686803][ T8924] veth7: entered allmulticast mode [ 1401.687013][ T8924] veth7: entered promiscuous mode [ 1401.687774][ T8924] lag2: Port device veth7 added [ 1414.495259][ T8974] lag2: left allmulticast mode [ 1414.495492][ T8974] veth1: left allmulticast mode [ 1414.495664][ T8974] veth7: left allmulticast mode [ 1414.495845][ T8974] veth1: left promiscuous mode [ 1414.496028][ T8974] veth7: left promiscuous mode [ 1414.496207][ T8974] br1: port 1(lag2) entered disabled state [ 1416.615843][ T8976] br1: port 1(lag2) entered blocking state [ 1416.616272][ T8976] br1: port 1(lag2) entered disabled state [ 1416.616648][ T8976] lag2: entered allmulticast mode [ 1416.616888][ T8976] veth1: entered allmulticast mode [ 1416.617152][ T8976] veth7: entered allmulticast mode [ 1416.619808][ T8976] veth1: entered promiscuous mode [ 1416.620108][ T8976] veth7: entered promiscuous mode [ 1416.621077][ T8976] br1: port 1(lag2) entered blocking state [ 1416.621413][ T8976] br1: port 1(lag2) entered forwarding state [ 1429.423699][ T9026] lag3: Port device veth2 removed [ 1442.298339][ T9077] lag3: Port device veth2 added [ 1442.534113][ T9088] lag3: Port device veth4 removed [ 1455.406011][ T9139] lag3: Port device veth2 removed [ 1455.624460][ T9150] lag3: Port device veth4 added [ 1455.884442][ T9161] lag3: Port device veth2 added [ 1468.694882][ T9211] br1: port 2(lag3) entered blocking state [ 1468.695139][ T9211] br1: port 2(lag3) entered disabled state [ 1468.695371][ T9211] lag3: entered allmulticast mode [ 1468.695518][ T9211] veth4: entered allmulticast mode [ 1468.695662][ T9211] veth2: entered allmulticast mode [ 1468.697281][ T9211] lag3: entered promiscuous mode [ 1468.697444][ T9211] veth4: entered promiscuous mode [ 1468.697791][ T9211] veth2: entered promiscuous mode [ 1468.698264][ T9211] lag2: entered promiscuous mode [ 1468.699542][ T9211] br1: port 2(lag3) entered blocking state [ 1468.699741][ T9211] br1: port 2(lag3) entered forwarding state [ 1470.816800][ T9213] lag3: left allmulticast mode [ 1470.816994][ T9213] veth4: left allmulticast mode [ 1470.817161][ T9213] veth2: left allmulticast mode [ 1470.817317][ T9213] lag3: left promiscuous mode [ 1470.817461][ T9213] veth4: left promiscuous mode [ 1470.817853][ T9213] veth2: left promiscuous mode [ 1470.818343][ T9213] br1: port 2(lag3) entered disabled state [ 1470.819255][ T9213] lag2: left promiscuous mode [ 1483.870097][ T9266] lag3: Port device veth4 removed [ 1483.935433][ T9267] lag3: Port device veth2 removed [ 1484.549671][ T2980] br1: port 1(lag2) entered disabled state [ 1484.656719][ T9282] lag2: left allmulticast mode [ 1484.656914][ T9282] veth1: left allmulticast mode [ 1484.657065][ T9282] veth7: left allmulticast mode [ 1484.657966][ T9282] br1: port 1(lag2) entered disabled state [ 1484.810774][ T9284] lag2: Port device veth7 removed [ 1484.874104][ T9285] lag2: Port device veth1 removed [ 1485.955431][ T9300] lag4: Port device veth5 removed [ 1486.007003][ T9301] lag4: Port device veth3 removed [ 1487.106378][ T9314] lag1: Port device veth6 removed [ 1487.163942][ T9315] lag1: Port device veth0 removed