[ 868.176100][ T4472] lag1: Mode changed to "loadbalance" [ 868.281752][ T4473] 8021q: adding VLAN 0 to HW filter on device lag1 [ 868.601697][ T4480] [ 868.601854][ T4480] ====================================================== [ 868.602060][ T4480] WARNING: possible circular locking dependency detected [ 868.602271][ T4480] 6.14.0-rc2-virtme #1 Not tainted [ 868.602441][ T4480] ------------------------------------------------------ [ 868.602629][ T4480] ip/4480 is trying to acquire lock: [ 868.602778][ T4480] ffff888005374cb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 868.603018][ T4480] [ 868.603018][ T4480] but task is already holding lock: [ 868.603387][ T4480] ffff88800e812d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 868.603660][ T4480] [ 868.603660][ T4480] which lock already depends on the new lock. [ 868.603660][ T4480] [ 868.603950][ T4480] [ 868.603950][ T4480] the existing dependency chain (in reverse order) is: [ 868.604212][ T4480] [ 868.604212][ T4480] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 868.604451][ T4480] __lock_acquire+0xb9a/0x1680 [ 868.604612][ T4480] lock_acquire.part.0+0xeb/0x330 [ 868.604761][ T4480] __mutex_lock+0x169/0xc40 [ 868.604928][ T4480] team_set_mac_address+0x120/0x250 [ 868.605078][ T4480] netif_set_mac_address+0x28a/0x410 [ 868.605263][ T4480] do_setlink.constprop.0+0x1980/0x25f0 [ 868.605522][ T4480] rtnl_setlink+0x2b5/0x5a0 [ 868.605676][ T4480] rtnetlink_rcv_msg+0x712/0xc10 [ 868.605825][ T4480] netlink_rcv_skb+0x130/0x360 [ 868.605976][ T4480] netlink_unicast+0x44b/0x710 [ 868.606124][ T4480] netlink_sendmsg+0x723/0xbe0 [ 868.606272][ T4480] __sys_sendto+0x3c3/0x450 [ 868.606434][ T4480] __x64_sys_sendto+0xe0/0x1c0 [ 868.606584][ T4480] do_syscall_64+0xc1/0x1d0 [ 868.606737][ T4480] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 868.606924][ T4480] [ 868.606924][ T4480] -> #0 (&dev->lock){+.+.}-{4:4}: [ 868.607148][ T4480] check_prev_add+0x182/0xce0 [ 868.607311][ T4480] validate_chain+0x7bd/0xae0 [ 868.607460][ T4480] __lock_acquire+0xb9a/0x1680 [ 868.607611][ T4480] lock_acquire.part.0+0xeb/0x330 [ 868.607772][ T4480] __mutex_lock+0x169/0xc40 [ 868.607936][ T4480] __dev_open+0x57e/0x710 [ 868.608099][ T4480] netif_open+0xc9/0x130 [ 868.608261][ T4480] dev_open+0x9f/0x1a0 [ 868.608431][ T4480] team_port_add+0x90a/0x1ce0 [ 868.608596][ T4480] team_add_slave+0x41/0x80 [ 868.608758][ T4480] do_set_master+0x302/0x610 [ 868.608919][ T4480] do_setlink.constprop.0+0x87b/0x25f0 [ 868.609127][ T4480] rtnl_newlink+0x69c/0xa70 [ 868.609291][ T4480] rtnetlink_rcv_msg+0x712/0xc10 [ 868.609545][ T4480] netlink_rcv_skb+0x130/0x360 [ 868.609786][ T4480] netlink_unicast+0x44b/0x710 [ 868.609954][ T4480] netlink_sendmsg+0x723/0xbe0 [ 868.610117][ T4480] ____sys_sendmsg+0x7ac/0xa10 [ 868.610286][ T4480] ___sys_sendmsg+0xee/0x170 [ 868.610458][ T4480] __sys_sendmsg+0x109/0x1a0 [ 868.610622][ T4480] do_syscall_64+0xc1/0x1d0 [ 868.610785][ T4480] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 868.610987][ T4480] [ 868.610987][ T4480] other info that might help us debug this: [ 868.610987][ T4480] [ 868.611303][ T4480] Possible unsafe locking scenario: [ 868.611303][ T4480] [ 868.611546][ T4480] CPU0 CPU1 [ 868.611708][ T4480] ---- ---- [ 868.611869][ T4480] lock(team->team_lock_key); [ 868.612037][ T4480] lock(&dev->lock); [ 868.612239][ T4480] lock(team->team_lock_key); [ 868.612486][ T4480] lock(&dev->lock); [ 868.612619][ T4480] [ 868.612619][ T4480] *** DEADLOCK *** [ 868.612619][ T4480] [ 868.612857][ T4480] 2 locks held by ip/4480: [ 868.613023][ T4480] #0: ffffffffba7eeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 868.613298][ T4480] #1: ffff88800e812d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 868.613568][ T4480] [ 868.613568][ T4480] stack backtrace: [ 868.613752][ T4480] CPU: 3 UID: 0 PID: 4480 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 868.613757][ T4480] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 868.613759][ T4480] Call Trace: [ 868.613761][ T4480] [ 868.613763][ T4480] dump_stack_lvl+0x82/0xd0 [ 868.613770][ T4480] print_circular_bug+0x1b7/0x240 [ 868.613775][ T4480] check_noncircular+0x2f9/0x3e0 [ 868.613779][ T4480] ? __pfx_check_noncircular+0x10/0x10 [ 868.613783][ T4480] ? find_held_lock+0x2c/0x110 [ 868.613789][ T4480] ? alloc_chain_hlocks+0x4e0/0x720 [ 868.613793][ T4480] check_prev_add+0x182/0xce0 [ 868.613798][ T4480] validate_chain+0x7bd/0xae0 [ 868.613802][ T4480] ? stack_depot_save_flags+0x27e/0x440 [ 868.613808][ T4480] ? __pfx_validate_chain+0x10/0x10 [ 868.613811][ T4480] ? hlock_class+0x4e/0x130 [ 868.613813][ T4480] ? mark_lock+0x38/0x3e0 [ 868.613817][ T4480] __lock_acquire+0xb9a/0x1680 [ 868.613822][ T4480] ? mark_lock+0x38/0x3e0 [ 868.613826][ T4480] lock_acquire.part.0+0xeb/0x330 [ 868.613829][ T4480] ? __dev_open+0x57e/0x710 [ 868.613832][ T4480] ? validate_chain+0x162/0xae0 [ 868.613835][ T4480] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 868.613838][ T4480] ? trace_lock_acquire+0x14c/0x1f0 [ 868.613842][ T4480] ? lock_acquire+0x32/0xc0 [ 868.613844][ T4480] ? __dev_open+0x57e/0x710 [ 868.613848][ T4480] __mutex_lock+0x169/0xc40 [ 868.613850][ T4480] ? __dev_open+0x57e/0x710 [ 868.613854][ T4480] ? __dev_open+0x57e/0x710 [ 868.613856][ T4480] ? __pfx___mutex_lock+0x10/0x10 [ 868.613860][ T4480] ? mutex_is_locked+0x1c/0x60 [ 868.613863][ T4480] ? rtnl_is_locked+0x15/0x20 [ 868.613871][ T4480] ? mirred_device_event+0x3d/0x1e0 [act_mirred] [ 868.613880][ T4480] ? __dev_open+0x57e/0x710 [ 868.613882][ T4480] __dev_open+0x57e/0x710 [ 868.613884][ T4480] ? mark_held_locks+0x9e/0xe0 [ 868.613887][ T4480] ? __pfx___dev_open+0x10/0x10 [ 868.613890][ T4480] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 868.613896][ T4480] netif_open+0xc9/0x130 [ 868.613899][ T4480] ? __pfx_netif_open+0x10/0x10 [ 868.613903][ T4480] dev_open+0x9f/0x1a0 [ 868.613908][ T4480] team_port_add+0x90a/0x1ce0 [ 868.613913][ T4480] ? __pfx_team_port_add+0x10/0x10 [ 868.613916][ T4480] ? rcu_read_lock_any_held+0x43/0xb0 [ 868.613922][ T4480] ? validate_chain+0x1fe/0xae0 [ 868.613926][ T4480] team_add_slave+0x41/0x80 [ 868.613930][ T4480] do_set_master+0x302/0x610 [ 868.613935][ T4480] do_setlink.constprop.0+0x87b/0x25f0 [ 868.613939][ T4480] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 868.613944][ T4480] ? lock_acquire.part.0+0xeb/0x330 [ 868.613947][ T4480] ? rtnl_newlink+0x653/0xa70 [ 868.613950][ T4480] ? rtnl_newlink+0xb9/0xa70 [ 868.613952][ T4480] ? rtnetlink_rcv_msg+0x712/0xc10 [ 868.613955][ T4480] ? __mutex_trylock_common+0xfa/0x260 [ 868.613959][ T4480] ? __pfx___mutex_trylock_common+0x10/0x10 [ 868.613962][ T4480] ? lock_acquire+0x32/0xc0 [ 868.613966][ T4480] ? trace_contention_end+0xef/0x150 [ 868.613969][ T4480] ? __mutex_lock+0x190/0xc40 [ 868.613972][ T4480] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 868.613976][ T4480] ? rtnl_newlink+0x653/0xa70 [ 868.613979][ T4480] ? __pfx___mutex_lock+0x10/0x10 [ 868.613981][ T4480] ? __pfx_validate_nla+0x10/0x10 [ 868.613986][ T4480] ? trace_cap_capable+0x11e/0x1a0 [ 868.613992][ T4480] ? __rtnl_newlink+0x3f2/0xa80 [ 868.613997][ T4480] rtnl_newlink+0x69c/0xa70 [ 868.614001][ T4480] ? __pfx_rtnl_newlink+0x10/0x10 [ 868.614004][ T4480] ? find_held_lock+0x2c/0x110 [ 868.614009][ T4480] ? __pfx___lock_release+0x10/0x10 [ 868.614012][ T4480] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 868.614017][ T4480] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 868.614020][ T4480] ? __pfx_rtnl_newlink+0x10/0x10 [ 868.614023][ T4480] rtnetlink_rcv_msg+0x712/0xc10 [ 868.614027][ T4480] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 868.614031][ T4480] ? hlock_class+0x4e/0x130 [ 868.614033][ T4480] ? mark_lock+0x38/0x3e0 [ 868.614037][ T4480] ? __lock_acquire+0xb9a/0x1680 [ 868.614041][ T4480] netlink_rcv_skb+0x130/0x360 [ 868.614044][ T4480] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 868.614048][ T4480] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 868.614055][ T4480] ? netlink_deliver_tap+0x13e/0x340 [ 868.614059][ T4480] ? netlink_deliver_tap+0xc3/0x340 [ 868.614063][ T4480] netlink_unicast+0x44b/0x710 [ 868.614067][ T4480] ? __pfx_netlink_unicast+0x10/0x10 [ 868.614070][ T4480] ? find_held_lock+0x2c/0x110 [ 868.614075][ T4480] netlink_sendmsg+0x723/0xbe0 [ 868.614080][ T4480] ? __pfx_netlink_sendmsg+0x10/0x10 [ 868.614086][ T4480] ____sys_sendmsg+0x7ac/0xa10 [ 868.614089][ T4480] ? __pfx_____sys_sendmsg+0x10/0x10 [ 868.614092][ T4480] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 868.614099][ T4480] ___sys_sendmsg+0xee/0x170 [ 868.614103][ T4480] ? __pfx____sys_sendmsg+0x10/0x10 [ 868.614107][ T4480] ? kasan_save_stack+0x34/0x50 [ 868.614111][ T4480] ? kasan_save_stack+0x24/0x50 [ 868.614114][ T4480] ? kasan_record_aux_stack+0x8c/0xa0 [ 868.614117][ T4480] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 868.614120][ T4480] ? __x64_sys_close+0x7c/0xd0 [ 868.614124][ T4480] ? do_syscall_64+0xc1/0x1d0 [ 868.614126][ T4480] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 868.614130][ T4480] ? __lock_acquire+0xb9a/0x1680 [ 868.614133][ T4480] ? lock_downgrade+0x52/0x110 [ 868.614137][ T4480] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 868.614140][ T4480] ? find_held_lock+0x2c/0x110 [ 868.614145][ T4480] ? __lock_release+0x103/0x460 [ 868.614147][ T4480] ? __virt_addr_valid+0x22b/0x430 [ 868.614151][ T4480] ? __pfx___lock_release+0x10/0x10 [ 868.614154][ T4480] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 868.614159][ T4480] __sys_sendmsg+0x109/0x1a0 [ 868.614162][ T4480] ? __pfx___sys_sendmsg+0x10/0x10 [ 868.614170][ T4480] do_syscall_64+0xc1/0x1d0 [ 868.614173][ T4480] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 868.614176][ T4480] RIP: 0033:0x7f0dd7de99a7 [ 868.614180][ T4480] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 868.614182][ T4480] RSP: 002b:00007fffcfe31d88 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 868.614186][ T4480] RAX: ffffffffffffffda RBX: 00007fffcfe324b0 RCX: 00007f0dd7de99a7 [ 868.614188][ T4480] RDX: 0000000000000000 RSI: 00007fffcfe31df0 RDI: 0000000000000005 [ 868.614190][ T4480] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 868.614191][ T4480] R10: 00000000322ae910 R11: 0000000000000246 R12: 0000000000000004 [ 868.614193][ T4480] R13: 0000000067b35591 R14: 0000000000498600 R15: 0000000000000000 [ 868.614198][ T4480] [ 868.634358][ T4480] lag1: Port device veth0 added [ 868.654851][ T4480] ip (4480) used greatest stack depth: 23456 bytes left [ 868.741934][ T4490] lag1: Port device veth6 added [ 869.043792][ T4496] 8021q: adding VLAN 0 to HW filter on device lag1 [ 869.567855][ T4507] lag4: Mode changed to "loadbalance" [ 869.641853][ T4509] 8021q: adding VLAN 0 to HW filter on device lag4 [ 869.901100][ T4514] lag4: Port device veth3 added [ 869.973009][ T4515] lag4: Port device veth5 added [ 870.331840][ T4521] 8021q: adding VLAN 0 to HW filter on device lag4 [ 870.885822][ T4532] lag2: Mode changed to "loadbalance" [ 870.967727][ T4534] 8021q: adding VLAN 0 to HW filter on device lag2 [ 871.182333][ T4539] lag2: Port device veth1 added [ 871.244140][ T4540] lag2: Port device veth7 added [ 871.464723][ T4545] br1: port 1(lag2) entered blocking state [ 871.465089][ T4545] br1: port 1(lag2) entered disabled state [ 871.465429][ T4545] lag2: entered allmulticast mode [ 871.465654][ T4545] veth1: entered allmulticast mode [ 871.465886][ T4545] veth7: entered allmulticast mode [ 871.469142][ T4545] veth1: entered promiscuous mode [ 871.469442][ T4545] veth7: entered promiscuous mode [ 871.684960][ T4549] br1: port 1(lag2) entered blocking state [ 871.685215][ T4549] br1: port 1(lag2) entered forwarding state [ 871.936169][ T4555] lag3: Mode changed to "loadbalance" [ 872.015434][ T4557] 8021q: adding VLAN 0 to HW filter on device lag3 [ 872.231753][ T4562] lag3: Port device veth2 added [ 872.307935][ T4563] lag3: Port device veth4 added [ 881.141865][ T4627] veth7: left allmulticast mode [ 881.155063][ T4627] lag2: Port device veth7 removed [ 881.235013][ T4628] veth7: left promiscuous mode [ 894.058450][ T4678] veth7: entered allmulticast mode [ 894.058695][ T4678] veth7: entered promiscuous mode [ 894.059512][ T4678] lag2: Port device veth7 added [ 894.289943][ T4689] veth1: left allmulticast mode [ 894.291909][ T4689] lag2: Port device veth1 removed [ 894.358980][ T4690] veth1: left promiscuous mode [ 907.213995][ T870] br1: port 1(lag2) entered disabled state [ 907.278763][ T4740] veth7: left allmulticast mode [ 907.282223][ T4740] lag2: Port device veth7 removed [ 907.348912][ T4741] veth7: left promiscuous mode [ 907.562365][ T4751] veth1: entered allmulticast mode [ 907.562621][ T4751] veth1: entered promiscuous mode [ 907.563499][ T4751] lag2: Port device veth1 added [ 907.592815][ T4532] br1: port 1(lag2) entered blocking state [ 907.593083][ T4532] br1: port 1(lag2) entered forwarding state [ 907.848136][ T4762] veth7: entered allmulticast mode [ 907.848369][ T4762] veth7: entered promiscuous mode [ 907.849195][ T4762] lag2: Port device veth7 added [ 920.708065][ T4812] lag2: left allmulticast mode [ 920.708368][ T4812] veth1: left allmulticast mode [ 920.708536][ T4812] veth7: left allmulticast mode [ 920.708716][ T4812] veth1: left promiscuous mode [ 920.708892][ T4812] veth7: left promiscuous mode [ 920.709055][ T4812] br1: port 1(lag2) entered disabled state [ 922.821258][ T4814] br1: port 1(lag2) entered blocking state [ 922.821496][ T4814] br1: port 1(lag2) entered disabled state [ 922.821726][ T4814] lag2: entered allmulticast mode [ 922.821886][ T4814] veth1: entered allmulticast mode [ 922.822048][ T4814] veth7: entered allmulticast mode [ 922.823874][ T4814] veth1: entered promiscuous mode [ 922.824130][ T4814] veth7: entered promiscuous mode [ 922.824956][ T4814] br1: port 1(lag2) entered blocking state [ 922.825176][ T4814] br1: port 1(lag2) entered forwarding state [ 935.686154][ T4864] lag3: Port device veth2 removed [ 948.696890][ T4915] lag3: Port device veth2 added [ 948.953742][ T4926] lag3: Port device veth4 removed [ 961.865202][ T4977] lag3: Port device veth2 removed [ 962.121609][ T4988] lag3: Port device veth4 added [ 962.371139][ T4999] lag3: Port device veth2 added [ 975.257640][ T5049] br1: port 2(lag3) entered blocking state [ 975.257934][ T5049] br1: port 2(lag3) entered disabled state [ 975.258197][ T5049] lag3: entered allmulticast mode [ 975.258375][ T5049] veth4: entered allmulticast mode [ 975.258552][ T5049] veth2: entered allmulticast mode [ 975.260136][ T5049] lag3: entered promiscuous mode [ 975.260350][ T5049] veth4: entered promiscuous mode [ 975.260746][ T5049] veth2: entered promiscuous mode [ 975.261266][ T5049] lag2: entered promiscuous mode [ 975.262638][ T5049] br1: port 2(lag3) entered blocking state [ 975.262886][ T5049] br1: port 2(lag3) entered forwarding state [ 977.366599][ T5051] lag3: left allmulticast mode [ 977.366817][ T5051] veth4: left allmulticast mode [ 977.366977][ T5051] veth2: left allmulticast mode [ 977.367143][ T5051] lag3: left promiscuous mode [ 977.367301][ T5051] veth4: left promiscuous mode [ 977.367710][ T5051] veth2: left promiscuous mode [ 977.368229][ T5051] br1: port 2(lag3) entered disabled state [ 977.369231][ T5051] lag2: left promiscuous mode [ 990.587409][ T5104] lag3: Port device veth4 removed [ 990.656918][ T5105] lag3: Port device veth2 removed [ 991.337908][ T39] br1: port 1(lag2) entered disabled state [ 991.455717][ T5120] lag2: left allmulticast mode [ 991.455965][ T5120] veth1: left allmulticast mode [ 991.456135][ T5120] veth7: left allmulticast mode [ 991.457670][ T5120] br1: port 1(lag2) entered disabled state [ 991.659670][ T5122] lag2: Port device veth7 removed [ 991.733855][ T5123] lag2: Port device veth1 removed [ 992.871633][ T5137] lag4: Port device veth5 removed [ 992.943085][ T5138] lag4: Port device veth3 removed [ 994.216519][ T5152] lag1: Port device veth6 removed [ 994.285605][ T5153] lag1: Port device veth0 removed