[ 859.326053][ T5781] lag1: Mode changed to "loadbalance" [ 859.682400][ T5789] [ 859.682538][ T5789] ====================================================== [ 859.682734][ T5789] WARNING: possible circular locking dependency detected [ 859.682925][ T5789] 6.14.0-rc2-virtme #1 Not tainted [ 859.683084][ T5789] ------------------------------------------------------ [ 859.683289][ T5789] ip/5789 is trying to acquire lock: [ 859.683441][ T5789] ffff888009381cb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 859.683689][ T5789] [ 859.683689][ T5789] but task is already holding lock: [ 859.683962][ T5789] ffff888008e82d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 859.684250][ T5789] [ 859.684250][ T5789] which lock already depends on the new lock. [ 859.684250][ T5789] [ 859.684572][ T5789] [ 859.684572][ T5789] the existing dependency chain (in reverse order) is: [ 859.684851][ T5789] [ 859.684851][ T5789] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 859.685106][ T5789] __lock_acquire+0xb9a/0x1680 [ 859.685283][ T5789] lock_acquire.part.0+0xeb/0x330 [ 859.685453][ T5789] __mutex_lock+0x169/0xc40 [ 859.685616][ T5789] team_set_mac_address+0x120/0x250 [ 859.685770][ T5789] netif_set_mac_address+0x28a/0x410 [ 859.685967][ T5789] do_setlink.constprop.0+0x1980/0x25f0 [ 859.686168][ T5789] rtnl_setlink+0x2b5/0x5a0 [ 859.686355][ T5789] rtnetlink_rcv_msg+0x712/0xc10 [ 859.686516][ T5789] netlink_rcv_skb+0x130/0x360 [ 859.686684][ T5789] netlink_unicast+0x44b/0x710 [ 859.686845][ T5789] netlink_sendmsg+0x723/0xbe0 [ 859.687014][ T5789] __sys_sendto+0x3c3/0x450 [ 859.687177][ T5789] __x64_sys_sendto+0xe0/0x1c0 [ 859.687342][ T5789] do_syscall_64+0xc1/0x1d0 [ 859.687506][ T5789] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 859.687728][ T5789] [ 859.687728][ T5789] -> #0 (&dev->lock){+.+.}-{4:4}: [ 859.687993][ T5789] check_prev_add+0x182/0xce0 [ 859.688166][ T5789] validate_chain+0x7bd/0xae0 [ 859.688321][ T5789] __lock_acquire+0xb9a/0x1680 [ 859.688473][ T5789] lock_acquire.part.0+0xeb/0x330 [ 859.688626][ T5789] __mutex_lock+0x169/0xc40 [ 859.688791][ T5789] __dev_open+0x57e/0x710 [ 859.688949][ T5789] netif_open+0xc9/0x130 [ 859.689109][ T5789] dev_open+0x9f/0x1a0 [ 859.689264][ T5789] team_port_add+0x90a/0x1ce0 [ 859.689425][ T5789] team_add_slave+0x41/0x80 [ 859.689583][ T5789] do_set_master+0x302/0x610 [ 859.689781][ T5789] do_setlink.constprop.0+0x87b/0x25f0 [ 859.689994][ T5789] rtnl_newlink+0x69c/0xa70 [ 859.690168][ T5789] rtnetlink_rcv_msg+0x712/0xc10 [ 859.690366][ T5789] netlink_rcv_skb+0x130/0x360 [ 859.690543][ T5789] netlink_unicast+0x44b/0x710 [ 859.690713][ T5789] netlink_sendmsg+0x723/0xbe0 [ 859.690886][ T5789] ____sys_sendmsg+0x7ac/0xa10 [ 859.691059][ T5789] ___sys_sendmsg+0xee/0x170 [ 859.691236][ T5789] __sys_sendmsg+0x109/0x1a0 [ 859.691409][ T5789] do_syscall_64+0xc1/0x1d0 [ 859.691583][ T5789] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 859.691818][ T5789] [ 859.691818][ T5789] other info that might help us debug this: [ 859.691818][ T5789] [ 859.692157][ T5789] Possible unsafe locking scenario: [ 859.692157][ T5789] [ 859.692422][ T5789] CPU0 CPU1 [ 859.692597][ T5789] ---- ---- [ 859.692766][ T5789] lock(team->team_lock_key); [ 859.692949][ T5789] lock(&dev->lock); [ 859.693166][ T5789] lock(team->team_lock_key); [ 859.693423][ T5789] lock(&dev->lock); [ 859.693555][ T5789] [ 859.693555][ T5789] *** DEADLOCK *** [ 859.693555][ T5789] [ 859.693813][ T5789] 2 locks held by ip/5789: [ 859.693990][ T5789] #0: ffffffffaa7eeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 859.694329][ T5789] #1: ffff888008e82d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 859.694622][ T5789] [ 859.694622][ T5789] stack backtrace: [ 859.694829][ T5789] CPU: 3 UID: 0 PID: 5789 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 859.694834][ T5789] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 859.694837][ T5789] Call Trace: [ 859.694839][ T5789] [ 859.694842][ T5789] dump_stack_lvl+0x82/0xd0 [ 859.694850][ T5789] print_circular_bug+0x1b7/0x240 [ 859.694856][ T5789] check_noncircular+0x2f9/0x3e0 [ 859.694860][ T5789] ? __pfx_check_noncircular+0x10/0x10 [ 859.694864][ T5789] ? find_held_lock+0x2c/0x110 [ 859.694871][ T5789] ? alloc_chain_hlocks+0x4e0/0x720 [ 859.694875][ T5789] check_prev_add+0x182/0xce0 [ 859.694880][ T5789] validate_chain+0x7bd/0xae0 [ 859.694884][ T5789] ? stack_depot_save_flags+0x27e/0x440 [ 859.694892][ T5789] ? __pfx_validate_chain+0x10/0x10 [ 859.694895][ T5789] ? hlock_class+0x4e/0x130 [ 859.694897][ T5789] ? mark_lock+0x38/0x3e0 [ 859.694902][ T5789] __lock_acquire+0xb9a/0x1680 [ 859.694908][ T5789] lock_acquire.part.0+0xeb/0x330 [ 859.694911][ T5789] ? __dev_open+0x57e/0x710 [ 859.694915][ T5789] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 859.694919][ T5789] ? trace_lock_acquire+0x14c/0x1f0 [ 859.694922][ T5789] ? lock_acquire+0x32/0xc0 [ 859.694925][ T5789] ? __dev_open+0x57e/0x710 [ 859.694928][ T5789] __mutex_lock+0x169/0xc40 [ 859.694931][ T5789] ? __dev_open+0x57e/0x710 [ 859.694938][ T5789] ? __dev_open+0x57e/0x710 [ 859.694940][ T5789] ? __pfx___mutex_lock+0x10/0x10 [ 859.694944][ T5789] ? mutex_is_locked+0x1c/0x60 [ 859.694947][ T5789] ? rtnl_is_locked+0x15/0x20 [ 859.694955][ T5789] ? mirred_device_event+0x3d/0x1e0 [act_mirred] [ 859.694964][ T5789] ? __dev_open+0x57e/0x710 [ 859.694966][ T5789] __dev_open+0x57e/0x710 [ 859.694968][ T5789] ? mark_held_locks+0x9e/0xe0 [ 859.694971][ T5789] ? __pfx___dev_open+0x10/0x10 [ 859.694974][ T5789] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 859.694981][ T5789] netif_open+0xc9/0x130 [ 859.694984][ T5789] ? __pfx_netif_open+0x10/0x10 [ 859.694988][ T5789] dev_open+0x9f/0x1a0 [ 859.694993][ T5789] team_port_add+0x90a/0x1ce0 [ 859.694998][ T5789] ? __pfx_team_port_add+0x10/0x10 [ 859.695002][ T5789] ? rcu_read_lock_any_held+0x43/0xb0 [ 859.695008][ T5789] ? validate_chain+0x1fe/0xae0 [ 859.695013][ T5789] team_add_slave+0x41/0x80 [ 859.695017][ T5789] do_set_master+0x302/0x610 [ 859.695022][ T5789] do_setlink.constprop.0+0x87b/0x25f0 [ 859.695026][ T5789] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 859.695030][ T5789] ? lock_acquire.part.0+0xeb/0x330 [ 859.695033][ T5789] ? rtnl_newlink+0x653/0xa70 [ 859.695036][ T5789] ? rtnl_newlink+0xb9/0xa70 [ 859.695039][ T5789] ? rtnetlink_rcv_msg+0x712/0xc10 [ 859.695042][ T5789] ? __mutex_trylock_common+0xfa/0x260 [ 859.695046][ T5789] ? __pfx___mutex_trylock_common+0x10/0x10 [ 859.695050][ T5789] ? lock_acquire+0x32/0xc0 [ 859.695053][ T5789] ? trace_contention_end+0xef/0x150 [ 859.695056][ T5789] ? __mutex_lock+0x190/0xc40 [ 859.695059][ T5789] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 859.695063][ T5789] ? rtnl_newlink+0x653/0xa70 [ 859.695066][ T5789] ? __pfx___mutex_lock+0x10/0x10 [ 859.695068][ T5789] ? __pfx_validate_nla+0x10/0x10 [ 859.695074][ T5789] ? trace_cap_capable+0x11e/0x1a0 [ 859.695081][ T5789] ? __rtnl_newlink+0x3f2/0xa80 [ 859.695085][ T5789] rtnl_newlink+0x69c/0xa70 [ 859.695090][ T5789] ? __pfx_rtnl_newlink+0x10/0x10 [ 859.695092][ T5789] ? find_held_lock+0x2c/0x110 [ 859.695097][ T5789] ? __pfx___lock_release+0x10/0x10 [ 859.695101][ T5789] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 859.695106][ T5789] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 859.695109][ T5789] ? __pfx_rtnl_newlink+0x10/0x10 [ 859.695112][ T5789] rtnetlink_rcv_msg+0x712/0xc10 [ 859.695116][ T5789] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 859.695119][ T5789] ? hlock_class+0x4e/0x130 [ 859.695121][ T5789] ? mark_lock+0x38/0x3e0 [ 859.695125][ T5789] ? __lock_acquire+0xb9a/0x1680 [ 859.695129][ T5789] netlink_rcv_skb+0x130/0x360 [ 859.695133][ T5789] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 859.695137][ T5789] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 859.695144][ T5789] ? netlink_deliver_tap+0x13e/0x340 [ 859.695148][ T5789] ? netlink_deliver_tap+0xc3/0x340 [ 859.695151][ T5789] netlink_unicast+0x44b/0x710 [ 859.695156][ T5789] ? __pfx_netlink_unicast+0x10/0x10 [ 859.695159][ T5789] ? find_held_lock+0x2c/0x110 [ 859.695164][ T5789] netlink_sendmsg+0x723/0xbe0 [ 859.695169][ T5789] ? __pfx_netlink_sendmsg+0x10/0x10 [ 859.695174][ T5789] ____sys_sendmsg+0x7ac/0xa10 [ 859.695178][ T5789] ? __pfx_____sys_sendmsg+0x10/0x10 [ 859.695181][ T5789] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 859.695188][ T5789] ___sys_sendmsg+0xee/0x170 [ 859.695192][ T5789] ? __pfx____sys_sendmsg+0x10/0x10 [ 859.695196][ T5789] ? kasan_save_stack+0x34/0x50 [ 859.695202][ T5789] ? kasan_save_stack+0x24/0x50 [ 859.695205][ T5789] ? kasan_record_aux_stack+0x8c/0xa0 [ 859.695209][ T5789] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 859.695214][ T5789] ? __x64_sys_close+0x7c/0xd0 [ 859.695219][ T5789] ? do_syscall_64+0xc1/0x1d0 [ 859.695221][ T5789] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 859.695225][ T5789] ? __lock_acquire+0xb9a/0x1680 [ 859.695228][ T5789] ? lock_downgrade+0x52/0x110 [ 859.695232][ T5789] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 859.695236][ T5789] ? find_held_lock+0x2c/0x110 [ 859.695240][ T5789] ? __lock_release+0x103/0x460 [ 859.695243][ T5789] ? __virt_addr_valid+0x22b/0x430 [ 859.695248][ T5789] ? __pfx___lock_release+0x10/0x10 [ 859.695251][ T5789] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 859.695255][ T5789] __sys_sendmsg+0x109/0x1a0 [ 859.695258][ T5789] ? __pfx___sys_sendmsg+0x10/0x10 [ 859.695266][ T5789] do_syscall_64+0xc1/0x1d0 [ 859.695269][ T5789] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 859.695272][ T5789] RIP: 0033:0x7f4e824089a7 [ 859.695277][ T5789] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 859.695280][ T5789] RSP: 002b:00007fff74bc6578 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 859.695284][ T5789] RAX: ffffffffffffffda RBX: 00007fff74bc6ca0 RCX: 00007f4e824089a7 [ 859.695286][ T5789] RDX: 0000000000000000 RSI: 00007fff74bc65e0 RDI: 0000000000000005 [ 859.695288][ T5789] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 859.695289][ T5789] R10: 000000002fe8d910 R11: 0000000000000246 R12: 0000000000000004 [ 859.695291][ T5789] R13: 0000000067b32b3b R14: 0000000000498600 R15: 0000000000000000 [ 859.695296][ T5789] [ 859.718103][ T5789] lag1: Port device veth0 added [ 859.744732][ T5789] ip (5789) used greatest stack depth: 23544 bytes left [ 859.819374][ T5799] lag1: Port device veth6 added [ 860.733140][ T5816] lag4: Mode changed to "loadbalance" [ 861.069893][ T5823] lag4: Port device veth3 added [ 861.155556][ T5824] lag4: Port device veth5 added [ 862.049503][ T5841] lag2: Mode changed to "loadbalance" [ 862.355362][ T5848] lag2: Port device veth1 added [ 862.425810][ T5849] lag2: Port device veth7 added [ 862.639769][ T5854] br1: port 1(lag2) entered blocking state [ 862.640011][ T5854] br1: port 1(lag2) entered disabled state [ 862.640262][ T5854] lag2: entered allmulticast mode [ 862.640422][ T5854] veth1: entered allmulticast mode [ 862.640584][ T5854] veth7: entered allmulticast mode [ 862.642871][ T5854] veth1: entered promiscuous mode [ 862.643078][ T5854] veth7: entered promiscuous mode [ 862.825181][ T5858] br1: port 1(lag2) entered blocking state [ 862.825450][ T5858] br1: port 1(lag2) entered forwarding state [ 863.098670][ T5864] lag3: Mode changed to "loadbalance" [ 863.414019][ T5871] lag3: Port device veth2 added [ 863.525539][ T5872] lag3: Port device veth4 added [ 872.276597][ T5935] veth7: left allmulticast mode [ 872.278050][ T5935] lag2: Port device veth7 removed [ 872.335747][ T5936] veth7: left promiscuous mode [ 885.232333][ T5986] veth7: entered allmulticast mode [ 885.232569][ T5986] veth7: entered promiscuous mode [ 885.233376][ T5986] lag2: Port device veth7 added [ 885.507795][ T5997] veth1: left allmulticast mode [ 885.509155][ T5997] lag2: Port device veth1 removed [ 885.578473][ T5998] veth1: left promiscuous mode [ 898.400409][ T38] br1: port 1(lag2) entered disabled state [ 898.462290][ T6048] veth7: left allmulticast mode [ 898.464316][ T6048] lag2: Port device veth7 removed [ 898.526488][ T6049] veth7: left promiscuous mode [ 898.703708][ T6059] veth1: entered allmulticast mode [ 898.704021][ T6059] veth1: entered promiscuous mode [ 898.705853][ T6059] lag2: Port device veth1 added [ 898.736982][ T5781] br1: port 1(lag2) entered blocking state [ 898.737375][ T5781] br1: port 1(lag2) entered forwarding state [ 898.968750][ T6070] veth7: entered allmulticast mode [ 898.968946][ T6070] veth7: entered promiscuous mode [ 898.969712][ T6070] lag2: Port device veth7 added [ 911.828751][ T6120] lag2: left allmulticast mode [ 911.828992][ T6120] veth1: left allmulticast mode [ 911.829161][ T6120] veth7: left allmulticast mode [ 911.829356][ T6120] veth1: left promiscuous mode [ 911.829540][ T6120] veth7: left promiscuous mode [ 911.829701][ T6120] br1: port 1(lag2) entered disabled state [ 913.938736][ T6122] br1: port 1(lag2) entered blocking state [ 913.939032][ T6122] br1: port 1(lag2) entered disabled state [ 913.939417][ T6122] lag2: entered allmulticast mode [ 913.939568][ T6122] veth1: entered allmulticast mode [ 913.939720][ T6122] veth7: entered allmulticast mode [ 913.941659][ T6122] veth1: entered promiscuous mode [ 913.941891][ T6122] veth7: entered promiscuous mode [ 913.942560][ T6122] br1: port 1(lag2) entered blocking state [ 913.942776][ T6122] br1: port 1(lag2) entered forwarding state [ 926.753767][ T6172] lag3: Port device veth2 removed [ 939.652299][ T6223] lag3: Port device veth2 added [ 939.904423][ T6234] lag3: Port device veth4 removed [ 952.882918][ T6285] lag3: Port device veth2 removed [ 953.147052][ T6296] lag3: Port device veth4 added [ 953.388997][ T6307] lag3: Port device veth2 added [ 966.304350][ T6357] br1: port 2(lag3) entered blocking state [ 966.304595][ T6357] br1: port 2(lag3) entered disabled state [ 966.304822][ T6357] lag3: entered allmulticast mode [ 966.304971][ T6357] veth4: entered allmulticast mode [ 966.305119][ T6357] veth2: entered allmulticast mode [ 966.306723][ T6357] lag3: entered promiscuous mode [ 966.306896][ T6357] veth4: entered promiscuous mode [ 966.307279][ T6357] veth2: entered promiscuous mode [ 966.307770][ T6357] lag2: entered promiscuous mode [ 966.308971][ T6357] br1: port 2(lag3) entered blocking state [ 966.309226][ T6357] br1: port 2(lag3) entered forwarding state [ 968.415770][ T6359] lag3: left allmulticast mode [ 968.415969][ T6359] veth4: left allmulticast mode [ 968.416123][ T6359] veth2: left allmulticast mode [ 968.417423][ T6359] lag3: left promiscuous mode [ 968.417581][ T6359] veth4: left promiscuous mode [ 968.418063][ T6359] veth2: left promiscuous mode [ 968.418648][ T6359] br1: port 2(lag3) entered disabled state [ 968.419638][ T6359] lag2: left promiscuous mode [ 981.613248][ T6412] lag3: Port device veth4 removed [ 981.694503][ T6413] lag3: Port device veth2 removed [ 982.388175][ T45] br1: port 1(lag2) entered disabled state [ 982.525147][ T6428] lag2: left allmulticast mode [ 982.526269][ T6428] veth1: left allmulticast mode [ 982.526532][ T6428] veth7: left allmulticast mode [ 982.526734][ T6428] br1: port 1(lag2) entered disabled state [ 982.718806][ T6430] lag2: Port device veth7 removed [ 982.793951][ T6431] lag2: Port device veth1 removed [ 984.016688][ T6446] lag4: Port device veth5 removed [ 984.083708][ T6447] lag4: Port device veth3 removed [ 985.166280][ T6460] lag1: Port device veth6 removed [ 985.228845][ T6461] lag1: Port device veth0 removed