[ 1394.562628][T28127] lag2: Mode changed to "loadbalance" [ 1394.802669][T28130] [ 1394.802804][T28130] ====================================================== [ 1394.803021][T28130] WARNING: possible circular locking dependency detected [ 1394.803225][T28130] 6.14.0-rc2-virtme #1 Not tainted [ 1394.803389][T28130] ------------------------------------------------------ [ 1394.803599][T28130] ip/28130 is trying to acquire lock: [ 1394.803760][T28130] ffff88800b92ccb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 1394.804019][T28130] [ 1394.804019][T28130] but task is already holding lock: [ 1394.804261][T28130] ffff88801a802d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1394.804563][T28130] [ 1394.804563][T28130] which lock already depends on the new lock. [ 1394.804563][T28130] [ 1394.804878][T28130] [ 1394.804878][T28130] the existing dependency chain (in reverse order) is: [ 1394.805156][T28130] [ 1394.805156][T28130] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 1394.805419][T28130] __lock_acquire+0xb9a/0x1680 [ 1394.805586][T28130] lock_acquire.part.0+0xeb/0x330 [ 1394.805752][T28130] __mutex_lock+0x169/0xc40 [ 1394.805920][T28130] team_set_mac_address+0x120/0x250 [ 1394.806083][T28130] netif_set_mac_address+0x28a/0x410 [ 1394.806284][T28130] do_setlink.constprop.0+0x1980/0x25f0 [ 1394.806488][T28130] rtnl_setlink+0x2b5/0x5a0 [ 1394.806651][T28130] rtnetlink_rcv_msg+0x712/0xc10 [ 1394.806818][T28130] netlink_rcv_skb+0x130/0x360 [ 1394.806982][T28130] netlink_unicast+0x44b/0x710 [ 1394.807146][T28130] netlink_sendmsg+0x723/0xbe0 [ 1394.807310][T28130] __sys_sendto+0x3c3/0x450 [ 1394.807473][T28130] __x64_sys_sendto+0xe0/0x1c0 [ 1394.807634][T28130] do_syscall_64+0xc1/0x1d0 [ 1394.807799][T28130] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1394.808009][T28130] [ 1394.808009][T28130] -> #0 (&dev->lock){+.+.}-{4:4}: [ 1394.808258][T28130] check_prev_add+0x182/0xce0 [ 1394.808421][T28130] validate_chain+0x7bd/0xae0 [ 1394.808585][T28130] __lock_acquire+0xb9a/0x1680 [ 1394.808755][T28130] lock_acquire.part.0+0xeb/0x330 [ 1394.808920][T28130] __mutex_lock+0x169/0xc40 [ 1394.809084][T28130] __dev_open+0x57e/0x710 [ 1394.809251][T28130] netif_open+0xc9/0x130 [ 1394.809412][T28130] dev_open+0x9f/0x1a0 [ 1394.809576][T28130] team_port_add+0x90a/0x1ce0 [ 1394.809739][T28130] team_add_slave+0x41/0x80 [ 1394.809905][T28130] do_set_master+0x302/0x610 [ 1394.810069][T28130] do_setlink.constprop.0+0x87b/0x25f0 [ 1394.810278][T28130] rtnl_newlink+0x69c/0xa70 [ 1394.810447][T28130] rtnetlink_rcv_msg+0x712/0xc10 [ 1394.810609][T28130] netlink_rcv_skb+0x130/0x360 [ 1394.810772][T28130] netlink_unicast+0x44b/0x710 [ 1394.810937][T28130] netlink_sendmsg+0x723/0xbe0 [ 1394.811102][T28130] ____sys_sendmsg+0x7ac/0xa10 [ 1394.811267][T28130] ___sys_sendmsg+0xee/0x170 [ 1394.811433][T28130] __sys_sendmsg+0x109/0x1a0 [ 1394.811596][T28130] do_syscall_64+0xc1/0x1d0 [ 1394.811759][T28130] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1394.811961][T28130] [ 1394.811961][T28130] other info that might help us debug this: [ 1394.811961][T28130] [ 1394.812276][T28130] Possible unsafe locking scenario: [ 1394.812276][T28130] [ 1394.812522][T28130] CPU0 CPU1 [ 1394.812683][T28130] ---- ---- [ 1394.812844][T28130] lock(team->team_lock_key); [ 1394.813008][T28130] lock(&dev->lock); [ 1394.813213][T28130] lock(team->team_lock_key); [ 1394.813456][T28130] lock(&dev->lock); [ 1394.813583][T28130] [ 1394.813583][T28130] *** DEADLOCK *** [ 1394.813583][T28130] [ 1394.813814][T28130] 2 locks held by ip/28130: [ 1394.813961][T28130] #0: ffffffff9fdeeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 1394.814231][T28130] #1: ffff88801a802d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1394.814522][T28130] [ 1394.814522][T28130] stack backtrace: [ 1394.814709][T28130] CPU: 0 UID: 0 PID: 28130 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 1394.814713][T28130] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1394.814715][T28130] Call Trace: [ 1394.814717][T28130] [ 1394.814718][T28130] dump_stack_lvl+0x82/0xd0 [ 1394.814725][T28130] print_circular_bug+0x1b7/0x240 [ 1394.814730][T28130] check_noncircular+0x2f9/0x3e0 [ 1394.814734][T28130] ? __pfx_check_noncircular+0x10/0x10 [ 1394.814738][T28130] ? find_held_lock+0x2c/0x110 [ 1394.814744][T28130] ? alloc_chain_hlocks+0x4e0/0x720 [ 1394.814747][T28130] check_prev_add+0x182/0xce0 [ 1394.814752][T28130] validate_chain+0x7bd/0xae0 [ 1394.814757][T28130] ? stack_depot_save_flags+0x27e/0x440 [ 1394.814763][T28130] ? __pfx_validate_chain+0x10/0x10 [ 1394.814766][T28130] ? hlock_class+0x4e/0x130 [ 1394.814768][T28130] ? mark_lock+0x38/0x3e0 [ 1394.814772][T28130] __lock_acquire+0xb9a/0x1680 [ 1394.814778][T28130] lock_acquire.part.0+0xeb/0x330 [ 1394.814781][T28130] ? __dev_open+0x57e/0x710 [ 1394.814785][T28130] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1394.814788][T28130] ? trace_lock_acquire+0x14c/0x1f0 [ 1394.814792][T28130] ? lock_acquire+0x32/0xc0 [ 1394.814794][T28130] ? __dev_open+0x57e/0x710 [ 1394.814797][T28130] __mutex_lock+0x169/0xc40 [ 1394.814800][T28130] ? __dev_open+0x57e/0x710 [ 1394.814803][T28130] ? __dev_open+0x57e/0x710 [ 1394.814805][T28130] ? __pfx___mutex_lock+0x10/0x10 [ 1394.814813][T28130] ? mutex_is_locked+0x1c/0x60 [ 1394.814816][T28130] ? rtnl_is_locked+0x15/0x20 [ 1394.814821][T28130] ? mirred_device_event+0x3d/0x1e0 [act_mirred] [ 1394.814831][T28130] ? __dev_open+0x57e/0x710 [ 1394.814833][T28130] __dev_open+0x57e/0x710 [ 1394.814835][T28130] ? mark_held_locks+0x9e/0xe0 [ 1394.814838][T28130] ? __pfx___dev_open+0x10/0x10 [ 1394.814841][T28130] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 1394.814847][T28130] netif_open+0xc9/0x130 [ 1394.814850][T28130] ? __pfx_netif_open+0x10/0x10 [ 1394.814854][T28130] dev_open+0x9f/0x1a0 [ 1394.814858][T28130] team_port_add+0x90a/0x1ce0 [ 1394.814863][T28130] ? __pfx_team_port_add+0x10/0x10 [ 1394.814866][T28130] ? rcu_read_lock_any_held+0x43/0xb0 [ 1394.814871][T28130] ? validate_chain+0x1fe/0xae0 [ 1394.814875][T28130] team_add_slave+0x41/0x80 [ 1394.814879][T28130] do_set_master+0x302/0x610 [ 1394.814884][T28130] do_setlink.constprop.0+0x87b/0x25f0 [ 1394.814889][T28130] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 1394.814893][T28130] ? lock_acquire.part.0+0xeb/0x330 [ 1394.814896][T28130] ? rtnl_newlink+0x653/0xa70 [ 1394.814899][T28130] ? rtnl_newlink+0xb9/0xa70 [ 1394.814902][T28130] ? rtnetlink_rcv_msg+0x712/0xc10 [ 1394.814905][T28130] ? __mutex_trylock_common+0xfa/0x260 [ 1394.814908][T28130] ? __pfx___mutex_trylock_common+0x10/0x10 [ 1394.814912][T28130] ? lock_acquire+0x32/0xc0 [ 1394.814915][T28130] ? trace_contention_end+0xef/0x150 [ 1394.814919][T28130] ? __mutex_lock+0x190/0xc40 [ 1394.814922][T28130] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1394.814926][T28130] ? rtnl_newlink+0x653/0xa70 [ 1394.814929][T28130] ? __pfx___mutex_lock+0x10/0x10 [ 1394.814931][T28130] ? __pfx_validate_nla+0x10/0x10 [ 1394.814936][T28130] ? trace_cap_capable+0x11e/0x1a0 [ 1394.814942][T28130] ? __rtnl_newlink+0x3f2/0xa80 [ 1394.814947][T28130] rtnl_newlink+0x69c/0xa70 [ 1394.814951][T28130] ? __pfx_rtnl_newlink+0x10/0x10 [ 1394.814954][T28130] ? find_held_lock+0x2c/0x110 [ 1394.814959][T28130] ? __pfx___lock_release+0x10/0x10 [ 1394.814962][T28130] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1394.814967][T28130] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 1394.814970][T28130] ? __pfx_rtnl_newlink+0x10/0x10 [ 1394.814973][T28130] rtnetlink_rcv_msg+0x712/0xc10 [ 1394.814976][T28130] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1394.814979][T28130] ? hlock_class+0x4e/0x130 [ 1394.814981][T28130] ? mark_lock+0x38/0x3e0 [ 1394.814986][T28130] ? __lock_acquire+0xb9a/0x1680 [ 1394.814990][T28130] netlink_rcv_skb+0x130/0x360 [ 1394.814993][T28130] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1394.814996][T28130] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 1394.815004][T28130] ? netlink_deliver_tap+0x13e/0x340 [ 1394.815007][T28130] ? netlink_deliver_tap+0xc3/0x340 [ 1394.815011][T28130] netlink_unicast+0x44b/0x710 [ 1394.815015][T28130] ? __pfx_netlink_unicast+0x10/0x10 [ 1394.815018][T28130] ? find_held_lock+0x2c/0x110 [ 1394.815023][T28130] netlink_sendmsg+0x723/0xbe0 [ 1394.815028][T28130] ? __pfx_netlink_sendmsg+0x10/0x10 [ 1394.815034][T28130] ____sys_sendmsg+0x7ac/0xa10 [ 1394.815037][T28130] ? __pfx_____sys_sendmsg+0x10/0x10 [ 1394.815040][T28130] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 1394.815047][T28130] ___sys_sendmsg+0xee/0x170 [ 1394.815051][T28130] ? __pfx____sys_sendmsg+0x10/0x10 [ 1394.815055][T28130] ? kasan_save_stack+0x34/0x50 [ 1394.815059][T28130] ? kasan_save_stack+0x24/0x50 [ 1394.815062][T28130] ? kasan_record_aux_stack+0x8c/0xa0 [ 1394.815065][T28130] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 1394.815070][T28130] ? __x64_sys_close+0x7c/0xd0 [ 1394.815074][T28130] ? do_syscall_64+0xc1/0x1d0 [ 1394.815076][T28130] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1394.815079][T28130] ? __lock_acquire+0xb9a/0x1680 [ 1394.815082][T28130] ? lock_downgrade+0x52/0x110 [ 1394.815086][T28130] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1394.815089][T28130] ? find_held_lock+0x2c/0x110 [ 1394.815094][T28130] ? __lock_release+0x103/0x460 [ 1394.815096][T28130] ? __virt_addr_valid+0x22b/0x430 [ 1394.815100][T28130] ? __pfx___lock_release+0x10/0x10 [ 1394.815103][T28130] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1394.815108][T28130] __sys_sendmsg+0x109/0x1a0 [ 1394.815111][T28130] ? __pfx___sys_sendmsg+0x10/0x10 [ 1394.815119][T28130] do_syscall_64+0xc1/0x1d0 [ 1394.815122][T28130] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1394.815125][T28130] RIP: 0033:0x7efd2d8d29a7 [ 1394.815128][T28130] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 1394.815131][T28130] RSP: 002b:00007fff6e5854a8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 1394.815134][T28130] RAX: ffffffffffffffda RBX: 00007fff6e585bd0 RCX: 00007efd2d8d29a7 [ 1394.815136][T28130] RDX: 0000000000000000 RSI: 00007fff6e585510 RDI: 0000000000000005 [ 1394.815138][T28130] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 1394.815139][T28130] R10: 0000000005a1e910 R11: 0000000000000246 R12: 0000000000000004 [ 1394.815141][T28130] R13: 0000000067b2d8cb R14: 0000000000498600 R15: 0000000000000000 [ 1394.815146][T28130] [ 1394.835366][T28130] lag2: Port device veth3 added [ 1395.033984][T28141] lag2: Port device veth5 added [ 1395.147263][T28143] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1395.200724][T28144] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1396.498544][T28171] lag1: Mode changed to "loadbalance" [ 1396.625542][T28174] lag1: Port device veth2 added [ 1396.831878][T28177] lag1: Port device veth4 added [ 1396.960976][T28179] 8021q: adding VLAN 0 to HW filter on device lag1 [ 1402.886266][T28205] lag2: Port device veth5 removed [ 1406.873606][T28215] lag2: Port device veth3 removed [ 1411.756154][T28245] lag2: Mode changed to "loadbalance" [ 1411.890979][T28248] lag2: Port device veth3 added [ 1412.096434][T28253] lag2: Port device veth5 added [ 1412.225794][T28255] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1412.288170][T28256] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1418.344939][T28291] lag2: Port device veth3 removed [ 1422.279366][T28301] lag2: Port device veth5 removed [ 1427.164940][T28331] lag2: Mode changed to "loadbalance" [ 1427.293739][T28334] lag2: Port device veth3 added [ 1427.483712][T28339] lag2: Port device veth5 added [ 1427.601629][T28341] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1427.664818][T28342] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1433.752943][T28171] lag1: Port device veth4 removed [ 1433.774483][T28171] lag1: Port device veth2 removed [ 1435.100667][T28331] lag2: Port device veth5 removed [ 1435.102742][T28331] lag2: Port device veth3 removed