[ 1384.392174][T15121] lag2: Mode changed to "loadbalance" [ 1384.575074][T15124] [ 1384.575213][T15124] ====================================================== [ 1384.575420][T15124] WARNING: possible circular locking dependency detected [ 1384.575627][T15124] 6.14.0-rc2-virtme #1 Not tainted [ 1384.575799][T15124] ------------------------------------------------------ [ 1384.575998][T15124] ip/15124 is trying to acquire lock: [ 1384.576172][T15124] ffff88800c15ccb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 1384.576446][T15124] [ 1384.576446][T15124] but task is already holding lock: [ 1384.576690][T15124] ffff888005482d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1384.576985][T15124] [ 1384.576985][T15124] which lock already depends on the new lock. [ 1384.576985][T15124] [ 1384.577326][T15124] [ 1384.577326][T15124] the existing dependency chain (in reverse order) is: [ 1384.577612][T15124] [ 1384.577612][T15124] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 1384.577860][T15124] __lock_acquire+0xb9a/0x1680 [ 1384.578034][T15124] lock_acquire.part.0+0xeb/0x330 [ 1384.578206][T15124] __mutex_lock+0x169/0xc40 [ 1384.578369][T15124] team_set_mac_address+0x120/0x250 [ 1384.578537][T15124] netif_set_mac_address+0x28a/0x410 [ 1384.578760][T15124] do_setlink.constprop.0+0x1980/0x25f0 [ 1384.578979][T15124] rtnl_setlink+0x2b5/0x5a0 [ 1384.579148][T15124] rtnetlink_rcv_msg+0x712/0xc10 [ 1384.579309][T15124] netlink_rcv_skb+0x130/0x360 [ 1384.579479][T15124] netlink_unicast+0x44b/0x710 [ 1384.579639][T15124] netlink_sendmsg+0x723/0xbe0 [ 1384.579804][T15124] __sys_sendto+0x3c3/0x450 [ 1384.579970][T15124] __x64_sys_sendto+0xe0/0x1c0 [ 1384.580134][T15124] do_syscall_64+0xc1/0x1d0 [ 1384.580291][T15124] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1384.580481][T15124] [ 1384.580481][T15124] -> #0 (&dev->lock){+.+.}-{4:4}: [ 1384.580706][T15124] check_prev_add+0x182/0xce0 [ 1384.580872][T15124] validate_chain+0x7bd/0xae0 [ 1384.581044][T15124] __lock_acquire+0xb9a/0x1680 [ 1384.581202][T15124] lock_acquire.part.0+0xeb/0x330 [ 1384.581364][T15124] __mutex_lock+0x169/0xc40 [ 1384.581544][T15124] __dev_open+0x57e/0x710 [ 1384.581703][T15124] netif_open+0xc9/0x130 [ 1384.581864][T15124] dev_open+0x9f/0x1a0 [ 1384.582026][T15124] team_port_add+0x90a/0x1ce0 [ 1384.582200][T15124] team_add_slave+0x41/0x80 [ 1384.582365][T15124] do_set_master+0x302/0x610 [ 1384.582523][T15124] do_setlink.constprop.0+0x87b/0x25f0 [ 1384.582726][T15124] rtnl_newlink+0x69c/0xa70 [ 1384.582889][T15124] rtnetlink_rcv_msg+0x712/0xc10 [ 1384.583048][T15124] netlink_rcv_skb+0x130/0x360 [ 1384.583205][T15124] netlink_unicast+0x44b/0x710 [ 1384.583368][T15124] netlink_sendmsg+0x723/0xbe0 [ 1384.583532][T15124] ____sys_sendmsg+0x7ac/0xa10 [ 1384.583695][T15124] ___sys_sendmsg+0xee/0x170 [ 1384.583860][T15124] __sys_sendmsg+0x109/0x1a0 [ 1384.584137][T15124] do_syscall_64+0xc1/0x1d0 [ 1384.584301][T15124] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1384.584507][T15124] [ 1384.584507][T15124] other info that might help us debug this: [ 1384.584507][T15124] [ 1384.584907][T15124] Possible unsafe locking scenario: [ 1384.584907][T15124] [ 1384.585153][T15124] CPU0 CPU1 [ 1384.585313][T15124] ---- ---- [ 1384.585472][T15124] lock(team->team_lock_key); [ 1384.585720][T15124] lock(&dev->lock); [ 1384.585924][T15124] lock(team->team_lock_key); [ 1384.586160][T15124] lock(&dev->lock); [ 1384.586283][T15124] [ 1384.586283][T15124] *** DEADLOCK *** [ 1384.586283][T15124] [ 1384.586598][T15124] 2 locks held by ip/15124: [ 1384.586761][T15124] #0: ffffffffb37eeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 1384.587053][T15124] #1: ffff888005482d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1384.587423][T15124] [ 1384.587423][T15124] stack backtrace: [ 1384.587618][T15124] CPU: 2 UID: 0 PID: 15124 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 1384.587623][T15124] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1384.587626][T15124] Call Trace: [ 1384.587628][T15124] [ 1384.587630][T15124] dump_stack_lvl+0x82/0xd0 [ 1384.587638][T15124] print_circular_bug+0x1b7/0x240 [ 1384.587645][T15124] check_noncircular+0x2f9/0x3e0 [ 1384.587648][T15124] ? __pfx_check_noncircular+0x10/0x10 [ 1384.587652][T15124] ? find_held_lock+0x2c/0x110 [ 1384.587659][T15124] ? alloc_chain_hlocks+0x4e0/0x720 [ 1384.587663][T15124] check_prev_add+0x182/0xce0 [ 1384.587667][T15124] validate_chain+0x7bd/0xae0 [ 1384.587672][T15124] ? stack_depot_save_flags+0x27e/0x440 [ 1384.587679][T15124] ? __pfx_validate_chain+0x10/0x10 [ 1384.587682][T15124] ? hlock_class+0x4e/0x130 [ 1384.587684][T15124] ? mark_lock+0x38/0x3e0 [ 1384.587688][T15124] __lock_acquire+0xb9a/0x1680 [ 1384.587694][T15124] lock_acquire.part.0+0xeb/0x330 [ 1384.587697][T15124] ? __dev_open+0x57e/0x710 [ 1384.587701][T15124] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1384.587704][T15124] ? trace_lock_acquire+0x14c/0x1f0 [ 1384.587708][T15124] ? lock_acquire+0x32/0xc0 [ 1384.587710][T15124] ? __dev_open+0x57e/0x710 [ 1384.587713][T15124] __mutex_lock+0x169/0xc40 [ 1384.587716][T15124] ? __dev_open+0x57e/0x710 [ 1384.587721][T15124] ? __dev_open+0x57e/0x710 [ 1384.587723][T15124] ? __pfx___mutex_lock+0x10/0x10 [ 1384.587727][T15124] ? mutex_is_locked+0x1c/0x60 [ 1384.587730][T15124] ? rtnl_is_locked+0x15/0x20 [ 1384.587738][T15124] ? mirred_device_event+0x3d/0x1e0 [act_mirred] [ 1384.587746][T15124] ? __dev_open+0x57e/0x710 [ 1384.587748][T15124] __dev_open+0x57e/0x710 [ 1384.587750][T15124] ? mark_held_locks+0x9e/0xe0 [ 1384.587753][T15124] ? __pfx___dev_open+0x10/0x10 [ 1384.587756][T15124] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 1384.587763][T15124] netif_open+0xc9/0x130 [ 1384.587766][T15124] ? __pfx_netif_open+0x10/0x10 [ 1384.587770][T15124] dev_open+0x9f/0x1a0 [ 1384.587774][T15124] team_port_add+0x90a/0x1ce0 [ 1384.587780][T15124] ? __pfx_team_port_add+0x10/0x10 [ 1384.587783][T15124] ? rcu_read_lock_any_held+0x43/0xb0 [ 1384.587790][T15124] ? validate_chain+0x1fe/0xae0 [ 1384.587795][T15124] team_add_slave+0x41/0x80 [ 1384.587799][T15124] do_set_master+0x302/0x610 [ 1384.587803][T15124] do_setlink.constprop.0+0x87b/0x25f0 [ 1384.587807][T15124] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 1384.587811][T15124] ? lock_acquire.part.0+0xeb/0x330 [ 1384.587814][T15124] ? rtnl_newlink+0x653/0xa70 [ 1384.587817][T15124] ? rtnl_newlink+0xb9/0xa70 [ 1384.587819][T15124] ? rtnetlink_rcv_msg+0x712/0xc10 [ 1384.587822][T15124] ? __mutex_trylock_common+0xfa/0x260 [ 1384.587826][T15124] ? __pfx___mutex_trylock_common+0x10/0x10 [ 1384.587829][T15124] ? lock_acquire+0x32/0xc0 [ 1384.587833][T15124] ? trace_contention_end+0xef/0x150 [ 1384.587836][T15124] ? __mutex_lock+0x190/0xc40 [ 1384.587839][T15124] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1384.587842][T15124] ? rtnl_newlink+0x653/0xa70 [ 1384.587845][T15124] ? __pfx___mutex_lock+0x10/0x10 [ 1384.587847][T15124] ? __pfx_validate_nla+0x10/0x10 [ 1384.587852][T15124] ? trace_cap_capable+0x11e/0x1a0 [ 1384.587859][T15124] ? __rtnl_newlink+0x3f2/0xa80 [ 1384.587863][T15124] rtnl_newlink+0x69c/0xa70 [ 1384.587868][T15124] ? __pfx_rtnl_newlink+0x10/0x10 [ 1384.587870][T15124] ? find_held_lock+0x2c/0x110 [ 1384.587875][T15124] ? __pfx___lock_release+0x10/0x10 [ 1384.587878][T15124] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1384.587883][T15124] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 1384.587886][T15124] ? __pfx_rtnl_newlink+0x10/0x10 [ 1384.587889][T15124] rtnetlink_rcv_msg+0x712/0xc10 [ 1384.587892][T15124] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1384.587895][T15124] ? hlock_class+0x4e/0x130 [ 1384.587897][T15124] ? mark_lock+0x38/0x3e0 [ 1384.587901][T15124] ? __lock_acquire+0xb9a/0x1680 [ 1384.587905][T15124] netlink_rcv_skb+0x130/0x360 [ 1384.587909][T15124] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1384.587912][T15124] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 1384.587919][T15124] ? netlink_deliver_tap+0x13e/0x340 [ 1384.587923][T15124] ? netlink_deliver_tap+0xc3/0x340 [ 1384.587926][T15124] netlink_unicast+0x44b/0x710 [ 1384.587931][T15124] ? __pfx_netlink_unicast+0x10/0x10 [ 1384.587934][T15124] ? find_held_lock+0x2c/0x110 [ 1384.587939][T15124] netlink_sendmsg+0x723/0xbe0 [ 1384.587943][T15124] ? __pfx_netlink_sendmsg+0x10/0x10 [ 1384.587949][T15124] ____sys_sendmsg+0x7ac/0xa10 [ 1384.587953][T15124] ? __pfx_____sys_sendmsg+0x10/0x10 [ 1384.587955][T15124] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 1384.587962][T15124] ___sys_sendmsg+0xee/0x170 [ 1384.587966][T15124] ? __pfx____sys_sendmsg+0x10/0x10 [ 1384.587971][T15124] ? kasan_save_stack+0x34/0x50 [ 1384.587975][T15124] ? kasan_save_stack+0x24/0x50 [ 1384.587978][T15124] ? kasan_record_aux_stack+0x8c/0xa0 [ 1384.587981][T15124] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 1384.587985][T15124] ? __x64_sys_close+0x7c/0xd0 [ 1384.587990][T15124] ? do_syscall_64+0xc1/0x1d0 [ 1384.587992][T15124] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1384.587995][T15124] ? __lock_acquire+0xb9a/0x1680 [ 1384.587998][T15124] ? lock_downgrade+0x52/0x110 [ 1384.588002][T15124] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1384.588005][T15124] ? find_held_lock+0x2c/0x110 [ 1384.588010][T15124] ? __lock_release+0x103/0x460 [ 1384.588012][T15124] ? __virt_addr_valid+0x22b/0x430 [ 1384.588018][T15124] ? __pfx___lock_release+0x10/0x10 [ 1384.588020][T15124] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1384.588025][T15124] __sys_sendmsg+0x109/0x1a0 [ 1384.588028][T15124] ? __pfx___sys_sendmsg+0x10/0x10 [ 1384.588036][T15124] do_syscall_64+0xc1/0x1d0 [ 1384.588039][T15124] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1384.588042][T15124] RIP: 0033:0x7f8369ed49a7 [ 1384.588046][T15124] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 1384.588050][T15124] RSP: 002b:00007ffc181fe228 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 1384.588053][T15124] RAX: ffffffffffffffda RBX: 00007ffc181fe950 RCX: 00007f8369ed49a7 [ 1384.588055][T15124] RDX: 0000000000000000 RSI: 00007ffc181fe290 RDI: 0000000000000005 [ 1384.588057][T15124] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 1384.588058][T15124] R10: 000000003478b910 R11: 0000000000000246 R12: 0000000000000004 [ 1384.588060][T15124] R13: 0000000067b3578d R14: 0000000000498600 R15: 0000000000000000 [ 1384.588066][T15124] [ 1384.611243][T15124] lag2: Port device veth3 added [ 1384.803931][T15135] lag2: Port device veth5 added [ 1384.911001][T15137] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1384.969503][T15138] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1386.286647][T15165] lag1: Mode changed to "loadbalance" [ 1386.451870][T15168] lag1: Port device veth2 added [ 1386.663805][T15171] lag1: Port device veth4 added [ 1386.798741][T15173] 8021q: adding VLAN 0 to HW filter on device lag1 [ 1392.770485][T15199] lag2: Port device veth5 removed [ 1396.713539][T15209] lag2: Port device veth3 removed [ 1401.544369][T15239] lag2: Mode changed to "loadbalance" [ 1401.672841][T15242] lag2: Port device veth3 added [ 1401.889523][T15247] lag2: Port device veth5 added [ 1402.019349][T15249] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1402.092344][T15250] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1408.155920][T15284] lag2: Port device veth3 removed [ 1412.106007][T15294] lag2: Port device veth5 removed [ 1416.893187][T15324] lag2: Mode changed to "loadbalance" [ 1417.005027][T15327] lag2: Port device veth3 added [ 1417.207874][T15332] lag2: Port device veth5 added [ 1417.328336][T15334] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1417.392580][T15335] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1423.406188][T15165] lag1: Port device veth4 removed [ 1423.425590][T15165] lag1: Port device veth2 removed [ 1424.777030][T15324] lag2: Port device veth5 removed [ 1424.779390][T15324] lag2: Port device veth3 removed