[ 1168.814543][ T8521] lag2: Mode changed to "loadbalance" [ 1168.998277][ T8524] [ 1168.998397][ T8524] ====================================================== [ 1168.998593][ T8524] WARNING: possible circular locking dependency detected [ 1168.998787][ T8524] 6.14.0-rc2-virtme #1 Not tainted [ 1168.998943][ T8524] ------------------------------------------------------ [ 1168.999126][ T8524] ip/8524 is trying to acquire lock: [ 1168.999277][ T8524] ffff8880088b1cb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 1168.999511][ T8524] [ 1168.999511][ T8524] but task is already holding lock: [ 1168.999736][ T8524] ffff88800f0aad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1169.000008][ T8524] [ 1169.000008][ T8524] which lock already depends on the new lock. [ 1169.000008][ T8524] [ 1169.000307][ T8524] [ 1169.000307][ T8524] the existing dependency chain (in reverse order) is: [ 1169.000555][ T8524] [ 1169.000555][ T8524] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 1169.000776][ T8524] __lock_acquire+0xb9a/0x1680 [ 1169.000943][ T8524] lock_acquire.part.0+0xeb/0x330 [ 1169.001127][ T8524] __mutex_lock+0x169/0xc40 [ 1169.001274][ T8524] team_set_mac_address+0x120/0x250 [ 1169.001429][ T8524] netif_set_mac_address+0x28a/0x410 [ 1169.001612][ T8524] do_setlink.constprop.0+0x1980/0x25f0 [ 1169.001796][ T8524] rtnl_setlink+0x2b5/0x5a0 [ 1169.001950][ T8524] rtnetlink_rcv_msg+0x712/0xc10 [ 1169.002097][ T8524] netlink_rcv_skb+0x130/0x360 [ 1169.002245][ T8524] netlink_unicast+0x44b/0x710 [ 1169.002392][ T8524] netlink_sendmsg+0x723/0xbe0 [ 1169.002543][ T8524] __sys_sendto+0x3c3/0x450 [ 1169.002695][ T8524] __x64_sys_sendto+0xe0/0x1c0 [ 1169.002841][ T8524] do_syscall_64+0xc1/0x1d0 [ 1169.002993][ T8524] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1169.003176][ T8524] [ 1169.003176][ T8524] -> #0 (&dev->lock){+.+.}-{4:4}: [ 1169.003398][ T8524] check_prev_add+0x182/0xce0 [ 1169.003548][ T8524] validate_chain+0x7bd/0xae0 [ 1169.003694][ T8524] __lock_acquire+0xb9a/0x1680 [ 1169.003847][ T8524] lock_acquire.part.0+0xeb/0x330 [ 1169.003995][ T8524] __mutex_lock+0x169/0xc40 [ 1169.004141][ T8524] __dev_open+0x57e/0x710 [ 1169.004288][ T8524] netif_open+0xc9/0x130 [ 1169.004435][ T8524] dev_open+0x9f/0x1a0 [ 1169.004585][ T8524] team_port_add+0x90a/0x1ce0 [ 1169.004732][ T8524] team_add_slave+0x41/0x80 [ 1169.004884][ T8524] do_set_master+0x302/0x610 [ 1169.005032][ T8524] do_setlink.constprop.0+0x87b/0x25f0 [ 1169.005214][ T8524] rtnl_newlink+0x69c/0xa70 [ 1169.005364][ T8524] rtnetlink_rcv_msg+0x712/0xc10 [ 1169.005514][ T8524] netlink_rcv_skb+0x130/0x360 [ 1169.005660][ T8524] netlink_unicast+0x44b/0x710 [ 1169.005805][ T8524] netlink_sendmsg+0x723/0xbe0 [ 1169.005958][ T8524] ____sys_sendmsg+0x7ac/0xa10 [ 1169.006108][ T8524] ___sys_sendmsg+0xee/0x170 [ 1169.006254][ T8524] __sys_sendmsg+0x109/0x1a0 [ 1169.006405][ T8524] do_syscall_64+0xc1/0x1d0 [ 1169.006550][ T8524] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1169.006731][ T8524] [ 1169.006731][ T8524] other info that might help us debug this: [ 1169.006731][ T8524] [ 1169.007020][ T8524] Possible unsafe locking scenario: [ 1169.007020][ T8524] [ 1169.007239][ T8524] CPU0 CPU1 [ 1169.007385][ T8524] ---- ---- [ 1169.007531][ T8524] lock(team->team_lock_key); [ 1169.007685][ T8524] lock(&dev->lock); [ 1169.007869][ T8524] lock(team->team_lock_key); [ 1169.008092][ T8524] lock(&dev->lock); [ 1169.008205][ T8524] [ 1169.008205][ T8524] *** DEADLOCK *** [ 1169.008205][ T8524] [ 1169.008420][ T8524] 2 locks held by ip/8524: [ 1169.008569][ T8524] #0: ffffffff9f9eeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 1169.008834][ T8524] #1: ffff88800f0aad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1169.009146][ T8524] [ 1169.009146][ T8524] stack backtrace: [ 1169.009328][ T8524] CPU: 0 UID: 0 PID: 8524 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 1169.009332][ T8524] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1169.009334][ T8524] Call Trace: [ 1169.009336][ T8524] [ 1169.009338][ T8524] dump_stack_lvl+0x82/0xd0 [ 1169.009344][ T8524] print_circular_bug+0x1b7/0x240 [ 1169.009349][ T8524] check_noncircular+0x2f9/0x3e0 [ 1169.009353][ T8524] ? __pfx_check_noncircular+0x10/0x10 [ 1169.009356][ T8524] ? find_held_lock+0x2c/0x110 [ 1169.009363][ T8524] ? alloc_chain_hlocks+0x4e0/0x720 [ 1169.009366][ T8524] check_prev_add+0x182/0xce0 [ 1169.009371][ T8524] validate_chain+0x7bd/0xae0 [ 1169.009375][ T8524] ? stack_depot_save_flags+0x27e/0x440 [ 1169.009381][ T8524] ? __pfx_validate_chain+0x10/0x10 [ 1169.009384][ T8524] ? hlock_class+0x4e/0x130 [ 1169.009387][ T8524] ? mark_lock+0x38/0x3e0 [ 1169.009391][ T8524] __lock_acquire+0xb9a/0x1680 [ 1169.009397][ T8524] lock_acquire.part.0+0xeb/0x330 [ 1169.009400][ T8524] ? __dev_open+0x57e/0x710 [ 1169.009403][ T8524] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1169.009407][ T8524] ? trace_lock_acquire+0x14c/0x1f0 [ 1169.009410][ T8524] ? lock_acquire+0x32/0xc0 [ 1169.009413][ T8524] ? __dev_open+0x57e/0x710 [ 1169.009416][ T8524] __mutex_lock+0x169/0xc40 [ 1169.009418][ T8524] ? __dev_open+0x57e/0x710 [ 1169.009421][ T8524] ? __dev_open+0x57e/0x710 [ 1169.009424][ T8524] ? __pfx___mutex_lock+0x10/0x10 [ 1169.009428][ T8524] ? mutex_is_locked+0x1c/0x60 [ 1169.009431][ T8524] ? rtnl_is_locked+0x15/0x20 [ 1169.009438][ T8524] ? mirred_device_event+0x3d/0x1e0 [act_mirred] [ 1169.009447][ T8524] ? __dev_open+0x57e/0x710 [ 1169.009449][ T8524] __dev_open+0x57e/0x710 [ 1169.009452][ T8524] ? mark_held_locks+0x9e/0xe0 [ 1169.009455][ T8524] ? __pfx___dev_open+0x10/0x10 [ 1169.009457][ T8524] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 1169.009463][ T8524] netif_open+0xc9/0x130 [ 1169.009466][ T8524] ? __pfx_netif_open+0x10/0x10 [ 1169.009470][ T8524] dev_open+0x9f/0x1a0 [ 1169.009474][ T8524] team_port_add+0x90a/0x1ce0 [ 1169.009479][ T8524] ? __pfx_team_port_add+0x10/0x10 [ 1169.009482][ T8524] ? rcu_read_lock_any_held+0x43/0xb0 [ 1169.009488][ T8524] ? validate_chain+0x1fe/0xae0 [ 1169.009492][ T8524] team_add_slave+0x41/0x80 [ 1169.009496][ T8524] do_set_master+0x302/0x610 [ 1169.009501][ T8524] do_setlink.constprop.0+0x87b/0x25f0 [ 1169.009505][ T8524] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 1169.009509][ T8524] ? lock_acquire.part.0+0xeb/0x330 [ 1169.009512][ T8524] ? rtnl_newlink+0x653/0xa70 [ 1169.009515][ T8524] ? rtnl_newlink+0xb9/0xa70 [ 1169.009518][ T8524] ? rtnetlink_rcv_msg+0x712/0xc10 [ 1169.009521][ T8524] ? __mutex_trylock_common+0xfa/0x260 [ 1169.009525][ T8524] ? __pfx___mutex_trylock_common+0x10/0x10 [ 1169.009528][ T8524] ? lock_acquire+0x32/0xc0 [ 1169.009532][ T8524] ? trace_contention_end+0xef/0x150 [ 1169.009535][ T8524] ? __mutex_lock+0x190/0xc40 [ 1169.009538][ T8524] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1169.009542][ T8524] ? rtnl_newlink+0x653/0xa70 [ 1169.009545][ T8524] ? __pfx___mutex_lock+0x10/0x10 [ 1169.009547][ T8524] ? __pfx_validate_nla+0x10/0x10 [ 1169.009552][ T8524] ? trace_cap_capable+0x11e/0x1a0 [ 1169.009558][ T8524] ? __rtnl_newlink+0x3f2/0xa80 [ 1169.009563][ T8524] rtnl_newlink+0x69c/0xa70 [ 1169.009567][ T8524] ? __pfx_rtnl_newlink+0x10/0x10 [ 1169.009570][ T8524] ? find_held_lock+0x2c/0x110 [ 1169.009574][ T8524] ? __pfx___lock_release+0x10/0x10 [ 1169.009577][ T8524] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1169.009582][ T8524] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 1169.009586][ T8524] ? __pfx_rtnl_newlink+0x10/0x10 [ 1169.009588][ T8524] rtnetlink_rcv_msg+0x712/0xc10 [ 1169.009592][ T8524] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1169.009595][ T8524] ? hlock_class+0x4e/0x130 [ 1169.009597][ T8524] ? mark_lock+0x38/0x3e0 [ 1169.009601][ T8524] ? __lock_acquire+0xb9a/0x1680 [ 1169.009605][ T8524] netlink_rcv_skb+0x130/0x360 [ 1169.009609][ T8524] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1169.009612][ T8524] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 1169.009620][ T8524] ? netlink_deliver_tap+0x13e/0x340 [ 1169.009623][ T8524] ? netlink_deliver_tap+0xc3/0x340 [ 1169.009627][ T8524] netlink_unicast+0x44b/0x710 [ 1169.009631][ T8524] ? __pfx_netlink_unicast+0x10/0x10 [ 1169.009635][ T8524] ? find_held_lock+0x2c/0x110 [ 1169.009640][ T8524] netlink_sendmsg+0x723/0xbe0 [ 1169.009644][ T8524] ? __pfx_netlink_sendmsg+0x10/0x10 [ 1169.009650][ T8524] ____sys_sendmsg+0x7ac/0xa10 [ 1169.009654][ T8524] ? __pfx_____sys_sendmsg+0x10/0x10 [ 1169.009656][ T8524] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 1169.009663][ T8524] ___sys_sendmsg+0xee/0x170 [ 1169.009667][ T8524] ? __pfx____sys_sendmsg+0x10/0x10 [ 1169.009671][ T8524] ? kasan_save_stack+0x34/0x50 [ 1169.009676][ T8524] ? kasan_save_stack+0x24/0x50 [ 1169.009678][ T8524] ? kasan_record_aux_stack+0x8c/0xa0 [ 1169.009682][ T8524] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 1169.009685][ T8524] ? __x64_sys_close+0x7c/0xd0 [ 1169.009689][ T8524] ? do_syscall_64+0xc1/0x1d0 [ 1169.009691][ T8524] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1169.009694][ T8524] ? __lock_acquire+0xb9a/0x1680 [ 1169.009697][ T8524] ? lock_downgrade+0x52/0x110 [ 1169.009701][ T8524] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1169.009704][ T8524] ? find_held_lock+0x2c/0x110 [ 1169.009709][ T8524] ? __lock_release+0x103/0x460 [ 1169.009711][ T8524] ? __virt_addr_valid+0x22b/0x430 [ 1169.009716][ T8524] ? __pfx___lock_release+0x10/0x10 [ 1169.009718][ T8524] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1169.009723][ T8524] __sys_sendmsg+0x109/0x1a0 [ 1169.009726][ T8524] ? __pfx___sys_sendmsg+0x10/0x10 [ 1169.009734][ T8524] do_syscall_64+0xc1/0x1d0 [ 1169.009737][ T8524] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1169.009740][ T8524] RIP: 0033:0x7f55b98009a7 [ 1169.009744][ T8524] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 1169.009746][ T8524] RSP: 002b:00007ffc3348dde8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 1169.009750][ T8524] RAX: ffffffffffffffda RBX: 00007ffc3348e510 RCX: 00007f55b98009a7 [ 1169.009752][ T8524] RDX: 0000000000000000 RSI: 00007ffc3348de50 RDI: 0000000000000005 [ 1169.009754][ T8524] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 1169.009755][ T8524] R10: 000000001b22c910 R11: 0000000000000246 R12: 0000000000000004 [ 1169.009757][ T8524] R13: 0000000067b2d7e7 R14: 0000000000498600 R15: 0000000000000000 [ 1169.009762][ T8524] [ 1169.030528][ T8524] lag2: Port device veth3 added [ 1169.245106][ T8535] lag2: Port device veth5 added [ 1169.359969][ T8537] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1169.419250][ T8538] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1170.753513][ T8565] lag1: Mode changed to "loadbalance" [ 1170.879733][ T8568] lag1: Port device veth2 added [ 1171.119624][ T8571] lag1: Port device veth4 added [ 1171.254498][ T8573] 8021q: adding VLAN 0 to HW filter on device lag1 [ 1177.256442][ T8599] lag2: Port device veth5 removed [ 1181.220869][ T8609] lag2: Port device veth3 removed [ 1186.106788][ T8639] lag2: Mode changed to "loadbalance" [ 1186.238034][ T8642] lag2: Port device veth3 added [ 1186.455315][ T8647] lag2: Port device veth5 added [ 1186.590944][ T8649] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1186.657663][ T8650] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1192.783162][ T8684] lag2: Port device veth3 removed [ 1196.749993][ T8694] lag2: Port device veth5 removed [ 1201.670562][ T8724] lag2: Mode changed to "loadbalance" [ 1201.809860][ T8727] lag2: Port device veth3 added [ 1202.032560][ T8732] lag2: Port device veth5 added [ 1202.171604][ T8734] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1202.267638][ T8735] 8021q: adding VLAN 0 to HW filter on device lag2 [ 1208.367934][ T8565] lag1: Port device veth4 removed [ 1208.375462][ T8565] lag1: Port device veth2 removed [ 1209.909493][ T8724] lag2: Port device veth5 removed [ 1209.912123][ T8724] lag2: Port device veth3 removed