[ 1378.028781][T18526] lag: Mode changed to "loadbalance" [ 1378.212336][T18529] [ 1378.212561][T18529] ====================================================== [ 1378.212753][T18529] WARNING: possible circular locking dependency detected [ 1378.212946][T18529] 6.14.0-rc2-virtme #1 Not tainted [ 1378.213101][T18529] ------------------------------------------------------ [ 1378.213297][T18529] ip/18529 is trying to acquire lock: [ 1378.213445][T18529] ffff88800bccccb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 1378.213685][T18529] [ 1378.213685][T18529] but task is already holding lock: [ 1378.213905][T18529] ffff8880103cad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1378.214177][T18529] [ 1378.214177][T18529] which lock already depends on the new lock. [ 1378.214177][T18529] [ 1378.214472][T18529] [ 1378.214472][T18529] the existing dependency chain (in reverse order) is: [ 1378.214725][T18529] [ 1378.214725][T18529] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 1378.214944][T18529] __lock_acquire+0xb9a/0x1680 [ 1378.215096][T18529] lock_acquire.part.0+0xeb/0x330 [ 1378.215243][T18529] __mutex_lock+0x169/0xc40 [ 1378.215402][T18529] team_set_mac_address+0x120/0x250 [ 1378.215554][T18529] netif_set_mac_address+0x28a/0x410 [ 1378.215735][T18529] do_setlink.constprop.0+0x1980/0x25f0 [ 1378.215919][T18529] rtnl_setlink+0x2b5/0x5a0 [ 1378.216065][T18529] rtnetlink_rcv_msg+0x712/0xc10 [ 1378.216211][T18529] netlink_rcv_skb+0x130/0x360 [ 1378.216366][T18529] netlink_unicast+0x44b/0x710 [ 1378.216512][T18529] netlink_sendmsg+0x723/0xbe0 [ 1378.216662][T18529] __sys_sendto+0x3c3/0x450 [ 1378.216808][T18529] __x64_sys_sendto+0xe0/0x1c0 [ 1378.216954][T18529] do_syscall_64+0xc1/0x1d0 [ 1378.217102][T18529] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1378.217296][T18529] [ 1378.217296][T18529] -> #0 (&dev->lock){+.+.}-{4:4}: [ 1378.217521][T18529] check_prev_add+0x182/0xce0 [ 1378.217674][T18529] validate_chain+0x7bd/0xae0 [ 1378.217821][T18529] __lock_acquire+0xb9a/0x1680 [ 1378.217971][T18529] lock_acquire.part.0+0xeb/0x330 [ 1378.218122][T18529] __mutex_lock+0x169/0xc40 [ 1378.218281][T18529] __dev_open+0x57e/0x710 [ 1378.218433][T18529] netif_open+0xc9/0x130 [ 1378.218586][T18529] dev_open+0x9f/0x1a0 [ 1378.218740][T18529] team_port_add+0x90a/0x1ce0 [ 1378.218897][T18529] team_add_slave+0x41/0x80 [ 1378.219049][T18529] do_set_master+0x302/0x610 [ 1378.219197][T18529] do_setlink.constprop.0+0x87b/0x25f0 [ 1378.219389][T18529] rtnl_newlink+0x69c/0xa70 [ 1378.219541][T18529] rtnetlink_rcv_msg+0x712/0xc10 [ 1378.219690][T18529] netlink_rcv_skb+0x130/0x360 [ 1378.219845][T18529] netlink_unicast+0x44b/0x710 [ 1378.219995][T18529] netlink_sendmsg+0x723/0xbe0 [ 1378.220146][T18529] ____sys_sendmsg+0x7ac/0xa10 [ 1378.220304][T18529] ___sys_sendmsg+0xee/0x170 [ 1378.220452][T18529] __sys_sendmsg+0x109/0x1a0 [ 1378.220600][T18529] do_syscall_64+0xc1/0x1d0 [ 1378.220750][T18529] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1378.220937][T18529] [ 1378.220937][T18529] other info that might help us debug this: [ 1378.220937][T18529] [ 1378.221224][T18529] Possible unsafe locking scenario: [ 1378.221224][T18529] [ 1378.221449][T18529] CPU0 CPU1 [ 1378.221595][T18529] ---- ---- [ 1378.221741][T18529] lock(team->team_lock_key); [ 1378.221897][T18529] lock(&dev->lock); [ 1378.222079][T18529] lock(team->team_lock_key); [ 1378.222305][T18529] lock(&dev->lock); [ 1378.222420][T18529] [ 1378.222420][T18529] *** DEADLOCK *** [ 1378.222420][T18529] [ 1378.222637][T18529] 2 locks held by ip/18529: [ 1378.222783][T18529] #0: ffffffff997eeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 1378.223050][T18529] #1: ffff8880103cad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1378.223337][T18529] [ 1378.223337][T18529] stack backtrace: [ 1378.223520][T18529] CPU: 2 UID: 0 PID: 18529 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 1378.223525][T18529] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1378.223527][T18529] Call Trace: [ 1378.223529][T18529] [ 1378.223531][T18529] dump_stack_lvl+0x82/0xd0 [ 1378.223538][T18529] print_circular_bug+0x1b7/0x240 [ 1378.223544][T18529] check_noncircular+0x2f9/0x3e0 [ 1378.223547][T18529] ? find_held_lock+0x2c/0x110 [ 1378.223551][T18529] ? __pfx_check_noncircular+0x10/0x10 [ 1378.223555][T18529] ? stack_depot_save_flags+0x27e/0x440 [ 1378.223560][T18529] ? __pfx___lock_release+0x10/0x10 [ 1378.223565][T18529] ? alloc_chain_hlocks+0x4e0/0x720 [ 1378.223569][T18529] check_prev_add+0x182/0xce0 [ 1378.223572][T18529] ? validate_chain+0x1fe/0xae0 [ 1378.223576][T18529] validate_chain+0x7bd/0xae0 [ 1378.223580][T18529] ? mark_lock+0x38/0x3e0 [ 1378.223583][T18529] ? __pfx_validate_chain+0x10/0x10 [ 1378.223586][T18529] ? hlock_class+0x4e/0x130 [ 1378.223588][T18529] ? mark_lock+0x38/0x3e0 [ 1378.223592][T18529] __lock_acquire+0xb9a/0x1680 [ 1378.223598][T18529] lock_acquire.part.0+0xeb/0x330 [ 1378.223601][T18529] ? __dev_open+0x57e/0x710 [ 1378.223604][T18529] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1378.223608][T18529] ? trace_lock_acquire+0x14c/0x1f0 [ 1378.223611][T18529] ? lock_acquire+0x32/0xc0 [ 1378.223613][T18529] ? __dev_open+0x57e/0x710 [ 1378.223616][T18529] __mutex_lock+0x169/0xc40 [ 1378.223619][T18529] ? __dev_open+0x57e/0x710 [ 1378.223621][T18529] ? __lock_release+0x103/0x460 [ 1378.223624][T18529] ? __pfx___lock_release+0x10/0x10 [ 1378.223627][T18529] ? __dev_open+0x57e/0x710 [ 1378.223629][T18529] ? hlock_class+0x4e/0x130 [ 1378.223631][T18529] ? __pfx___mutex_lock+0x10/0x10 [ 1378.223636][T18529] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 1378.223642][T18529] ? __dev_open+0x57e/0x710 [ 1378.223644][T18529] __dev_open+0x57e/0x710 [ 1378.223646][T18529] ? mark_held_locks+0x9e/0xe0 [ 1378.223649][T18529] ? __pfx___dev_open+0x10/0x10 [ 1378.223652][T18529] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 1378.223658][T18529] netif_open+0xc9/0x130 [ 1378.223660][T18529] ? __pfx_netif_open+0x10/0x10 [ 1378.223664][T18529] dev_open+0x9f/0x1a0 [ 1378.223669][T18529] team_port_add+0x90a/0x1ce0 [ 1378.223674][T18529] ? __pfx_team_port_add+0x10/0x10 [ 1378.223677][T18529] ? rcu_read_lock_any_held+0x43/0xb0 [ 1378.223682][T18529] ? validate_chain+0x1fe/0xae0 [ 1378.223686][T18529] team_add_slave+0x41/0x80 [ 1378.223690][T18529] do_set_master+0x302/0x610 [ 1378.223694][T18529] do_setlink.constprop.0+0x87b/0x25f0 [ 1378.223699][T18529] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 1378.223702][T18529] ? lock_acquire.part.0+0xeb/0x330 [ 1378.223705][T18529] ? rtnl_newlink+0x653/0xa70 [ 1378.223708][T18529] ? rtnl_newlink+0xb9/0xa70 [ 1378.223710][T18529] ? rtnetlink_rcv_msg+0x712/0xc10 [ 1378.223713][T18529] ? __mutex_trylock_common+0xfa/0x260 [ 1378.223717][T18529] ? __pfx___mutex_trylock_common+0x10/0x10 [ 1378.223721][T18529] ? lock_acquire+0x32/0xc0 [ 1378.223724][T18529] ? trace_contention_end+0xef/0x150 [ 1378.223727][T18529] ? __mutex_lock+0x190/0xc40 [ 1378.223730][T18529] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1378.223734][T18529] ? rtnl_newlink+0x653/0xa70 [ 1378.223737][T18529] ? __pfx___mutex_lock+0x10/0x10 [ 1378.223739][T18529] ? __pfx_validate_nla+0x10/0x10 [ 1378.223743][T18529] ? trace_cap_capable+0x11e/0x1a0 [ 1378.223749][T18529] ? __rtnl_newlink+0x3f2/0xa80 [ 1378.223754][T18529] rtnl_newlink+0x69c/0xa70 [ 1378.223758][T18529] ? __pfx_rtnl_newlink+0x10/0x10 [ 1378.223760][T18529] ? find_held_lock+0x2c/0x110 [ 1378.223765][T18529] ? __pfx___lock_release+0x10/0x10 [ 1378.223768][T18529] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1378.223773][T18529] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 1378.223776][T18529] ? __pfx_rtnl_newlink+0x10/0x10 [ 1378.223779][T18529] rtnetlink_rcv_msg+0x712/0xc10 [ 1378.223782][T18529] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1378.223785][T18529] ? hlock_class+0x4e/0x130 [ 1378.223787][T18529] ? mark_lock+0x38/0x3e0 [ 1378.223791][T18529] ? __lock_acquire+0xb9a/0x1680 [ 1378.223795][T18529] netlink_rcv_skb+0x130/0x360 [ 1378.223799][T18529] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1378.223803][T18529] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 1378.223810][T18529] ? netlink_deliver_tap+0x13e/0x340 [ 1378.223813][T18529] ? netlink_deliver_tap+0xc3/0x340 [ 1378.223817][T18529] netlink_unicast+0x44b/0x710 [ 1378.223821][T18529] ? __pfx_netlink_unicast+0x10/0x10 [ 1378.223824][T18529] ? find_held_lock+0x2c/0x110 [ 1378.223829][T18529] netlink_sendmsg+0x723/0xbe0 [ 1378.223834][T18529] ? __pfx_netlink_sendmsg+0x10/0x10 [ 1378.223840][T18529] ____sys_sendmsg+0x7ac/0xa10 [ 1378.223844][T18529] ? __pfx_____sys_sendmsg+0x10/0x10 [ 1378.223846][T18529] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 1378.223853][T18529] ___sys_sendmsg+0xee/0x170 [ 1378.223857][T18529] ? __pfx____sys_sendmsg+0x10/0x10 [ 1378.223861][T18529] ? kasan_save_stack+0x34/0x50 [ 1378.223865][T18529] ? kasan_save_stack+0x24/0x50 [ 1378.223867][T18529] ? kasan_record_aux_stack+0x8c/0xa0 [ 1378.223871][T18529] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 1378.223875][T18529] ? __x64_sys_close+0x7c/0xd0 [ 1378.223879][T18529] ? do_syscall_64+0xc1/0x1d0 [ 1378.223881][T18529] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1378.223885][T18529] ? __lock_acquire+0xb9a/0x1680 [ 1378.223888][T18529] ? lock_downgrade+0x52/0x110 [ 1378.223892][T18529] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1378.223895][T18529] ? find_held_lock+0x2c/0x110 [ 1378.223899][T18529] ? __lock_release+0x103/0x460 [ 1378.223902][T18529] ? __virt_addr_valid+0x22b/0x430 [ 1378.223906][T18529] ? __pfx___lock_release+0x10/0x10 [ 1378.223908][T18529] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1378.223913][T18529] __sys_sendmsg+0x109/0x1a0 [ 1378.223916][T18529] ? __pfx___sys_sendmsg+0x10/0x10 [ 1378.223924][T18529] do_syscall_64+0xc1/0x1d0 [ 1378.223927][T18529] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1378.223929][T18529] RIP: 0033:0x7ff39f7899a7 [ 1378.223933][T18529] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 1378.223936][T18529] RSP: 002b:00007ffff11c5f38 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 1378.223940][T18529] RAX: ffffffffffffffda RBX: 00007ffff11c6660 RCX: 00007ff39f7899a7 [ 1378.223942][T18529] RDX: 0000000000000000 RSI: 00007ffff11c5fa0 RDI: 0000000000000005 [ 1378.223943][T18529] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 1378.223945][T18529] R10: 0000000033830910 R11: 0000000000000246 R12: 0000000000000004 [ 1378.223946][T18529] R13: 0000000067b32d36 R14: 0000000000498600 R15: 0000000000000000 [ 1378.223952][T18529] [ 1378.249974][T18529] lag: Port device veth2 added [ 1378.262483][T18529] ip (18529) used greatest stack depth: 23544 bytes left [ 1378.454721][T18539] lag: Port device veth4 added [ 1378.575970][T18541] 8021q: adding VLAN 0 to HW filter on device lag [ 1378.628390][T18542] br1: port 1(lag) entered blocking state [ 1378.628602][T18542] br1: port 1(lag) entered disabled state [ 1378.628782][T18542] lag: entered allmulticast mode [ 1378.628928][T18542] veth2: entered allmulticast mode [ 1378.629073][T18542] veth4: entered allmulticast mode [ 1378.631671][T18542] veth2: entered promiscuous mode [ 1378.631857][T18542] veth4: entered promiscuous mode [ 1378.690481][T18543] br1: port 1(lag) entered blocking state [ 1378.690819][T18543] br1: port 1(lag) entered forwarding state [ 1399.301218][ T37] br1: port 1(lag) entered disabled state [ 1405.031561][ T40] br1: port 1(lag) entered blocking state [ 1405.031792][ T40] br1: port 1(lag) entered forwarding state [ 1419.766685][T17404] br1: port 1(lag) entered disabled state [ 1425.493408][T18614] br1: port 1(lag) entered blocking state [ 1425.493756][T18614] br1: port 1(lag) entered forwarding state [ 1426.067544][T18680] lag: left allmulticast mode [ 1426.067768][T18680] veth2: left allmulticast mode [ 1426.067929][T18680] veth4: left allmulticast mode [ 1426.068102][T18680] veth2: left promiscuous mode [ 1426.068292][T18680] veth4: left promiscuous mode [ 1426.068760][T18680] br1: port 1(lag) entered disabled state [ 1426.134100][T18526] lag: Port device veth4 removed [ 1426.137157][T18526] lag: Port device veth2 removed