[ 1392.937155][T28533] lag: Mode changed to "loadbalance" [ 1393.123438][T28537] [ 1393.123569][T28537] ====================================================== [ 1393.123779][T28537] WARNING: possible circular locking dependency detected [ 1393.123990][T28537] 6.14.0-rc2-virtme #1 Not tainted [ 1393.124156][T28537] ------------------------------------------------------ [ 1393.124369][T28537] ip/28537 is trying to acquire lock: [ 1393.124532][T28537] ffff88800af64cb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 1393.124788][T28537] [ 1393.124788][T28537] but task is already holding lock: [ 1393.125012][T28537] ffff88800bd8ad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1393.125283][T28537] [ 1393.125283][T28537] which lock already depends on the new lock. [ 1393.125283][T28537] [ 1393.125599][T28537] [ 1393.125599][T28537] the existing dependency chain (in reverse order) is: [ 1393.125874][T28537] [ 1393.125874][T28537] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 1393.126119][T28537] __lock_acquire+0xb9a/0x1680 [ 1393.126280][T28537] lock_acquire.part.0+0xeb/0x330 [ 1393.126440][T28537] __mutex_lock+0x169/0xc40 [ 1393.126590][T28537] team_set_mac_address+0x120/0x250 [ 1393.126737][T28537] netif_set_mac_address+0x28a/0x410 [ 1393.126938][T28537] do_setlink.constprop.0+0x1980/0x25f0 [ 1393.127142][T28537] rtnl_setlink+0x2b5/0x5a0 [ 1393.127300][T28537] rtnetlink_rcv_msg+0x712/0xc10 [ 1393.127469][T28537] netlink_rcv_skb+0x130/0x360 [ 1393.127634][T28537] netlink_unicast+0x44b/0x710 [ 1393.127781][T28537] netlink_sendmsg+0x723/0xbe0 [ 1393.127946][T28537] __sys_sendto+0x3c3/0x450 [ 1393.128105][T28537] __x64_sys_sendto+0xe0/0x1c0 [ 1393.128260][T28537] do_syscall_64+0xc1/0x1d0 [ 1393.128408][T28537] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1393.128616][T28537] [ 1393.128616][T28537] -> #0 (&dev->lock){+.+.}-{4:4}: [ 1393.128863][T28537] check_prev_add+0x182/0xce0 [ 1393.129042][T28537] validate_chain+0x7bd/0xae0 [ 1393.129199][T28537] __lock_acquire+0xb9a/0x1680 [ 1393.129354][T28537] lock_acquire.part.0+0xeb/0x330 [ 1393.129530][T28537] __mutex_lock+0x169/0xc40 [ 1393.129699][T28537] __dev_open+0x57e/0x710 [ 1393.129853][T28537] netif_open+0xc9/0x130 [ 1393.130004][T28537] dev_open+0x9f/0x1a0 [ 1393.130164][T28537] team_port_add+0x90a/0x1ce0 [ 1393.130321][T28537] team_add_slave+0x41/0x80 [ 1393.130486][T28537] do_set_master+0x302/0x610 [ 1393.130640][T28537] do_setlink.constprop.0+0x87b/0x25f0 [ 1393.130825][T28537] rtnl_newlink+0x69c/0xa70 [ 1393.130988][T28537] rtnetlink_rcv_msg+0x712/0xc10 [ 1393.131154][T28537] netlink_rcv_skb+0x130/0x360 [ 1393.131314][T28537] netlink_unicast+0x44b/0x710 [ 1393.131478][T28537] netlink_sendmsg+0x723/0xbe0 [ 1393.131625][T28537] ____sys_sendmsg+0x7ac/0xa10 [ 1393.131779][T28537] ___sys_sendmsg+0xee/0x170 [ 1393.131945][T28537] __sys_sendmsg+0x109/0x1a0 [ 1393.132114][T28537] do_syscall_64+0xc1/0x1d0 [ 1393.132267][T28537] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1393.132447][T28537] [ 1393.132447][T28537] other info that might help us debug this: [ 1393.132447][T28537] [ 1393.132763][T28537] Possible unsafe locking scenario: [ 1393.132763][T28537] [ 1393.132989][T28537] CPU0 CPU1 [ 1393.133142][T28537] ---- ---- [ 1393.133303][T28537] lock(team->team_lock_key); [ 1393.133455][T28537] lock(&dev->lock); [ 1393.133651][T28537] lock(team->team_lock_key); [ 1393.133891][T28537] lock(&dev->lock); [ 1393.134018][T28537] [ 1393.134018][T28537] *** DEADLOCK *** [ 1393.134018][T28537] [ 1393.134254][T28537] 2 locks held by ip/28537: [ 1393.134412][T28537] #0: ffffffffa13eeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 1393.134729][T28537] #1: ffff88800bd8ad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1393.135021][T28537] [ 1393.135021][T28537] stack backtrace: [ 1393.135233][T28537] CPU: 2 UID: 0 PID: 28537 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 1393.135239][T28537] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1393.135242][T28537] Call Trace: [ 1393.135244][T28537] [ 1393.135246][T28537] dump_stack_lvl+0x82/0xd0 [ 1393.135254][T28537] print_circular_bug+0x1b7/0x240 [ 1393.135260][T28537] check_noncircular+0x2f9/0x3e0 [ 1393.135264][T28537] ? __pfx_check_noncircular+0x10/0x10 [ 1393.135267][T28537] ? __pfx_validate_chain+0x10/0x10 [ 1393.135271][T28537] ? hlock_class+0x4e/0x130 [ 1393.135273][T28537] ? mark_lock+0x38/0x3e0 [ 1393.135278][T28537] ? alloc_chain_hlocks+0x4e0/0x720 [ 1393.135280][T28537] ? __lock_acquire+0xb9a/0x1680 [ 1393.135285][T28537] check_prev_add+0x182/0xce0 [ 1393.135289][T28537] validate_chain+0x7bd/0xae0 [ 1393.135294][T28537] ? hlock_class+0x4e/0x130 [ 1393.135296][T28537] ? __pfx_validate_chain+0x10/0x10 [ 1393.135299][T28537] ? hlock_class+0x4e/0x130 [ 1393.135301][T28537] ? mark_lock+0x38/0x3e0 [ 1393.135304][T28537] ? mark_held_locks+0x9e/0xe0 [ 1393.135308][T28537] __lock_acquire+0xb9a/0x1680 [ 1393.135314][T28537] lock_acquire.part.0+0xeb/0x330 [ 1393.135317][T28537] ? __dev_open+0x57e/0x710 [ 1393.135321][T28537] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1393.135324][T28537] ? trace_lock_acquire+0x14c/0x1f0 [ 1393.135328][T28537] ? lock_acquire+0x32/0xc0 [ 1393.135330][T28537] ? __dev_open+0x57e/0x710 [ 1393.135334][T28537] __mutex_lock+0x169/0xc40 [ 1393.135337][T28537] ? __dev_open+0x57e/0x710 [ 1393.135339][T28537] ? __lock_release+0x103/0x460 [ 1393.135342][T28537] ? __pfx___lock_release+0x10/0x10 [ 1393.135345][T28537] ? __dev_open+0x57e/0x710 [ 1393.135347][T28537] ? hlock_class+0x4e/0x130 [ 1393.135349][T28537] ? __pfx___mutex_lock+0x10/0x10 [ 1393.135355][T28537] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 1393.135361][T28537] ? __dev_open+0x57e/0x710 [ 1393.135364][T28537] __dev_open+0x57e/0x710 [ 1393.135366][T28537] ? mark_held_locks+0x9e/0xe0 [ 1393.135369][T28537] ? __pfx___dev_open+0x10/0x10 [ 1393.135371][T28537] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 1393.135378][T28537] netif_open+0xc9/0x130 [ 1393.135380][T28537] ? __pfx_netif_open+0x10/0x10 [ 1393.135384][T28537] dev_open+0x9f/0x1a0 [ 1393.135389][T28537] team_port_add+0x90a/0x1ce0 [ 1393.135394][T28537] ? __pfx_team_port_add+0x10/0x10 [ 1393.135398][T28537] ? rcu_read_lock_any_held+0x43/0xb0 [ 1393.135403][T28537] ? validate_chain+0x1fe/0xae0 [ 1393.135407][T28537] team_add_slave+0x41/0x80 [ 1393.135412][T28537] do_set_master+0x302/0x610 [ 1393.135416][T28537] do_setlink.constprop.0+0x87b/0x25f0 [ 1393.135421][T28537] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 1393.135425][T28537] ? lock_acquire.part.0+0xeb/0x330 [ 1393.135428][T28537] ? rtnl_newlink+0x653/0xa70 [ 1393.135431][T28537] ? rtnl_newlink+0xb9/0xa70 [ 1393.135434][T28537] ? rtnetlink_rcv_msg+0x712/0xc10 [ 1393.135439][T28537] ? __mutex_trylock_common+0xfa/0x260 [ 1393.135446][T28537] ? __pfx___mutex_trylock_common+0x10/0x10 [ 1393.135453][T28537] ? lock_acquire+0x32/0xc0 [ 1393.135458][T28537] ? trace_contention_end+0xef/0x150 [ 1393.135462][T28537] ? __mutex_lock+0x190/0xc40 [ 1393.135464][T28537] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1393.135468][T28537] ? rtnl_newlink+0x653/0xa70 [ 1393.135471][T28537] ? __pfx___mutex_lock+0x10/0x10 [ 1393.135473][T28537] ? __pfx_validate_nla+0x10/0x10 [ 1393.135479][T28537] ? trace_cap_capable+0x11e/0x1a0 [ 1393.135485][T28537] ? __rtnl_newlink+0x3f2/0xa80 [ 1393.135490][T28537] rtnl_newlink+0x69c/0xa70 [ 1393.135494][T28537] ? __pfx_rtnl_newlink+0x10/0x10 [ 1393.135497][T28537] ? find_held_lock+0x2c/0x110 [ 1393.135502][T28537] ? __pfx___lock_release+0x10/0x10 [ 1393.135505][T28537] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1393.135510][T28537] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 1393.135513][T28537] ? __pfx_rtnl_newlink+0x10/0x10 [ 1393.135516][T28537] rtnetlink_rcv_msg+0x712/0xc10 [ 1393.135520][T28537] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1393.135523][T28537] ? hlock_class+0x4e/0x130 [ 1393.135525][T28537] ? mark_lock+0x38/0x3e0 [ 1393.135529][T28537] ? __lock_acquire+0xb9a/0x1680 [ 1393.135533][T28537] netlink_rcv_skb+0x130/0x360 [ 1393.135537][T28537] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1393.135541][T28537] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 1393.135548][T28537] ? netlink_deliver_tap+0x13e/0x340 [ 1393.135552][T28537] ? netlink_deliver_tap+0xc3/0x340 [ 1393.135555][T28537] netlink_unicast+0x44b/0x710 [ 1393.135560][T28537] ? __pfx_netlink_unicast+0x10/0x10 [ 1393.135563][T28537] ? find_held_lock+0x2c/0x110 [ 1393.135568][T28537] netlink_sendmsg+0x723/0xbe0 [ 1393.135572][T28537] ? __pfx_netlink_sendmsg+0x10/0x10 [ 1393.135583][T28537] ____sys_sendmsg+0x7ac/0xa10 [ 1393.135591][T28537] ? __pfx_____sys_sendmsg+0x10/0x10 [ 1393.135595][T28537] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 1393.135603][T28537] ___sys_sendmsg+0xee/0x170 [ 1393.135607][T28537] ? __pfx____sys_sendmsg+0x10/0x10 [ 1393.135611][T28537] ? kasan_save_stack+0x34/0x50 [ 1393.135615][T28537] ? kasan_save_stack+0x24/0x50 [ 1393.135618][T28537] ? kasan_record_aux_stack+0x8c/0xa0 [ 1393.135621][T28537] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 1393.135625][T28537] ? __x64_sys_close+0x7c/0xd0 [ 1393.135628][T28537] ? do_syscall_64+0xc1/0x1d0 [ 1393.135630][T28537] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1393.135633][T28537] ? __lock_acquire+0xb9a/0x1680 [ 1393.135636][T28537] ? lock_downgrade+0x52/0x110 [ 1393.135641][T28537] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1393.135644][T28537] ? find_held_lock+0x2c/0x110 [ 1393.135649][T28537] ? __lock_release+0x103/0x460 [ 1393.135651][T28537] ? __virt_addr_valid+0x22b/0x430 [ 1393.135655][T28537] ? __pfx___lock_release+0x10/0x10 [ 1393.135658][T28537] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1393.135663][T28537] __sys_sendmsg+0x109/0x1a0 [ 1393.135666][T28537] ? __pfx___sys_sendmsg+0x10/0x10 [ 1393.135674][T28537] do_syscall_64+0xc1/0x1d0 [ 1393.135677][T28537] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1393.135680][T28537] RIP: 0033:0x7f3b7fb459a7 [ 1393.135685][T28537] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 1393.135688][T28537] RSP: 002b:00007ffe8be7eee8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 1393.135691][T28537] RAX: ffffffffffffffda RBX: 00007ffe8be7f610 RCX: 00007f3b7fb459a7 [ 1393.135693][T28537] RDX: 0000000000000000 RSI: 00007ffe8be7ef50 RDI: 0000000000000005 [ 1393.135695][T28537] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 1393.135697][T28537] R10: 00000000208ef910 R11: 0000000000000246 R12: 0000000000000004 [ 1393.135699][T28537] R13: 0000000067b302af R14: 0000000000498600 R15: 0000000000000000 [ 1393.135704][T28537] [ 1393.157521][T28537] lag: Port device veth2 added [ 1393.406395][T28547] lag: Port device veth4 added [ 1393.530247][T28549] 8021q: adding VLAN 0 to HW filter on device lag [ 1393.600021][T28550] br1: port 1(lag) entered blocking state [ 1393.600251][T28550] br1: port 1(lag) entered disabled state [ 1393.600463][T28550] lag: entered allmulticast mode [ 1393.600621][T28550] veth2: entered allmulticast mode [ 1393.600789][T28550] veth4: entered allmulticast mode [ 1393.602536][T28550] veth2: entered promiscuous mode [ 1393.602774][T28550] veth4: entered promiscuous mode [ 1393.680702][T28551] br1: port 1(lag) entered blocking state [ 1393.681008][T28551] br1: port 1(lag) entered forwarding state [ 1414.608265][T21936] br1: port 1(lag) entered disabled state [ 1414.612572][T15668] kworker/1:2 (15668) used greatest stack depth: 23328 bytes left [ 1420.365200][T14456] br1: port 1(lag) entered blocking state [ 1420.365387][T14456] br1: port 1(lag) entered forwarding state [ 1435.082737][T21936] br1: port 1(lag) entered disabled state [ 1440.881436][T14452] br1: port 1(lag) entered blocking state [ 1440.881695][T14452] br1: port 1(lag) entered forwarding state [ 1441.415255][T28688] lag: left allmulticast mode [ 1441.415488][T28688] veth2: left allmulticast mode [ 1441.415686][T28688] veth4: left allmulticast mode [ 1441.415860][T28688] veth2: left promiscuous mode [ 1441.416046][T28688] veth4: left promiscuous mode [ 1441.416206][T28688] br1: port 1(lag) entered disabled state [ 1441.481012][T28533] lag: Port device veth4 removed [ 1441.484006][T28533] lag: Port device veth2 removed