[ 378.122989][ T3279] lag1: Mode changed to "loadbalance" [ 378.226910][ T3281] 8021q: adding VLAN 0 to HW filter on device lag1 [ 378.660549][ T3289] [ 378.660687][ T3289] ====================================================== [ 378.660893][ T3289] WARNING: possible circular locking dependency detected [ 378.661093][ T3289] 6.14.0-rc2-virtme #1 Not tainted [ 378.661254][ T3289] ------------------------------------------------------ [ 378.661460][ T3289] ip/3289 is trying to acquire lock: [ 378.661629][ T3289] ffff8880086f9cb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 378.661898][ T3289] [ 378.661898][ T3289] but task is already holding lock: [ 378.662154][ T3289] ffff88800ba0ad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 378.662454][ T3289] [ 378.662454][ T3289] which lock already depends on the new lock. [ 378.662454][ T3289] [ 378.662773][ T3289] [ 378.662773][ T3289] the existing dependency chain (in reverse order) is: [ 378.663057][ T3289] [ 378.663057][ T3289] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 378.663299][ T3289] __lock_acquire+0xb9a/0x1680 [ 378.663469][ T3289] lock_acquire.part.0+0xeb/0x330 [ 378.663638][ T3289] __mutex_lock+0x169/0xc40 [ 378.663805][ T3289] team_set_mac_address+0x120/0x250 [ 378.663969][ T3289] netif_set_mac_address+0x28a/0x410 [ 378.664177][ T3289] do_setlink.constprop.0+0x1980/0x25f0 [ 378.664380][ T3289] rtnl_setlink+0x2b5/0x5a0 [ 378.664548][ T3289] rtnetlink_rcv_msg+0x712/0xc10 [ 378.664711][ T3289] netlink_rcv_skb+0x130/0x360 [ 378.664877][ T3289] netlink_unicast+0x44b/0x710 [ 378.665044][ T3289] netlink_sendmsg+0x723/0xbe0 [ 378.665212][ T3289] __sys_sendto+0x3c3/0x450 [ 378.665377][ T3289] __x64_sys_sendto+0xe0/0x1c0 [ 378.665550][ T3289] do_syscall_64+0xc1/0x1d0 [ 378.665712][ T3289] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 378.665913][ T3289] [ 378.665913][ T3289] -> #0 (&dev->lock){+.+.}-{4:4}: [ 378.666160][ T3289] check_prev_add+0x182/0xce0 [ 378.666337][ T3289] validate_chain+0x7bd/0xae0 [ 378.666507][ T3289] __lock_acquire+0xb9a/0x1680 [ 378.666675][ T3289] lock_acquire.part.0+0xeb/0x330 [ 378.666834][ T3289] __mutex_lock+0x169/0xc40 [ 378.666993][ T3289] __dev_open+0x57e/0x710 [ 378.667153][ T3289] netif_open+0xc9/0x130 [ 378.667311][ T3289] dev_open+0x9f/0x1a0 [ 378.667474][ T3289] team_port_add+0x90a/0x1ce0 [ 378.667636][ T3289] team_add_slave+0x41/0x80 [ 378.667799][ T3289] do_set_master+0x302/0x610 [ 378.667959][ T3289] do_setlink.constprop.0+0x87b/0x25f0 [ 378.668158][ T3289] rtnl_newlink+0x69c/0xa70 [ 378.668319][ T3289] rtnetlink_rcv_msg+0x712/0xc10 [ 378.668478][ T3289] netlink_rcv_skb+0x130/0x360 [ 378.668638][ T3289] netlink_unicast+0x44b/0x710 [ 378.668800][ T3289] netlink_sendmsg+0x723/0xbe0 [ 378.668968][ T3289] ____sys_sendmsg+0x7ac/0xa10 [ 378.669130][ T3289] ___sys_sendmsg+0xee/0x170 [ 378.669292][ T3289] __sys_sendmsg+0x109/0x1a0 [ 378.669454][ T3289] do_syscall_64+0xc1/0x1d0 [ 378.669614][ T3289] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 378.669817][ T3289] [ 378.669817][ T3289] other info that might help us debug this: [ 378.669817][ T3289] [ 378.670141][ T3289] Possible unsafe locking scenario: [ 378.670141][ T3289] [ 378.670378][ T3289] CPU0 CPU1 [ 378.670538][ T3289] ---- ---- [ 378.670701][ T3289] lock(team->team_lock_key); [ 378.670884][ T3289] lock(&dev->lock); [ 378.671093][ T3289] lock(team->team_lock_key); [ 378.671339][ T3289] lock(&dev->lock); [ 378.671464][ T3289] [ 378.671464][ T3289] *** DEADLOCK *** [ 378.671464][ T3289] [ 378.671702][ T3289] 2 locks held by ip/3289: [ 378.671865][ T3289] #0: ffffffff86deeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 378.672156][ T3289] #1: ffff88800ba0ad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 378.672454][ T3289] [ 378.672454][ T3289] stack backtrace: [ 378.672657][ T3289] CPU: 3 UID: 0 PID: 3289 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 378.672662][ T3289] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 378.672664][ T3289] Call Trace: [ 378.672666][ T3289] [ 378.672668][ T3289] dump_stack_lvl+0x82/0xd0 [ 378.672677][ T3289] print_circular_bug+0x1b7/0x240 [ 378.672683][ T3289] check_noncircular+0x2f9/0x3e0 [ 378.672687][ T3289] ? __pfx_check_noncircular+0x10/0x10 [ 378.672691][ T3289] ? find_held_lock+0x2c/0x110 [ 378.672698][ T3289] ? alloc_chain_hlocks+0x4e0/0x720 [ 378.672702][ T3289] check_prev_add+0x182/0xce0 [ 378.672707][ T3289] validate_chain+0x7bd/0xae0 [ 378.672711][ T3289] ? stack_depot_save_flags+0x27e/0x440 [ 378.672719][ T3289] ? __pfx_validate_chain+0x10/0x10 [ 378.672722][ T3289] ? hlock_class+0x4e/0x130 [ 378.672725][ T3289] ? mark_lock+0x38/0x3e0 [ 378.672729][ T3289] __lock_acquire+0xb9a/0x1680 [ 378.672734][ T3289] ? mark_lock+0x38/0x3e0 [ 378.672737][ T3289] lock_acquire.part.0+0xeb/0x330 [ 378.672740][ T3289] ? __dev_open+0x57e/0x710 [ 378.672743][ T3289] ? validate_chain+0x162/0xae0 [ 378.672747][ T3289] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 378.672750][ T3289] ? trace_lock_acquire+0x14c/0x1f0 [ 378.672753][ T3289] ? lock_acquire+0x32/0xc0 [ 378.672756][ T3289] ? __dev_open+0x57e/0x710 [ 378.672759][ T3289] __mutex_lock+0x169/0xc40 [ 378.672762][ T3289] ? __dev_open+0x57e/0x710 [ 378.672765][ T3289] ? __dev_open+0x57e/0x710 [ 378.672768][ T3289] ? __pfx___mutex_lock+0x10/0x10 [ 378.672775][ T3289] ? mutex_is_locked+0x1c/0x60 [ 378.672778][ T3289] ? rtnl_is_locked+0x15/0x20 [ 378.672786][ T3289] ? mirred_device_event+0x3d/0x1e0 [act_mirred] [ 378.672796][ T3289] ? __dev_open+0x57e/0x710 [ 378.672798][ T3289] __dev_open+0x57e/0x710 [ 378.672800][ T3289] ? mark_held_locks+0x9e/0xe0 [ 378.672803][ T3289] ? __pfx___dev_open+0x10/0x10 [ 378.672806][ T3289] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 378.672814][ T3289] netif_open+0xc9/0x130 [ 378.672817][ T3289] ? __pfx_netif_open+0x10/0x10 [ 378.672822][ T3289] dev_open+0x9f/0x1a0 [ 378.672826][ T3289] team_port_add+0x90a/0x1ce0 [ 378.672831][ T3289] ? __pfx_team_port_add+0x10/0x10 [ 378.672834][ T3289] ? rcu_read_lock_any_held+0x43/0xb0 [ 378.672841][ T3289] ? validate_chain+0x1fe/0xae0 [ 378.672845][ T3289] team_add_slave+0x41/0x80 [ 378.672849][ T3289] do_set_master+0x302/0x610 [ 378.672854][ T3289] do_setlink.constprop.0+0x87b/0x25f0 [ 378.672859][ T3289] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 378.672862][ T3289] ? lock_acquire.part.0+0xeb/0x330 [ 378.672865][ T3289] ? rtnl_newlink+0x653/0xa70 [ 378.672868][ T3289] ? rtnl_newlink+0xb9/0xa70 [ 378.672871][ T3289] ? rtnetlink_rcv_msg+0x712/0xc10 [ 378.672874][ T3289] ? __mutex_trylock_common+0xfa/0x260 [ 378.672878][ T3289] ? __pfx___mutex_trylock_common+0x10/0x10 [ 378.672881][ T3289] ? lock_acquire+0x32/0xc0 [ 378.672885][ T3289] ? trace_contention_end+0xef/0x150 [ 378.672888][ T3289] ? __mutex_lock+0x190/0xc40 [ 378.672892][ T3289] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 378.672895][ T3289] ? rtnl_newlink+0x653/0xa70 [ 378.672899][ T3289] ? __pfx___mutex_lock+0x10/0x10 [ 378.672901][ T3289] ? __pfx_validate_nla+0x10/0x10 [ 378.672907][ T3289] ? trace_cap_capable+0x11e/0x1a0 [ 378.672913][ T3289] ? __rtnl_newlink+0x3f2/0xa80 [ 378.672918][ T3289] rtnl_newlink+0x69c/0xa70 [ 378.672922][ T3289] ? __pfx_rtnl_newlink+0x10/0x10 [ 378.672925][ T3289] ? find_held_lock+0x2c/0x110 [ 378.672930][ T3289] ? __pfx___lock_release+0x10/0x10 [ 378.672933][ T3289] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 378.672938][ T3289] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 378.672941][ T3289] ? __pfx_rtnl_newlink+0x10/0x10 [ 378.672944][ T3289] rtnetlink_rcv_msg+0x712/0xc10 [ 378.672948][ T3289] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 378.672951][ T3289] ? hlock_class+0x4e/0x130 [ 378.672953][ T3289] ? mark_lock+0x38/0x3e0 [ 378.672957][ T3289] ? __lock_acquire+0xb9a/0x1680 [ 378.672961][ T3289] netlink_rcv_skb+0x130/0x360 [ 378.672966][ T3289] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 378.672970][ T3289] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 378.672977][ T3289] ? netlink_deliver_tap+0x13e/0x340 [ 378.672981][ T3289] ? netlink_deliver_tap+0xc3/0x340 [ 378.672985][ T3289] netlink_unicast+0x44b/0x710 [ 378.672989][ T3289] ? __pfx_netlink_unicast+0x10/0x10 [ 378.672993][ T3289] ? find_held_lock+0x2c/0x110 [ 378.672998][ T3289] netlink_sendmsg+0x723/0xbe0 [ 378.673003][ T3289] ? __pfx_netlink_sendmsg+0x10/0x10 [ 378.673009][ T3289] ____sys_sendmsg+0x7ac/0xa10 [ 378.673012][ T3289] ? __pfx_____sys_sendmsg+0x10/0x10 [ 378.673015][ T3289] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 378.673022][ T3289] ___sys_sendmsg+0xee/0x170 [ 378.673026][ T3289] ? __pfx____sys_sendmsg+0x10/0x10 [ 378.673031][ T3289] ? kasan_save_stack+0x34/0x50 [ 378.673035][ T3289] ? kasan_save_stack+0x24/0x50 [ 378.673038][ T3289] ? kasan_record_aux_stack+0x8c/0xa0 [ 378.673041][ T3289] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 378.673045][ T3289] ? __x64_sys_close+0x7c/0xd0 [ 378.673050][ T3289] ? do_syscall_64+0xc1/0x1d0 [ 378.673052][ T3289] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 378.673055][ T3289] ? __lock_acquire+0xb9a/0x1680 [ 378.673059][ T3289] ? lock_downgrade+0x52/0x110 [ 378.673063][ T3289] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 378.673066][ T3289] ? find_held_lock+0x2c/0x110 [ 378.673071][ T3289] ? __lock_release+0x103/0x460 [ 378.673073][ T3289] ? __virt_addr_valid+0x22b/0x430 [ 378.673079][ T3289] ? __pfx___lock_release+0x10/0x10 [ 378.673082][ T3289] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 378.673087][ T3289] __sys_sendmsg+0x109/0x1a0 [ 378.673090][ T3289] ? __pfx___sys_sendmsg+0x10/0x10 [ 378.673098][ T3289] do_syscall_64+0xc1/0x1d0 [ 378.673101][ T3289] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 378.673104][ T3289] RIP: 0033:0x7f67f14629a7 [ 378.673109][ T3289] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 378.673112][ T3289] RSP: 002b:00007fff9d118e98 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 378.673116][ T3289] RAX: ffffffffffffffda RBX: 00007fff9d1195c0 RCX: 00007f67f14629a7 [ 378.673118][ T3289] RDX: 0000000000000000 RSI: 00007fff9d118f00 RDI: 0000000000000005 [ 378.673120][ T3289] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 378.673122][ T3289] R10: 0000000007422910 R11: 0000000000000246 R12: 0000000000000004 [ 378.673124][ T3289] R13: 0000000067b2d8c9 R14: 0000000000498600 R15: 0000000000000000 [ 378.673130][ T3289] [ 378.692765][ T3289] lag1: Port device veth0 added [ 378.767269][ T3290] lag1: Port device veth6 added [ 379.095306][ T3296] 8021q: adding VLAN 0 to HW filter on device lag1 [ 380.271370][ T3319] lag4: Mode changed to "loadbalance" [ 380.346680][ T3321] 8021q: adding VLAN 0 to HW filter on device lag4 [ 380.628274][ T3327] lag4: Port device veth3 added [ 380.685779][ T3328] lag4: Port device veth5 added [ 381.005930][ T3334] 8021q: adding VLAN 0 to HW filter on device lag4 [ 382.175683][ T3357] lag2: Mode changed to "loadbalance" [ 382.239518][ T3359] 8021q: adding VLAN 0 to HW filter on device lag2 [ 382.504324][ T3365] lag2: Port device veth1 added [ 382.570977][ T3366] lag2: Port device veth7 added [ 383.128631][ T3379] br1: port 1(lag2.100) entered blocking state [ 383.128890][ T3379] br1: port 1(lag2.100) entered disabled state [ 383.129117][ T3379] lag2.100: entered allmulticast mode [ 383.129261][ T3379] lag2: entered allmulticast mode [ 383.129432][ T3379] veth1: entered allmulticast mode [ 383.129595][ T3379] veth7: entered allmulticast mode [ 383.132140][ T3379] lag2.100: entered promiscuous mode [ 383.132301][ T3379] lag2: entered promiscuous mode [ 383.133097][ T3379] veth1: entered promiscuous mode [ 383.133611][ T3379] veth7: entered promiscuous mode [ 383.396838][ T3386] br2: port 1(lag2.200) entered blocking state [ 383.397116][ T3386] br2: port 1(lag2.200) entered disabled state [ 383.397382][ T3386] lag2.200: entered allmulticast mode [ 383.399003][ T3386] lag2.200: entered promiscuous mode [ 383.579931][ T3389] br1: port 1(lag2.100) entered blocking state [ 383.580205][ T3389] br1: port 1(lag2.100) entered forwarding state [ 383.646756][ T3390] br2: port 1(lag2.200) entered blocking state [ 383.647026][ T3390] br2: port 1(lag2.200) entered forwarding state [ 383.998748][ T3398] lag3: Mode changed to "loadbalance" [ 384.061437][ T3400] 8021q: adding VLAN 0 to HW filter on device lag3 [ 384.329291][ T3406] lag3: Port device veth2 added [ 384.407887][ T3407] lag3: Port device veth4 added [ 395.767945][ T3488] veth7: left promiscuous mode [ 395.769025][ T3488] veth7: left allmulticast mode [ 395.770224][ T3488] lag2: Port device veth7 removed [ 410.904703][ T3549] veth7: entered promiscuous mode [ 410.905144][ T3549] veth7: entered allmulticast mode [ 410.905901][ T3549] lag2: Port device veth7 added [ 411.127741][ T3560] veth1: left promiscuous mode [ 411.128144][ T3560] veth1: left allmulticast mode [ 411.136871][ T3560] lag2: Port device veth1 removed [ 426.217600][ T154] br1: port 1(lag2.100) entered disabled state [ 426.218827][ T154] br2: port 1(lag2.200) entered disabled state [ 426.267186][ T3621] veth7: left promiscuous mode [ 426.267602][ T3621] veth7: left allmulticast mode [ 426.268869][ T3621] lag2: Port device veth7 removed [ 426.512192][ T3632] veth1: entered promiscuous mode [ 426.512593][ T3632] veth1: entered allmulticast mode [ 426.513392][ T3632] lag2: Port device veth1 added [ 426.536729][ T56] br1: port 1(lag2.100) entered blocking state [ 426.536977][ T56] br1: port 1(lag2.100) entered forwarding state [ 426.537590][ T56] br2: port 1(lag2.200) entered blocking state [ 426.537793][ T56] br2: port 1(lag2.200) entered forwarding state [ 426.760336][ T3644] veth7: entered promiscuous mode [ 426.760718][ T3644] veth7: entered allmulticast mode [ 426.761667][ T3644] lag2: Port device veth7 added [ 441.863147][ T3704] lag2.200: left allmulticast mode [ 441.863375][ T3704] lag2.200: left promiscuous mode [ 441.863909][ T3704] br2: port 1(lag2.200) entered disabled state [ 441.922056][ T3705] lag2.100: left allmulticast mode [ 441.922265][ T3705] lag2: left allmulticast mode [ 441.922452][ T3705] veth1: left allmulticast mode [ 441.922614][ T3705] veth7: left allmulticast mode [ 441.922782][ T3705] lag2.100: left promiscuous mode [ 441.922929][ T3705] lag2: left promiscuous mode [ 441.923081][ T3705] veth1: left promiscuous mode [ 441.923492][ T3705] veth7: left promiscuous mode [ 441.924194][ T3705] br1: port 1(lag2.100) entered disabled state [ 444.025110][ T3707] br1: port 1(lag2.100) entered blocking state [ 444.025343][ T3707] br1: port 1(lag2.100) entered disabled state [ 444.025946][ T3707] lag2.100: entered allmulticast mode [ 444.026127][ T3707] lag2: entered allmulticast mode [ 444.026276][ T3707] veth1: entered allmulticast mode [ 444.026438][ T3707] veth7: entered allmulticast mode [ 444.028088][ T3707] lag2.100: entered promiscuous mode [ 444.028253][ T3707] lag2: entered promiscuous mode [ 444.028411][ T3707] veth1: entered promiscuous mode [ 444.028797][ T3707] veth7: entered promiscuous mode [ 444.029938][ T3707] br1: port 1(lag2.100) entered blocking state [ 444.030155][ T3707] br1: port 1(lag2.100) entered forwarding state [ 444.099042][ T3708] br2: port 1(lag2.200) entered blocking state [ 444.099330][ T3708] br2: port 1(lag2.200) entered disabled state [ 444.099822][ T3708] lag2.200: entered allmulticast mode [ 444.101587][ T3708] lag2.200: entered promiscuous mode [ 444.102739][ T3708] br2: port 1(lag2.200) entered blocking state [ 444.102956][ T3708] br2: port 1(lag2.200) entered forwarding state [ 459.184947][ T3768] lag3: Port device veth2 removed [ 474.278669][ T3829] lag3: Port device veth2 added [ 474.511975][ T3840] lag3: Port device veth4 removed [ 489.567499][ T3901] lag3: Port device veth2 removed [ 489.790823][ T3912] lag3: Port device veth4 added [ 490.044826][ T3923] lag3: Port device veth2 added [ 505.586774][ T3994] lag3: Port device veth4 removed [ 505.645213][ T3995] lag3: Port device veth2 removed [ 506.170742][ T4007] br2: port 1(lag2.200) entered disabled state [ 506.228448][ T4008] br1: port 1(lag2.100) entered disabled state [ 506.398924][ T4011] lag2.200: left allmulticast mode [ 506.399127][ T4011] lag2.200: left promiscuous mode [ 506.399656][ T4011] br2: port 1(lag2.200) entered disabled state [ 506.562451][ T4013] lag2.100: left allmulticast mode [ 506.562674][ T4013] lag2: left allmulticast mode [ 506.562847][ T4013] veth1: left allmulticast mode [ 506.563013][ T4013] veth7: left allmulticast mode [ 506.563183][ T4013] lag2.100: left promiscuous mode [ 506.563342][ T4013] lag2: left promiscuous mode [ 506.564437][ T4013] veth1: left promiscuous mode [ 506.564959][ T4013] veth7: left promiscuous mode [ 506.565653][ T4013] br1: port 1(lag2.100) entered disabled state [ 506.883124][ T4017] lag2: Port device veth7 removed [ 506.937777][ T4018] lag2: Port device veth1 removed [ 508.203441][ T4035] lag4: Port device veth5 removed [ 508.256468][ T4036] lag4: Port device veth3 removed [ 509.396567][ T4051] lag1: Port device veth6 removed [ 509.449449][ T4052] lag1: Port device veth0 removed