[ 103.281328][ T876] lag: Mode changed to "loadbalance" [ 103.531284][ T879] [ 103.531423][ T879] ====================================================== [ 103.531616][ T879] WARNING: possible circular locking dependency detected [ 103.531807][ T879] 6.14.0-rc2-virtme #1 Not tainted [ 103.531972][ T879] ------------------------------------------------------ [ 103.532181][ T879] ip/879 is trying to acquire lock: [ 103.532353][ T879] ffff888002511cb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 103.532610][ T879] [ 103.532610][ T879] but task is already holding lock: [ 103.532858][ T879] ffff88800e0fad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 103.533171][ T879] [ 103.533171][ T879] which lock already depends on the new lock. [ 103.533171][ T879] [ 103.533488][ T879] [ 103.533488][ T879] the existing dependency chain (in reverse order) is: [ 103.533765][ T879] [ 103.533765][ T879] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 103.534017][ T879] __lock_acquire+0xb9a/0x1680 [ 103.534189][ T879] lock_acquire.part.0+0xeb/0x330 [ 103.534352][ T879] __mutex_lock+0x169/0xc40 [ 103.534536][ T879] team_set_mac_address+0x120/0x250 [ 103.534713][ T879] netif_set_mac_address+0x28a/0x410 [ 103.534934][ T879] do_setlink.constprop.0+0x1980/0x25f0 [ 103.535150][ T879] rtnl_setlink+0x2b5/0x5a0 [ 103.535342][ T879] rtnetlink_rcv_msg+0x712/0xc10 [ 103.535540][ T879] netlink_rcv_skb+0x130/0x360 [ 103.535724][ T879] netlink_unicast+0x44b/0x710 [ 103.535899][ T879] netlink_sendmsg+0x723/0xbe0 [ 103.536074][ T879] __sys_sendto+0x3c3/0x450 [ 103.536276][ T879] __x64_sys_sendto+0xe0/0x1c0 [ 103.536451][ T879] do_syscall_64+0xc1/0x1d0 [ 103.536633][ T879] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 103.536841][ T879] [ 103.536841][ T879] -> #0 (&dev->lock){+.+.}-{4:4}: [ 103.537088][ T879] check_prev_add+0x182/0xce0 [ 103.537247][ T879] validate_chain+0x7bd/0xae0 [ 103.537405][ T879] __lock_acquire+0xb9a/0x1680 [ 103.537595][ T879] lock_acquire.part.0+0xeb/0x330 [ 103.537763][ T879] __mutex_lock+0x169/0xc40 [ 103.537922][ T879] __dev_open+0x57e/0x710 [ 103.538087][ T879] netif_open+0xc9/0x130 [ 103.538250][ T879] dev_open+0x9f/0x1a0 [ 103.538408][ T879] team_port_add+0x90a/0x1ce0 [ 103.538592][ T879] team_add_slave+0x41/0x80 [ 103.538770][ T879] do_set_master+0x302/0x610 [ 103.538939][ T879] do_setlink.constprop.0+0x87b/0x25f0 [ 103.539157][ T879] rtnl_newlink+0x69c/0xa70 [ 103.539328][ T879] rtnetlink_rcv_msg+0x712/0xc10 [ 103.539500][ T879] netlink_rcv_skb+0x130/0x360 [ 103.539675][ T879] netlink_unicast+0x44b/0x710 [ 103.539861][ T879] netlink_sendmsg+0x723/0xbe0 [ 103.540026][ T879] ____sys_sendmsg+0x7ac/0xa10 [ 103.540187][ T879] ___sys_sendmsg+0xee/0x170 [ 103.540358][ T879] __sys_sendmsg+0x109/0x1a0 [ 103.540521][ T879] do_syscall_64+0xc1/0x1d0 [ 103.540692][ T879] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 103.540900][ T879] [ 103.540900][ T879] other info that might help us debug this: [ 103.540900][ T879] [ 103.541213][ T879] Possible unsafe locking scenario: [ 103.541213][ T879] [ 103.541460][ T879] CPU0 CPU1 [ 103.541619][ T879] ---- ---- [ 103.541783][ T879] lock(team->team_lock_key); [ 103.541961][ T879] lock(&dev->lock); [ 103.542156][ T879] lock(team->team_lock_key); [ 103.542397][ T879] lock(&dev->lock); [ 103.542551][ T879] [ 103.542551][ T879] *** DEADLOCK *** [ 103.542551][ T879] [ 103.542794][ T879] 2 locks held by ip/879: [ 103.542918][ T879] #0: ffffffff93deeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 103.543222][ T879] #1: ffff88800e0fad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 103.543523][ T879] [ 103.543523][ T879] stack backtrace: [ 103.543752][ T879] CPU: 3 UID: 0 PID: 879 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 103.543758][ T879] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 103.543761][ T879] Call Trace: [ 103.543763][ T879] [ 103.543766][ T879] dump_stack_lvl+0x82/0xd0 [ 103.543778][ T879] print_circular_bug+0x1b7/0x240 [ 103.543789][ T879] check_noncircular+0x2f9/0x3e0 [ 103.543797][ T879] ? __pfx_check_noncircular+0x10/0x10 [ 103.543802][ T879] ? __pfx_validate_chain+0x10/0x10 [ 103.543808][ T879] ? hlock_class+0x4e/0x130 [ 103.543813][ T879] ? mark_lock+0x38/0x3e0 [ 103.543820][ T879] ? alloc_chain_hlocks+0x4e0/0x720 [ 103.543824][ T879] ? __lock_acquire+0xb9a/0x1680 [ 103.543830][ T879] check_prev_add+0x182/0xce0 [ 103.543835][ T879] validate_chain+0x7bd/0xae0 [ 103.543839][ T879] ? hlock_class+0x4e/0x130 [ 103.543842][ T879] ? __pfx_validate_chain+0x10/0x10 [ 103.543845][ T879] ? hlock_class+0x4e/0x130 [ 103.543847][ T879] ? mark_lock+0x38/0x3e0 [ 103.543850][ T879] ? mark_held_locks+0x9e/0xe0 [ 103.543854][ T879] __lock_acquire+0xb9a/0x1680 [ 103.543860][ T879] lock_acquire.part.0+0xeb/0x330 [ 103.543863][ T879] ? __dev_open+0x57e/0x710 [ 103.543868][ T879] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 103.543871][ T879] ? trace_lock_acquire+0x14c/0x1f0 [ 103.543874][ T879] ? lock_acquire+0x32/0xc0 [ 103.543877][ T879] ? __dev_open+0x57e/0x710 [ 103.543880][ T879] __mutex_lock+0x169/0xc40 [ 103.543884][ T879] ? __dev_open+0x57e/0x710 [ 103.543886][ T879] ? __lock_release+0x103/0x460 [ 103.543889][ T879] ? __pfx___lock_release+0x10/0x10 [ 103.543892][ T879] ? __dev_open+0x57e/0x710 [ 103.543894][ T879] ? hlock_class+0x4e/0x130 [ 103.543897][ T879] ? __pfx___mutex_lock+0x10/0x10 [ 103.543903][ T879] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 103.543908][ T879] ? __dev_open+0x57e/0x710 [ 103.543911][ T879] __dev_open+0x57e/0x710 [ 103.543913][ T879] ? mark_held_locks+0x9e/0xe0 [ 103.543916][ T879] ? __pfx___dev_open+0x10/0x10 [ 103.543918][ T879] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 103.543926][ T879] netif_open+0xc9/0x130 [ 103.543929][ T879] ? __pfx_netif_open+0x10/0x10 [ 103.543933][ T879] dev_open+0x9f/0x1a0 [ 103.543937][ T879] team_port_add+0x90a/0x1ce0 [ 103.543943][ T879] ? __pfx_team_port_add+0x10/0x10 [ 103.543947][ T879] ? rcu_read_lock_any_held+0x43/0xb0 [ 103.543953][ T879] ? validate_chain+0x1fe/0xae0 [ 103.543958][ T879] team_add_slave+0x41/0x80 [ 103.543962][ T879] do_set_master+0x302/0x610 [ 103.543967][ T879] do_setlink.constprop.0+0x87b/0x25f0 [ 103.543972][ T879] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 103.543976][ T879] ? lock_acquire.part.0+0xeb/0x330 [ 103.543979][ T879] ? rtnl_newlink+0x653/0xa70 [ 103.543982][ T879] ? rtnl_newlink+0xb9/0xa70 [ 103.543985][ T879] ? rtnetlink_rcv_msg+0x712/0xc10 [ 103.543988][ T879] ? __mutex_trylock_common+0xfa/0x260 [ 103.543994][ T879] ? __pfx___mutex_trylock_common+0x10/0x10 [ 103.543998][ T879] ? lock_acquire+0x32/0xc0 [ 103.544001][ T879] ? trace_contention_end+0xef/0x150 [ 103.544005][ T879] ? __mutex_lock+0x190/0xc40 [ 103.544008][ T879] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 103.544012][ T879] ? rtnl_newlink+0x653/0xa70 [ 103.544015][ T879] ? __pfx___mutex_lock+0x10/0x10 [ 103.544019][ T879] ? __pfx_validate_nla+0x10/0x10 [ 103.544027][ T879] ? trace_cap_capable+0x11e/0x1a0 [ 103.544035][ T879] ? __rtnl_newlink+0x3f2/0xa80 [ 103.544040][ T879] rtnl_newlink+0x69c/0xa70 [ 103.544045][ T879] ? __pfx_rtnl_newlink+0x10/0x10 [ 103.544047][ T879] ? find_held_lock+0x2c/0x110 [ 103.544053][ T879] ? __pfx___lock_release+0x10/0x10 [ 103.544056][ T879] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 103.544061][ T879] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 103.544064][ T879] ? __pfx_rtnl_newlink+0x10/0x10 [ 103.544067][ T879] rtnetlink_rcv_msg+0x712/0xc10 [ 103.544071][ T879] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 103.544074][ T879] ? hlock_class+0x4e/0x130 [ 103.544077][ T879] ? mark_lock+0x38/0x3e0 [ 103.544081][ T879] ? __lock_acquire+0xb9a/0x1680 [ 103.544085][ T879] netlink_rcv_skb+0x130/0x360 [ 103.544090][ T879] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 103.544094][ T879] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 103.544101][ T879] ? netlink_deliver_tap+0x13e/0x340 [ 103.544105][ T879] ? netlink_deliver_tap+0xc3/0x340 [ 103.544109][ T879] netlink_unicast+0x44b/0x710 [ 103.544113][ T879] ? __pfx_netlink_unicast+0x10/0x10 [ 103.544116][ T879] ? find_held_lock+0x2c/0x110 [ 103.544121][ T879] netlink_sendmsg+0x723/0xbe0 [ 103.544126][ T879] ? __pfx_netlink_sendmsg+0x10/0x10 [ 103.544132][ T879] ____sys_sendmsg+0x7ac/0xa10 [ 103.544137][ T879] ? __pfx_____sys_sendmsg+0x10/0x10 [ 103.544139][ T879] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 103.544146][ T879] ___sys_sendmsg+0xee/0x170 [ 103.544151][ T879] ? __pfx____sys_sendmsg+0x10/0x10 [ 103.544155][ T879] ? kasan_save_stack+0x34/0x50 [ 103.544160][ T879] ? kasan_save_stack+0x24/0x50 [ 103.544163][ T879] ? kasan_record_aux_stack+0x8c/0xa0 [ 103.544167][ T879] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 103.544172][ T879] ? __x64_sys_close+0x7c/0xd0 [ 103.544178][ T879] ? do_syscall_64+0xc1/0x1d0 [ 103.544181][ T879] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 103.544185][ T879] ? __lock_acquire+0xb9a/0x1680 [ 103.544188][ T879] ? lock_downgrade+0x52/0x110 [ 103.544192][ T879] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 103.544196][ T879] ? find_held_lock+0x2c/0x110 [ 103.544200][ T879] ? __lock_release+0x103/0x460 [ 103.544203][ T879] ? __virt_addr_valid+0x22b/0x430 [ 103.544208][ T879] ? __pfx___lock_release+0x10/0x10 [ 103.544211][ T879] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 103.544216][ T879] __sys_sendmsg+0x109/0x1a0 [ 103.544221][ T879] ? __pfx___sys_sendmsg+0x10/0x10 [ 103.544233][ T879] do_syscall_64+0xc1/0x1d0 [ 103.544237][ T879] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 103.544240][ T879] RIP: 0033:0x7f47bda8d9a7 [ 103.544245][ T879] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 103.544248][ T879] RSP: 002b:00007ffe39c13e38 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 103.544252][ T879] RAX: ffffffffffffffda RBX: 00007ffe39c14560 RCX: 00007f47bda8d9a7 [ 103.544254][ T879] RDX: 0000000000000000 RSI: 00007ffe39c13ea0 RDI: 0000000000000005 [ 103.544256][ T879] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 103.544258][ T879] R10: 0000000021218910 R11: 0000000000000246 R12: 0000000000000004 [ 103.544259][ T879] R13: 0000000067b2d7a8 R14: 0000000000498600 R15: 0000000000000000 [ 103.544264][ T879] [ 103.566771][ T879] lag: Port device veth2 added [ 103.772381][ T889] lag: Port device veth4 added [ 103.896476][ T891] 8021q: adding VLAN 0 to HW filter on device lag [ 103.955705][ T892] br1: port 1(lag) entered blocking state [ 103.955947][ T892] br1: port 1(lag) entered disabled state [ 103.956155][ T892] lag: entered allmulticast mode [ 103.956325][ T892] veth2: entered allmulticast mode [ 103.956493][ T892] veth4: entered allmulticast mode [ 103.958319][ T892] veth2: entered promiscuous mode [ 103.958524][ T892] veth4: entered promiscuous mode [ 104.027699][ T893] br1: port 1(lag) entered blocking state [ 104.027969][ T893] br1: port 1(lag) entered forwarding state [ 110.705241][ T927] Mirror/redirect action on [ 125.144501][ T192] br1: port 1(lag) entered disabled state [ 130.993129][ T192] br1: port 1(lag) entered blocking state [ 130.993354][ T192] br1: port 1(lag) entered forwarding state [ 145.866956][ T45] br1: port 1(lag) entered disabled state [ 151.734691][ T966] br1: port 1(lag) entered blocking state [ 151.735024][ T966] br1: port 1(lag) entered forwarding state [ 152.378616][ T1032] lag: left allmulticast mode [ 152.379126][ T1032] veth2: left allmulticast mode [ 152.379435][ T1032] veth4: left allmulticast mode [ 152.379739][ T1032] veth2: left promiscuous mode [ 152.380034][ T1032] veth4: left promiscuous mode [ 152.380224][ T1032] br1: port 1(lag) entered disabled state [ 152.478843][ T876] lag: Port device veth4 removed [ 152.481624][ T876] lag: Port device veth2 removed