[ 99.877455][ T877] lag: Mode changed to "loadbalance" [ 100.119578][ T880] [ 100.119738][ T880] ====================================================== [ 100.119972][ T880] WARNING: possible circular locking dependency detected [ 100.120190][ T880] 6.14.0-rc2-virtme #1 Not tainted [ 100.120376][ T880] ------------------------------------------------------ [ 100.120628][ T880] ip/880 is trying to acquire lock: [ 100.120803][ T880] ffff888007e99cb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 100.121143][ T880] [ 100.121143][ T880] but task is already holding lock: [ 100.121461][ T880] ffff888010ab2d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 100.121821][ T880] [ 100.121821][ T880] which lock already depends on the new lock. [ 100.121821][ T880] [ 100.122321][ T880] [ 100.122321][ T880] the existing dependency chain (in reverse order) is: [ 100.122733][ T880] [ 100.122733][ T880] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 100.123100][ T880] __lock_acquire+0xb9a/0x1680 [ 100.123293][ T880] lock_acquire.part.0+0xeb/0x330 [ 100.123467][ T880] __mutex_lock+0x169/0xc40 [ 100.123682][ T880] team_set_mac_address+0x120/0x250 [ 100.123920][ T880] netif_set_mac_address+0x28a/0x410 [ 100.124157][ T880] do_setlink.constprop.0+0x1980/0x25f0 [ 100.124390][ T880] rtnl_setlink+0x2b5/0x5a0 [ 100.124580][ T880] rtnetlink_rcv_msg+0x712/0xc10 [ 100.124782][ T880] netlink_rcv_skb+0x130/0x360 [ 100.124967][ T880] netlink_unicast+0x44b/0x710 [ 100.125120][ T880] netlink_sendmsg+0x723/0xbe0 [ 100.125270][ T880] __sys_sendto+0x3c3/0x450 [ 100.125433][ T880] __x64_sys_sendto+0xe0/0x1c0 [ 100.125585][ T880] do_syscall_64+0xc1/0x1d0 [ 100.125775][ T880] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 100.126028][ T880] [ 100.126028][ T880] -> #0 (&dev->lock){+.+.}-{4:4}: [ 100.126260][ T880] check_prev_add+0x182/0xce0 [ 100.126417][ T880] validate_chain+0x7bd/0xae0 [ 100.126574][ T880] __lock_acquire+0xb9a/0x1680 [ 100.126724][ T880] lock_acquire.part.0+0xeb/0x330 [ 100.126888][ T880] __mutex_lock+0x169/0xc40 [ 100.127037][ T880] __dev_open+0x57e/0x710 [ 100.127188][ T880] netif_open+0xc9/0x130 [ 100.127339][ T880] dev_open+0x9f/0x1a0 [ 100.127491][ T880] team_port_add+0x90a/0x1ce0 [ 100.127641][ T880] team_add_slave+0x41/0x80 [ 100.127800][ T880] do_set_master+0x302/0x610 [ 100.127962][ T880] do_setlink.constprop.0+0x87b/0x25f0 [ 100.128149][ T880] rtnl_newlink+0x69c/0xa70 [ 100.128301][ T880] rtnetlink_rcv_msg+0x712/0xc10 [ 100.128456][ T880] netlink_rcv_skb+0x130/0x360 [ 100.128612][ T880] netlink_unicast+0x44b/0x710 [ 100.128768][ T880] netlink_sendmsg+0x723/0xbe0 [ 100.128975][ T880] ____sys_sendmsg+0x7ac/0xa10 [ 100.129156][ T880] ___sys_sendmsg+0xee/0x170 [ 100.129348][ T880] __sys_sendmsg+0x109/0x1a0 [ 100.129505][ T880] do_syscall_64+0xc1/0x1d0 [ 100.129659][ T880] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 100.129862][ T880] [ 100.129862][ T880] other info that might help us debug this: [ 100.129862][ T880] [ 100.130184][ T880] Possible unsafe locking scenario: [ 100.130184][ T880] [ 100.130470][ T880] CPU0 CPU1 [ 100.130661][ T880] ---- ---- [ 100.130870][ T880] lock(team->team_lock_key); [ 100.131111][ T880] lock(&dev->lock); [ 100.131330][ T880] lock(team->team_lock_key); [ 100.131555][ T880] lock(&dev->lock); [ 100.131674][ T880] [ 100.131674][ T880] *** DEADLOCK *** [ 100.131674][ T880] [ 100.131907][ T880] 2 locks held by ip/880: [ 100.132067][ T880] #0: ffffffff8a3eeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 100.132343][ T880] #1: ffff888010ab2d80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 100.132623][ T880] [ 100.132623][ T880] stack backtrace: [ 100.132811][ T880] CPU: 1 UID: 0 PID: 880 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 100.132816][ T880] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 100.132820][ T880] Call Trace: [ 100.132822][ T880] [ 100.132824][ T880] dump_stack_lvl+0x82/0xd0 [ 100.132836][ T880] print_circular_bug+0x1b7/0x240 [ 100.132845][ T880] check_noncircular+0x2f9/0x3e0 [ 100.132850][ T880] ? find_held_lock+0x2c/0x110 [ 100.132858][ T880] ? __pfx_check_noncircular+0x10/0x10 [ 100.132863][ T880] ? stack_depot_save_flags+0x27e/0x440 [ 100.132871][ T880] ? __pfx___lock_release+0x10/0x10 [ 100.132877][ T880] ? alloc_chain_hlocks+0x4e0/0x720 [ 100.132881][ T880] check_prev_add+0x182/0xce0 [ 100.132884][ T880] ? validate_chain+0x1fe/0xae0 [ 100.132888][ T880] validate_chain+0x7bd/0xae0 [ 100.132892][ T880] ? mark_lock+0x38/0x3e0 [ 100.132895][ T880] ? __pfx_validate_chain+0x10/0x10 [ 100.132898][ T880] ? hlock_class+0x4e/0x130 [ 100.132901][ T880] ? mark_lock+0x38/0x3e0 [ 100.132905][ T880] __lock_acquire+0xb9a/0x1680 [ 100.132911][ T880] lock_acquire.part.0+0xeb/0x330 [ 100.132914][ T880] ? __dev_open+0x57e/0x710 [ 100.132918][ T880] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 100.132922][ T880] ? trace_lock_acquire+0x14c/0x1f0 [ 100.132925][ T880] ? lock_acquire+0x32/0xc0 [ 100.132928][ T880] ? __dev_open+0x57e/0x710 [ 100.132931][ T880] __mutex_lock+0x169/0xc40 [ 100.132934][ T880] ? __dev_open+0x57e/0x710 [ 100.132936][ T880] ? __lock_release+0x103/0x460 [ 100.132939][ T880] ? __pfx___lock_release+0x10/0x10 [ 100.132942][ T880] ? __dev_open+0x57e/0x710 [ 100.132944][ T880] ? hlock_class+0x4e/0x130 [ 100.132947][ T880] ? __pfx___mutex_lock+0x10/0x10 [ 100.132953][ T880] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 100.132959][ T880] ? __dev_open+0x57e/0x710 [ 100.132961][ T880] __dev_open+0x57e/0x710 [ 100.132963][ T880] ? mark_held_locks+0x9e/0xe0 [ 100.132966][ T880] ? __pfx___dev_open+0x10/0x10 [ 100.132969][ T880] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 100.132976][ T880] netif_open+0xc9/0x130 [ 100.132979][ T880] ? __pfx_netif_open+0x10/0x10 [ 100.132983][ T880] dev_open+0x9f/0x1a0 [ 100.132988][ T880] team_port_add+0x90a/0x1ce0 [ 100.132993][ T880] ? __pfx_team_port_add+0x10/0x10 [ 100.132996][ T880] ? rcu_read_lock_any_held+0x43/0xb0 [ 100.133003][ T880] ? validate_chain+0x1fe/0xae0 [ 100.133008][ T880] team_add_slave+0x41/0x80 [ 100.133012][ T880] do_set_master+0x302/0x610 [ 100.133016][ T880] do_setlink.constprop.0+0x87b/0x25f0 [ 100.133021][ T880] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 100.133025][ T880] ? lock_acquire.part.0+0xeb/0x330 [ 100.133028][ T880] ? rtnl_newlink+0x653/0xa70 [ 100.133031][ T880] ? rtnl_newlink+0xb9/0xa70 [ 100.133034][ T880] ? rtnetlink_rcv_msg+0x712/0xc10 [ 100.133037][ T880] ? __mutex_trylock_common+0xfa/0x260 [ 100.133041][ T880] ? __pfx___mutex_trylock_common+0x10/0x10 [ 100.133045][ T880] ? lock_acquire+0x32/0xc0 [ 100.133049][ T880] ? trace_contention_end+0xef/0x150 [ 100.133052][ T880] ? __mutex_lock+0x190/0xc40 [ 100.133056][ T880] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 100.133060][ T880] ? rtnl_newlink+0x653/0xa70 [ 100.133064][ T880] ? __pfx___mutex_lock+0x10/0x10 [ 100.133066][ T880] ? __pfx_validate_nla+0x10/0x10 [ 100.133071][ T880] ? trace_cap_capable+0x11e/0x1a0 [ 100.133079][ T880] ? __rtnl_newlink+0x3f2/0xa80 [ 100.133083][ T880] rtnl_newlink+0x69c/0xa70 [ 100.133088][ T880] ? __pfx_rtnl_newlink+0x10/0x10 [ 100.133090][ T880] ? find_held_lock+0x2c/0x110 [ 100.133095][ T880] ? __pfx___lock_release+0x10/0x10 [ 100.133098][ T880] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 100.133103][ T880] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 100.133106][ T880] ? __pfx_rtnl_newlink+0x10/0x10 [ 100.133109][ T880] rtnetlink_rcv_msg+0x712/0xc10 [ 100.133113][ T880] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 100.133116][ T880] ? hlock_class+0x4e/0x130 [ 100.133118][ T880] ? mark_lock+0x38/0x3e0 [ 100.133122][ T880] ? __lock_acquire+0xb9a/0x1680 [ 100.133126][ T880] netlink_rcv_skb+0x130/0x360 [ 100.133131][ T880] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 100.133134][ T880] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 100.133141][ T880] ? netlink_deliver_tap+0x13e/0x340 [ 100.133145][ T880] ? netlink_deliver_tap+0xc3/0x340 [ 100.133149][ T880] netlink_unicast+0x44b/0x710 [ 100.133153][ T880] ? __pfx_netlink_unicast+0x10/0x10 [ 100.133156][ T880] ? find_held_lock+0x2c/0x110 [ 100.133161][ T880] netlink_sendmsg+0x723/0xbe0 [ 100.133166][ T880] ? __pfx_netlink_sendmsg+0x10/0x10 [ 100.133172][ T880] ____sys_sendmsg+0x7ac/0xa10 [ 100.133176][ T880] ? __pfx_____sys_sendmsg+0x10/0x10 [ 100.133179][ T880] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 100.133186][ T880] ___sys_sendmsg+0xee/0x170 [ 100.133191][ T880] ? __pfx____sys_sendmsg+0x10/0x10 [ 100.133195][ T880] ? kasan_save_stack+0x34/0x50 [ 100.133199][ T880] ? kasan_save_stack+0x24/0x50 [ 100.133202][ T880] ? kasan_record_aux_stack+0x8c/0xa0 [ 100.133205][ T880] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 100.133210][ T880] ? __x64_sys_close+0x7c/0xd0 [ 100.133214][ T880] ? do_syscall_64+0xc1/0x1d0 [ 100.133216][ T880] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 100.133220][ T880] ? __lock_acquire+0xb9a/0x1680 [ 100.133223][ T880] ? lock_downgrade+0x52/0x110 [ 100.133227][ T880] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 100.133231][ T880] ? find_held_lock+0x2c/0x110 [ 100.133236][ T880] ? __lock_release+0x103/0x460 [ 100.133238][ T880] ? __virt_addr_valid+0x22b/0x430 [ 100.133245][ T880] ? __pfx___lock_release+0x10/0x10 [ 100.133248][ T880] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 100.133252][ T880] __sys_sendmsg+0x109/0x1a0 [ 100.133256][ T880] ? __pfx___sys_sendmsg+0x10/0x10 [ 100.133264][ T880] do_syscall_64+0xc1/0x1d0 [ 100.133267][ T880] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 100.133270][ T880] RIP: 0033:0x7fe984a5d9a7 [ 100.133277][ T880] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 100.133280][ T880] RSP: 002b:00007fff75c8fe78 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 100.133284][ T880] RAX: ffffffffffffffda RBX: 00007fff75c905a0 RCX: 00007fe984a5d9a7 [ 100.133286][ T880] RDX: 0000000000000000 RSI: 00007fff75c8fee0 RDI: 0000000000000005 [ 100.133288][ T880] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 100.133290][ T880] R10: 00000000175ec910 R11: 0000000000000246 R12: 0000000000000004 [ 100.133291][ T880] R13: 0000000067b35678 R14: 0000000000498600 R15: 0000000000000000 [ 100.133297][ T880] [ 100.156344][ T880] lag: Port device veth2 added [ 100.367832][ T890] lag: Port device veth4 added [ 100.487001][ T892] 8021q: adding VLAN 0 to HW filter on device lag [ 100.542679][ T893] br1: port 1(lag) entered blocking state [ 100.543484][ T893] br1: port 1(lag) entered disabled state [ 100.543684][ T893] lag: entered allmulticast mode [ 100.543863][ T893] veth2: entered allmulticast mode [ 100.544026][ T893] veth4: entered allmulticast mode [ 100.545819][ T893] veth2: entered promiscuous mode [ 100.546026][ T893] veth4: entered promiscuous mode [ 100.608382][ T894] br1: port 1(lag) entered blocking state [ 100.608614][ T894] br1: port 1(lag) entered forwarding state [ 107.181863][ T928] Mirror/redirect action on [ 121.614557][ T45] br1: port 1(lag) entered disabled state [ 127.488652][ T57] br1: port 1(lag) entered blocking state [ 127.488994][ T57] br1: port 1(lag) entered forwarding state [ 142.358387][ T40] br1: port 1(lag) entered disabled state [ 148.184721][ T40] br1: port 1(lag) entered blocking state [ 148.185102][ T40] br1: port 1(lag) entered forwarding state [ 148.829478][ T1032] lag: left allmulticast mode [ 148.829754][ T1032] veth2: left allmulticast mode [ 148.829982][ T1032] veth4: left allmulticast mode [ 148.830187][ T1032] veth2: left promiscuous mode [ 148.830392][ T1032] veth4: left promiscuous mode [ 148.830554][ T1032] br1: port 1(lag) entered disabled state [ 148.924736][ T877] lag: Port device veth4 removed [ 148.927981][ T877] lag: Port device veth2 removed