[ 1372.376273][T21914] ip_gre: GRE over IPv4 tunneling driver [ 1373.143736][T21932] lag: Mode changed to "loadbalance" [ 1373.335040][T21935] [ 1373.335177][T21935] ====================================================== [ 1373.335389][T21935] WARNING: possible circular locking dependency detected [ 1373.335605][T21935] 6.14.0-rc2-virtme #1 Not tainted [ 1373.335771][T21935] ------------------------------------------------------ [ 1373.335986][T21935] ip/21935 is trying to acquire lock: [ 1373.336154][T21935] ffff888002114cb0 (&dev->lock){+.+.}-{4:4}, at: __dev_open+0x57e/0x710 [ 1373.336450][T21935] [ 1373.336450][T21935] but task is already holding lock: [ 1373.336707][T21935] ffff88800522ad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1373.337042][T21935] [ 1373.337042][T21935] which lock already depends on the new lock. [ 1373.337042][T21935] [ 1373.337385][T21935] [ 1373.337385][T21935] the existing dependency chain (in reverse order) is: [ 1373.337712][T21935] [ 1373.337712][T21935] -> #1 (team->team_lock_key){+.+.}-{4:4}: [ 1373.337978][T21935] __lock_acquire+0xb9a/0x1680 [ 1373.338152][T21935] lock_acquire.part.0+0xeb/0x330 [ 1373.338332][T21935] __mutex_lock+0x169/0xc40 [ 1373.338498][T21935] team_set_mac_address+0x120/0x250 [ 1373.338684][T21935] netif_set_mac_address+0x28a/0x410 [ 1373.338900][T21935] do_setlink.constprop.0+0x1980/0x25f0 [ 1373.339145][T21935] rtnl_setlink+0x2b5/0x5a0 [ 1373.339315][T21935] rtnetlink_rcv_msg+0x712/0xc10 [ 1373.339485][T21935] netlink_rcv_skb+0x130/0x360 [ 1373.339677][T21935] netlink_unicast+0x44b/0x710 [ 1373.339846][T21935] netlink_sendmsg+0x723/0xbe0 [ 1373.340041][T21935] __sys_sendto+0x3c3/0x450 [ 1373.340210][T21935] __x64_sys_sendto+0xe0/0x1c0 [ 1373.340403][T21935] do_syscall_64+0xc1/0x1d0 [ 1373.340575][T21935] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1373.340811][T21935] [ 1373.340811][T21935] -> #0 (&dev->lock){+.+.}-{4:4}: [ 1373.341084][T21935] check_prev_add+0x182/0xce0 [ 1373.341282][T21935] validate_chain+0x7bd/0xae0 [ 1373.341450][T21935] __lock_acquire+0xb9a/0x1680 [ 1373.341651][T21935] lock_acquire.part.0+0xeb/0x330 [ 1373.341816][T21935] __mutex_lock+0x169/0xc40 [ 1373.342015][T21935] __dev_open+0x57e/0x710 [ 1373.342195][T21935] netif_open+0xc9/0x130 [ 1373.342385][T21935] dev_open+0x9f/0x1a0 [ 1373.342559][T21935] team_port_add+0x90a/0x1ce0 [ 1373.342752][T21935] team_add_slave+0x41/0x80 [ 1373.342924][T21935] do_set_master+0x302/0x610 [ 1373.343096][T21935] do_setlink.constprop.0+0x87b/0x25f0 [ 1373.343304][T21935] rtnl_newlink+0x69c/0xa70 [ 1373.343476][T21935] rtnetlink_rcv_msg+0x712/0xc10 [ 1373.343640][T21935] netlink_rcv_skb+0x130/0x360 [ 1373.343810][T21935] netlink_unicast+0x44b/0x710 [ 1373.343979][T21935] netlink_sendmsg+0x723/0xbe0 [ 1373.344152][T21935] ____sys_sendmsg+0x7ac/0xa10 [ 1373.344322][T21935] ___sys_sendmsg+0xee/0x170 [ 1373.344487][T21935] __sys_sendmsg+0x109/0x1a0 [ 1373.344650][T21935] do_syscall_64+0xc1/0x1d0 [ 1373.344816][T21935] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1373.345028][T21935] [ 1373.345028][T21935] other info that might help us debug this: [ 1373.345028][T21935] [ 1373.345352][T21935] Possible unsafe locking scenario: [ 1373.345352][T21935] [ 1373.345596][T21935] CPU0 CPU1 [ 1373.345763][T21935] ---- ---- [ 1373.345926][T21935] lock(team->team_lock_key); [ 1373.346096][T21935] lock(&dev->lock); [ 1373.346304][T21935] lock(team->team_lock_key); [ 1373.346557][T21935] lock(&dev->lock); [ 1373.346681][T21935] [ 1373.346681][T21935] *** DEADLOCK *** [ 1373.346681][T21935] [ 1373.346920][T21935] 2 locks held by ip/21935: [ 1373.347084][T21935] #0: ffffffffb4feeb48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 1373.347376][T21935] #1: ffff88800522ad80 (team->team_lock_key){+.+.}-{4:4}, at: team_add_slave+0x33/0x80 [ 1373.347683][T21935] [ 1373.347683][T21935] stack backtrace: [ 1373.347887][T21935] CPU: 2 UID: 0 PID: 21935 Comm: ip Not tainted 6.14.0-rc2-virtme #1 [ 1373.347892][T21935] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1373.347894][T21935] Call Trace: [ 1373.347896][T21935] [ 1373.347898][T21935] dump_stack_lvl+0x82/0xd0 [ 1373.347908][T21935] print_circular_bug+0x1b7/0x240 [ 1373.347915][T21935] check_noncircular+0x2f9/0x3e0 [ 1373.347919][T21935] ? __pfx_check_noncircular+0x10/0x10 [ 1373.347922][T21935] ? __pfx_validate_chain+0x10/0x10 [ 1373.347926][T21935] ? hlock_class+0x4e/0x130 [ 1373.347928][T21935] ? mark_lock+0x38/0x3e0 [ 1373.347932][T21935] ? alloc_chain_hlocks+0x4e0/0x720 [ 1373.347934][T21935] ? __lock_acquire+0xb9a/0x1680 [ 1373.347938][T21935] check_prev_add+0x182/0xce0 [ 1373.347943][T21935] validate_chain+0x7bd/0xae0 [ 1373.347947][T21935] ? hlock_class+0x4e/0x130 [ 1373.347950][T21935] ? __pfx_validate_chain+0x10/0x10 [ 1373.347953][T21935] ? hlock_class+0x4e/0x130 [ 1373.347955][T21935] ? mark_lock+0x38/0x3e0 [ 1373.347958][T21935] ? mark_held_locks+0x9e/0xe0 [ 1373.347962][T21935] __lock_acquire+0xb9a/0x1680 [ 1373.347967][T21935] lock_acquire.part.0+0xeb/0x330 [ 1373.347970][T21935] ? __dev_open+0x57e/0x710 [ 1373.347974][T21935] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1373.347977][T21935] ? trace_lock_acquire+0x14c/0x1f0 [ 1373.347981][T21935] ? lock_acquire+0x32/0xc0 [ 1373.347983][T21935] ? __dev_open+0x57e/0x710 [ 1373.347986][T21935] __mutex_lock+0x169/0xc40 [ 1373.347989][T21935] ? __dev_open+0x57e/0x710 [ 1373.347991][T21935] ? __lock_release+0x103/0x460 [ 1373.347994][T21935] ? __pfx___lock_release+0x10/0x10 [ 1373.347997][T21935] ? __dev_open+0x57e/0x710 [ 1373.347999][T21935] ? hlock_class+0x4e/0x130 [ 1373.348001][T21935] ? __pfx___mutex_lock+0x10/0x10 [ 1373.348008][T21935] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 1373.348013][T21935] ? __dev_open+0x57e/0x710 [ 1373.348015][T21935] __dev_open+0x57e/0x710 [ 1373.348017][T21935] ? mark_held_locks+0x9e/0xe0 [ 1373.348020][T21935] ? __pfx___dev_open+0x10/0x10 [ 1373.348023][T21935] ? trace_percpu_alloc_percpu+0x149/0x1d0 [ 1373.348030][T21935] netif_open+0xc9/0x130 [ 1373.348032][T21935] ? __pfx_netif_open+0x10/0x10 [ 1373.348036][T21935] dev_open+0x9f/0x1a0 [ 1373.348041][T21935] team_port_add+0x90a/0x1ce0 [ 1373.348046][T21935] ? __pfx_team_port_add+0x10/0x10 [ 1373.348049][T21935] ? rcu_read_lock_any_held+0x43/0xb0 [ 1373.348055][T21935] ? validate_chain+0x1fe/0xae0 [ 1373.348060][T21935] team_add_slave+0x41/0x80 [ 1373.348064][T21935] do_set_master+0x302/0x610 [ 1373.348068][T21935] do_setlink.constprop.0+0x87b/0x25f0 [ 1373.348072][T21935] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 1373.348076][T21935] ? lock_acquire.part.0+0xeb/0x330 [ 1373.348079][T21935] ? rtnl_newlink+0x653/0xa70 [ 1373.348082][T21935] ? rtnl_newlink+0xb9/0xa70 [ 1373.348084][T21935] ? rtnetlink_rcv_msg+0x712/0xc10 [ 1373.348088][T21935] ? __mutex_trylock_common+0xfa/0x260 [ 1373.348093][T21935] ? __pfx___mutex_trylock_common+0x10/0x10 [ 1373.348097][T21935] ? lock_acquire+0x32/0xc0 [ 1373.348100][T21935] ? trace_contention_end+0xef/0x150 [ 1373.348104][T21935] ? __mutex_lock+0x190/0xc40 [ 1373.348107][T21935] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1373.348110][T21935] ? rtnl_newlink+0x653/0xa70 [ 1373.348114][T21935] ? __pfx___mutex_lock+0x10/0x10 [ 1373.348116][T21935] ? __pfx_validate_nla+0x10/0x10 [ 1373.348123][T21935] ? trace_cap_capable+0x11e/0x1a0 [ 1373.348130][T21935] ? __rtnl_newlink+0x3f2/0xa80 [ 1373.348135][T21935] rtnl_newlink+0x69c/0xa70 [ 1373.348140][T21935] ? __pfx_rtnl_newlink+0x10/0x10 [ 1373.348142][T21935] ? find_held_lock+0x2c/0x110 [ 1373.348148][T21935] ? __pfx___lock_release+0x10/0x10 [ 1373.348151][T21935] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1373.348155][T21935] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 1373.348159][T21935] ? __pfx_rtnl_newlink+0x10/0x10 [ 1373.348161][T21935] rtnetlink_rcv_msg+0x712/0xc10 [ 1373.348165][T21935] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1373.348168][T21935] ? hlock_class+0x4e/0x130 [ 1373.348170][T21935] ? mark_lock+0x38/0x3e0 [ 1373.348174][T21935] ? __lock_acquire+0xb9a/0x1680 [ 1373.348178][T21935] netlink_rcv_skb+0x130/0x360 [ 1373.348182][T21935] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1373.348185][T21935] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 1373.348192][T21935] ? netlink_deliver_tap+0x13e/0x340 [ 1373.348196][T21935] ? netlink_deliver_tap+0xc3/0x340 [ 1373.348199][T21935] netlink_unicast+0x44b/0x710 [ 1373.348204][T21935] ? __pfx_netlink_unicast+0x10/0x10 [ 1373.348207][T21935] ? find_held_lock+0x2c/0x110 [ 1373.348212][T21935] netlink_sendmsg+0x723/0xbe0 [ 1373.348216][T21935] ? __pfx_netlink_sendmsg+0x10/0x10 [ 1373.348222][T21935] ____sys_sendmsg+0x7ac/0xa10 [ 1373.348227][T21935] ? __pfx_____sys_sendmsg+0x10/0x10 [ 1373.348229][T21935] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 1373.348236][T21935] ___sys_sendmsg+0xee/0x170 [ 1373.348240][T21935] ? __pfx____sys_sendmsg+0x10/0x10 [ 1373.348244][T21935] ? kasan_save_stack+0x34/0x50 [ 1373.348250][T21935] ? kasan_save_stack+0x24/0x50 [ 1373.348253][T21935] ? kasan_record_aux_stack+0x8c/0xa0 [ 1373.348257][T21935] ? __call_rcu_common.constprop.0+0xa1/0x5b0 [ 1373.348263][T21935] ? __x64_sys_close+0x7c/0xd0 [ 1373.348268][T21935] ? do_syscall_64+0xc1/0x1d0 [ 1373.348270][T21935] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1373.348273][T21935] ? __lock_acquire+0xb9a/0x1680 [ 1373.348276][T21935] ? lock_downgrade+0x52/0x110 [ 1373.348280][T21935] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1373.348284][T21935] ? find_held_lock+0x2c/0x110 [ 1373.348288][T21935] ? __lock_release+0x103/0x460 [ 1373.348290][T21935] ? __virt_addr_valid+0x22b/0x430 [ 1373.348296][T21935] ? __pfx___lock_release+0x10/0x10 [ 1373.348299][T21935] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1373.348304][T21935] __sys_sendmsg+0x109/0x1a0 [ 1373.348307][T21935] ? __pfx___sys_sendmsg+0x10/0x10 [ 1373.348315][T21935] do_syscall_64+0xc1/0x1d0 [ 1373.348318][T21935] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1373.348321][T21935] RIP: 0033:0x7fd40ff2b9a7 [ 1373.348326][T21935] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 1373.348329][T21935] RSP: 002b:00007fffb6662678 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 1373.348332][T21935] RAX: ffffffffffffffda RBX: 00007fffb6662da0 RCX: 00007fd40ff2b9a7 [ 1373.348334][T21935] RDX: 0000000000000000 RSI: 00007fffb66626e0 RDI: 0000000000000005 [ 1373.348336][T21935] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 1373.348338][T21935] R10: 000000003de3c910 R11: 0000000000000246 R12: 0000000000000004 [ 1373.348339][T21935] R13: 0000000067b35790 R14: 0000000000498600 R15: 0000000000000000 [ 1373.348345][T21935] [ 1373.373802][T21935] lag: Port device veth2 added [ 1373.561064][T21943] lag: Port device veth4 added [ 1373.674666][T21945] 8021q: adding VLAN 0 to HW filter on device lag [ 1373.732771][T21946] br1: port 1(lag) entered blocking state [ 1373.733001][T21946] br1: port 1(lag) entered disabled state [ 1373.733205][T21946] lag: entered allmulticast mode [ 1373.733389][T21946] veth2: entered allmulticast mode [ 1373.733564][T21946] veth4: entered allmulticast mode [ 1373.735906][T21946] veth2: entered promiscuous mode [ 1373.736127][T21946] veth4: entered promiscuous mode [ 1373.788571][T21947] br1: port 1(lag) entered blocking state [ 1373.788837][T21947] br1: port 1(lag) entered forwarding state [ 1394.474383][ T40] br1: port 1(lag) entered disabled state [ 1400.270862][ T45] br1: port 1(lag) entered blocking state [ 1400.271093][ T45] br1: port 1(lag) entered forwarding state [ 1415.036330][T21512] br1: port 1(lag) entered disabled state [ 1420.844721][T21512] br1: port 1(lag) entered blocking state [ 1420.844928][T21512] br1: port 1(lag) entered forwarding state [ 1421.412811][T22085] lag: left allmulticast mode [ 1421.413014][T22085] veth2: left allmulticast mode [ 1421.413176][T22085] veth4: left allmulticast mode [ 1421.413909][T22085] veth2: left promiscuous mode [ 1421.414083][T22085] veth4: left promiscuous mode [ 1421.414243][T22085] br1: port 1(lag) entered disabled state [ 1421.495545][T21932] lag: Port device veth4 removed [ 1421.498976][T21932] lag: Port device veth2 removed