[ 13.498174][ T304] 8021q: 802.1Q VLAN Support v1.8 [ 18.236383][ T413] ip (413) used greatest stack depth: 23352 bytes left [ 19.074836][ T435] br10: port 1(veth1.10) entered blocking state [ 19.075366][ T435] br10: port 1(veth1.10) entered disabled state [ 19.075801][ T435] veth1.10: entered allmulticast mode [ 19.076002][ T435] veth1: entered allmulticast mode [ 19.078036][ T435] veth1.10: entered promiscuous mode [ 19.078292][ T435] veth1: entered promiscuous mode [ 19.205452][ T440] br10: port 2(veth2.10) entered blocking state [ 19.205849][ T440] br10: port 2(veth2.10) entered disabled state [ 19.207079][ T440] veth2.10: entered allmulticast mode [ 19.207270][ T440] veth2: entered allmulticast mode [ 19.209947][ T440] veth2.10: entered promiscuous mode [ 19.210204][ T440] veth2: entered promiscuous mode [ 19.346128][ T445] br10: port 2(veth2.10) entered blocking state [ 19.346619][ T445] br10: port 2(veth2.10) entered forwarding state [ 19.347530][ T445] br10: port 1(veth1.10) entered blocking state [ 19.347815][ T445] br10: port 1(veth1.10) entered forwarding state [ 20.416029][ T481] br11: port 1(veth1.11) entered blocking state [ 20.416351][ T481] br11: port 1(veth1.11) entered disabled state [ 20.416628][ T481] veth1.11: entered allmulticast mode [ 20.418578][ T481] veth1.11: entered promiscuous mode [ 20.547777][ T486] br11: port 2(veth2.11) entered blocking state [ 20.548070][ T486] br11: port 2(veth2.11) entered disabled state [ 20.548370][ T486] veth2.11: entered allmulticast mode [ 20.550638][ T486] veth2.11: entered promiscuous mode [ 20.669848][ T491] br11: port 2(veth2.11) entered blocking state [ 20.670152][ T491] br11: port 2(veth2.11) entered forwarding state [ 20.670644][ T491] br11: port 1(veth1.11) entered blocking state [ 20.670902][ T491] br11: port 1(veth1.11) entered forwarding state [ 21.846761][ T527] br12: port 1(veth1.12) entered blocking state [ 21.847239][ T527] br12: port 1(veth1.12) entered disabled state [ 21.848866][ T527] veth1.12: entered allmulticast mode [ 21.852171][ T527] veth1.12: entered promiscuous mode [ 22.021793][ T532] br12: port 2(veth2.12) entered blocking state [ 22.022106][ T532] br12: port 2(veth2.12) entered disabled state [ 22.022401][ T532] veth2.12: entered allmulticast mode [ 22.024437][ T532] veth2.12: entered promiscuous mode [ 22.142654][ T537] br12: port 2(veth2.12) entered blocking state [ 22.143005][ T537] br12: port 2(veth2.12) entered forwarding state [ 22.143488][ T537] br12: port 1(veth1.12) entered blocking state [ 22.143752][ T537] br12: port 1(veth1.12) entered forwarding state [ 435.271599][ T1969] br12: port 2(veth2.12) entered disabled state [ 435.379586][ T1971] br12: port 1(veth1.12) entered disabled state [ 435.619943][ T1975] veth2.12: left allmulticast mode [ 435.620208][ T1975] veth2.12: left promiscuous mode [ 435.620578][ T1975] br12: port 2(veth2.12) entered disabled state [ 435.720462][ T1977] veth1.12: left allmulticast mode [ 435.720831][ T1977] veth1.12: left promiscuous mode [ 435.721360][ T1977] br12: port 1(veth1.12) entered disabled state [ 436.356556][ T1987] br11: port 2(veth2.11) entered disabled state [ 436.467534][ T1989] br11: port 1(veth1.11) entered disabled state [ 436.686021][ T1993] veth2.11: left allmulticast mode [ 436.686303][ T1993] veth2.11: left promiscuous mode [ 436.686728][ T1993] br11: port 2(veth2.11) entered disabled state [ 436.801143][ T1995] veth1.11: left allmulticast mode [ 436.801416][ T1995] veth1.11: left promiscuous mode [ 436.801756][ T1995] br11: port 1(veth1.11) entered disabled state [ 437.359920][ T2003] veth2: left allmulticast mode [ 437.360297][ T2003] veth2: left promiscuous mode [ 437.363024][ T2003] br10: port 2(veth2.10) entered disabled state [ 437.465679][ T2005] veth1: left allmulticast mode [ 437.465968][ T2005] veth1: left promiscuous mode [ 437.467661][ T2005] br10: port 1(veth1.10) entered disabled state [ 437.709381][ T2009] veth2.10: left allmulticast mode [ 437.709636][ T2009] veth2.10: left promiscuous mode [ 437.709961][ T2009] br10: port 2(veth2.10) entered disabled state [ 437.832486][ T2011] veth1.10: left allmulticast mode [ 437.832963][ T2011] veth1.10: left promiscuous mode [ 437.833582][ T2011] br10: port 1(veth1.10) entered disabled state [ 438.847575][ T2029] [ 438.847737][ T2029] ============================================ [ 438.847934][ T2029] WARNING: possible recursive locking detected [ 438.848206][ T2029] 6.13.0-rc5-virtme #1 Not tainted [ 438.848383][ T2029] -------------------------------------------- [ 438.848565][ T2029] ip/2029 is trying to acquire lock: [ 438.848722][ T2029] ffffffffac5d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 438.849037][ T2029] [ 438.849037][ T2029] but task is already holding lock: [ 438.849260][ T2029] ffffffffac5d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 438.849581][ T2029] [ 438.849581][ T2029] other info that might help us debug this: [ 438.849796][ T2029] Possible unsafe locking scenario: [ 438.849796][ T2029] [ 438.850022][ T2029] CPU0 [ 438.850134][ T2029] ---- [ 438.850247][ T2029] lock((netdev_chain).rwsem); [ 438.850402][ T2029] lock((netdev_chain).rwsem); [ 438.850559][ T2029] [ 438.850559][ T2029] *** DEADLOCK *** [ 438.850559][ T2029] [ 438.850782][ T2029] May be due to missing lock nesting notation [ 438.850782][ T2029] [ 438.851011][ T2029] 2 locks held by ip/2029: [ 438.851161][ T2029] #0: ffffffffac5e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 438.851439][ T2029] #1: ffffffffac5d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 438.851750][ T2029] [ 438.851750][ T2029] stack backtrace: [ 438.851934][ T2029] CPU: 0 UID: 0 PID: 2029 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 438.852165][ T2029] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 438.852377][ T2029] Call Trace: [ 438.852491][ T2029] [ 438.852569][ T2029] dump_stack_lvl+0x82/0xd0 [ 438.852722][ T2029] print_deadlock_bug+0x40a/0x650 [ 438.852873][ T2029] validate_chain+0x5bf/0xae0 [ 438.853029][ T2029] ? __pfx_validate_chain+0x10/0x10 [ 438.853204][ T2029] ? hlock_class+0x4e/0x130 [ 438.853354][ T2029] ? mark_lock+0x38/0x3e0 [ 438.853476][ T2029] __lock_acquire+0xb9a/0x1680 [ 438.853630][ T2029] lock_acquire.part.0+0xeb/0x330 [ 438.853803][ T2029] ? blocking_notifier_call_chain+0x50/0x90 [ 438.854007][ T2029] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 438.854200][ T2029] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 438.854359][ T2029] ? trace_lock_acquire+0x14c/0x1f0 [ 438.854509][ T2029] ? lock_acquire+0x32/0xc0 [ 438.854675][ T2029] ? blocking_notifier_call_chain+0x50/0x90 [ 438.854865][ T2029] down_read+0x9f/0x340 [ 438.854979][ T2029] ? blocking_notifier_call_chain+0x50/0x90 [ 438.855161][ T2029] ? __pfx_down_read+0x10/0x10 [ 438.855315][ T2029] ? __lock_release+0x103/0x460 [ 438.855471][ T2029] ? netconsole_netdev_event+0x2c1/0x620 [ 438.855641][ T2029] ? __pfx___lock_release+0x10/0x10 [ 438.855801][ T2029] blocking_notifier_call_chain+0x50/0x90 [ 438.855954][ T2029] __netdev_upper_dev_unlink+0xd9/0x220 [ 438.856109][ T2029] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 438.856309][ T2029] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 438.856468][ T2029] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 438.856664][ T2029] ? rtnl_is_locked+0x15/0x20 [ 438.856836][ T2029] netdev_upper_dev_unlink+0x71/0xa0 [ 438.856992][ T2029] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 438.857177][ T2029] ? netconsole_netdev_event+0x2c1/0x620 [ 438.857330][ T2029] ? mutex_is_locked+0x1c/0x60 [ 438.857486][ T2029] ? rtnl_is_locked+0x15/0x20 [ 438.857643][ T2029] ? netdev_master_upper_dev_get+0x13/0x120 [ 438.857833][ T2029] vrf_device_event+0x78/0xe0 [vrf] [ 438.857998][ T2029] notifier_call_chain+0xcd/0x150 [ 438.858156][ T2029] blocking_notifier_call_chain+0x66/0x90 [ 438.858311][ T2029] unregister_netdevice_many_notify+0xa7b/0x1580 [ 438.858513][ T2029] ? hlock_class+0x4e/0x130 [ 438.858664][ T2029] ? mark_lock+0x38/0x3e0 [ 438.858780][ T2029] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 438.858965][ T2029] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 438.859155][ T2029] ? kfree+0xf3/0x330 [ 438.859275][ T2029] ? vlan_vid_del+0x310/0x5e0 [ 438.859430][ T2029] ? vlan_vid_del+0x310/0x5e0 [ 438.859588][ T2029] rtnl_dellink+0x348/0xa40 [ 438.859742][ T2029] ? __pfx_rtnl_dellink+0x10/0x10 [ 438.859904][ T2029] ? find_held_lock+0x2c/0x110 [ 438.860054][ T2029] ? __lock_release+0x103/0x460 [ 438.860203][ T2029] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 438.860351][ T2029] ? __pfx___lock_release+0x10/0x10 [ 438.860511][ T2029] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 438.860666][ T2029] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 438.860812][ T2029] ? __pfx_rtnl_dellink+0x10/0x10 [ 438.860960][ T2029] rtnetlink_rcv_msg+0x712/0xc10 [ 438.861112][ T2029] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 438.861267][ T2029] ? hlock_class+0x4e/0x130 [ 438.861430][ T2029] ? mark_lock+0x38/0x3e0 [ 438.861544][ T2029] ? __lock_acquire+0xb9a/0x1680 [ 438.861691][ T2029] netlink_rcv_skb+0x130/0x360 [ 438.861851][ T2029] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 438.862008][ T2029] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 438.862157][ T2029] ? netlink_deliver_tap+0x13e/0x340 [ 438.862307][ T2029] ? netlink_deliver_tap+0xc3/0x340 [ 438.862469][ T2029] netlink_unicast+0x44b/0x710 [ 438.862630][ T2029] ? __pfx_netlink_unicast+0x10/0x10 [ 438.862779][ T2029] ? find_held_lock+0x2c/0x110 [ 438.862930][ T2029] netlink_sendmsg+0x723/0xbe0 [ 438.863085][ T2029] ? __pfx_netlink_sendmsg+0x10/0x10 [ 438.863236][ T2029] ____sys_sendmsg+0x7ac/0xa10 [ 438.863391][ T2029] ? __pfx_____sys_sendmsg+0x10/0x10 [ 438.863546][ T2029] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 438.863739][ T2029] ___sys_sendmsg+0xee/0x170 [ 438.863891][ T2029] ? __pfx____sys_sendmsg+0x10/0x10 [ 438.864040][ T2029] ? kasan_save_stack+0x34/0x50 [ 438.864195][ T2029] ? kasan_save_stack+0x24/0x50 [ 438.864355][ T2029] ? __kasan_record_aux_stack+0x8e/0xa0 [ 438.864513][ T2029] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 438.864703][ T2029] ? __x64_sys_close+0x7c/0xd0 [ 438.864854][ T2029] ? do_syscall_64+0xc1/0x1d0 [ 438.865007][ T2029] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 438.865191][ T2029] ? __lock_acquire+0xb9a/0x1680 [ 438.865340][ T2029] ? find_held_lock+0x2c/0x110 [ 438.865491][ T2029] ? __lock_release+0x103/0x460 [ 438.865647][ T2029] ? __virt_addr_valid+0x22b/0x430 [ 438.865796][ T2029] ? __pfx___lock_release+0x10/0x10 [ 438.865947][ T2029] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 438.866103][ T2029] __sys_sendmsg+0x109/0x1a0 [ 438.866265][ T2029] ? __pfx___sys_sendmsg+0x10/0x10 [ 438.866422][ T2029] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 438.866628][ T2029] do_syscall_64+0xc1/0x1d0 [ 438.866784][ T2029] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 438.866986][ T2029] RIP: 0033:0x7f0629cfd9a7 [ 438.867156][ T2029] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 438.867701][ T2029] RSP: 002b:00007ffc4d09c468 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 438.867941][ T2029] RAX: ffffffffffffffda RBX: 00007ffc4d09cb90 RCX: 00007f0629cfd9a7 [ 438.868184][ T2029] RDX: 0000000000000000 RSI: 00007ffc4d09c4d0 RDI: 0000000000000005 [ 438.868432][ T2029] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 438.868680][ T2029] R10: 00007f0629bbbef8 R11: 0000000000000246 R12: 0000000000000002 [ 438.868911][ T2029] R13: 0000000067795030 R14: 0000000000498600 R15: 0000000000000000 [ 438.869145][ T2029]