[ 12.496892][ T285] 8021q: 802.1Q VLAN Support v1.8 [ 15.754229][ T327] br1: port 1(veth1.100) entered blocking state [ 15.754692][ T327] br1: port 1(veth1.100) entered disabled state [ 15.755054][ T327] veth1.100: entered allmulticast mode [ 15.755247][ T327] veth1: entered allmulticast mode [ 15.758518][ T327] veth1.100: entered promiscuous mode [ 15.758741][ T327] veth1: entered promiscuous mode [ 15.993927][ T330] br1: port 1(veth1.100) entered blocking state [ 15.994386][ T330] br1: port 1(veth1.100) entered forwarding state [ 16.561614][ T340] br2: port 1(veth1.200) entered blocking state [ 16.561988][ T340] br2: port 1(veth1.200) entered disabled state [ 16.562291][ T340] veth1.200: entered allmulticast mode [ 16.564275][ T340] veth1.200: entered promiscuous mode [ 16.816118][ T343] br2: port 1(veth1.200) entered blocking state [ 16.816459][ T343] br2: port 1(veth1.200) entered forwarding state [ 28.285434][ T404] veth1.100: left allmulticast mode [ 28.285678][ T404] veth1.100: left promiscuous mode [ 28.286201][ T404] br1: port 1(veth1.100) entered disabled state [ 28.369963][ T405] veth1.200: left allmulticast mode [ 28.370851][ T405] veth1: left allmulticast mode [ 28.371096][ T405] veth1.200: left promiscuous mode [ 28.371322][ T405] veth1: left promiscuous mode [ 28.371860][ T405] br2: port 1(veth1.200) entered disabled state [ 30.505468][ T407] br2: port 1(veth1.200) entered blocking state [ 30.506039][ T407] br2: port 1(veth1.200) entered disabled state [ 30.506777][ T407] veth1.200: entered allmulticast mode [ 30.507101][ T407] veth1: entered allmulticast mode [ 30.510539][ T407] veth1.200: entered promiscuous mode [ 30.510888][ T407] veth1: entered promiscuous mode [ 30.512915][ T407] br2: port 1(veth1.200) entered blocking state [ 30.513338][ T407] br2: port 1(veth1.200) entered forwarding state [ 30.622644][ T408] br1: port 1(veth1.100) entered blocking state [ 30.622994][ T408] br1: port 1(veth1.100) entered disabled state [ 30.623325][ T408] veth1.100: entered allmulticast mode [ 30.625533][ T408] veth1.100: entered promiscuous mode [ 30.626576][ T408] br1: port 1(veth1.100) entered blocking state [ 30.626921][ T408] br1: port 1(veth1.100) entered forwarding state [ 36.455560][ T460] veth1.200: left allmulticast mode [ 36.455811][ T460] veth1.200: left promiscuous mode [ 36.456348][ T460] br2: port 1(veth1.200) entered disabled state [ 36.611164][ T461] ip (461) used greatest stack depth: 23544 bytes left [ 36.962456][ T467] veth1.100: left allmulticast mode [ 36.962738][ T467] veth1: left allmulticast mode [ 36.963036][ T467] veth1.100: left promiscuous mode [ 36.963347][ T467] veth1: left promiscuous mode [ 36.963988][ T467] br1: port 1(veth1.100) entered disabled state [ 38.833000][ T489] [ 38.833158][ T489] ============================================ [ 38.833350][ T489] WARNING: possible recursive locking detected [ 38.833527][ T489] 6.13.0-rc5-virtme #1 Not tainted [ 38.833678][ T489] -------------------------------------------- [ 38.833860][ T489] ip/489 is trying to acquire lock: [ 38.834003][ T489] ffffffff963d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 38.834311][ T489] [ 38.834311][ T489] but task is already holding lock: [ 38.834522][ T489] ffffffff963d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 38.834818][ T489] [ 38.834818][ T489] other info that might help us debug this: [ 38.835043][ T489] Possible unsafe locking scenario: [ 38.835043][ T489] [ 38.835257][ T489] CPU0 [ 38.835372][ T489] ---- [ 38.835483][ T489] lock((netdev_chain).rwsem); [ 38.835629][ T489] lock((netdev_chain).rwsem); [ 38.835775][ T489] [ 38.835775][ T489] *** DEADLOCK *** [ 38.835775][ T489] [ 38.835993][ T489] May be due to missing lock nesting notation [ 38.835993][ T489] [ 38.836214][ T489] 2 locks held by ip/489: [ 38.836326][ T489] #0: ffffffff963e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 38.836606][ T489] #1: ffffffff963d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 38.836921][ T489] [ 38.836921][ T489] stack backtrace: [ 38.837102][ T489] CPU: 2 UID: 0 PID: 489 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 38.837356][ T489] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 38.837559][ T489] Call Trace: [ 38.837674][ T489] [ 38.837752][ T489] dump_stack_lvl+0x82/0xd0 [ 38.837905][ T489] print_deadlock_bug+0x40a/0x650 [ 38.838054][ T489] validate_chain+0x5bf/0xae0 [ 38.838201][ T489] ? __pfx_validate_chain+0x10/0x10 [ 38.838353][ T489] ? hlock_class+0x4e/0x130 [ 38.838496][ T489] ? mark_lock+0x38/0x3e0 [ 38.838607][ T489] __lock_acquire+0xb9a/0x1680 [ 38.838766][ T489] lock_acquire.part.0+0xeb/0x330 [ 38.838910][ T489] ? blocking_notifier_call_chain+0x50/0x90 [ 38.839092][ T489] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 38.839275][ T489] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 38.839422][ T489] ? trace_lock_acquire+0x14c/0x1f0 [ 38.839570][ T489] ? lock_acquire+0x32/0xc0 [ 38.839713][ T489] ? blocking_notifier_call_chain+0x50/0x90 [ 38.839901][ T489] down_read+0x9f/0x340 [ 38.840013][ T489] ? blocking_notifier_call_chain+0x50/0x90 [ 38.840193][ T489] ? __pfx_down_read+0x10/0x10 [ 38.840345][ T489] ? __lock_release+0x103/0x460 [ 38.840492][ T489] ? netconsole_netdev_event+0x2c1/0x620 [ 38.840637][ T489] ? __pfx___lock_release+0x10/0x10 [ 38.840786][ T489] blocking_notifier_call_chain+0x50/0x90 [ 38.840939][ T489] __netdev_upper_dev_unlink+0xd9/0x220 [ 38.841101][ T489] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 38.841280][ T489] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 38.841427][ T489] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 38.841608][ T489] ? rtnl_is_locked+0x15/0x20 [ 38.841755][ T489] netdev_upper_dev_unlink+0x71/0xa0 [ 38.841902][ T489] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 38.842089][ T489] ? netconsole_netdev_event+0x2c1/0x620 [ 38.842238][ T489] ? mutex_is_locked+0x1c/0x60 [ 38.842385][ T489] ? rtnl_is_locked+0x15/0x20 [ 38.842533][ T489] ? netdev_master_upper_dev_get+0x13/0x120 [ 38.842716][ T489] vrf_device_event+0x78/0xe0 [vrf] [ 38.842868][ T489] notifier_call_chain+0xcd/0x150 [ 38.843016][ T489] blocking_notifier_call_chain+0x66/0x90 [ 38.843170][ T489] unregister_netdevice_many_notify+0xa7b/0x1580 [ 38.843351][ T489] ? hlock_class+0x4e/0x130 [ 38.843495][ T489] ? mark_lock+0x38/0x3e0 [ 38.843606][ T489] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 38.843789][ T489] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 38.843970][ T489] ? kfree+0xf3/0x330 [ 38.844090][ T489] ? vlan_vid_del+0x310/0x5e0 [ 38.844241][ T489] ? vlan_vid_del+0x310/0x5e0 [ 38.844390][ T489] rtnl_dellink+0x348/0xa40 [ 38.844536][ T489] ? __pfx_rtnl_dellink+0x10/0x10 [ 38.844695][ T489] ? find_held_lock+0x2c/0x110 [ 38.844843][ T489] ? __lock_release+0x103/0x460 [ 38.844989][ T489] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 38.845134][ T489] ? __pfx___lock_release+0x10/0x10 [ 38.845285][ T489] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 38.845433][ T489] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 38.845578][ T489] ? __pfx_rtnl_dellink+0x10/0x10 [ 38.845723][ T489] rtnetlink_rcv_msg+0x712/0xc10 [ 38.845867][ T489] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 38.846011][ T489] ? hlock_class+0x4e/0x130 [ 38.846155][ T489] ? mark_lock+0x38/0x3e0 [ 38.846271][ T489] ? __lock_acquire+0xb9a/0x1680 [ 38.846417][ T489] netlink_rcv_skb+0x130/0x360 [ 38.846562][ T489] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 38.846712][ T489] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 38.846869][ T489] ? netlink_deliver_tap+0x13e/0x340 [ 38.847019][ T489] ? netlink_deliver_tap+0xc3/0x340 [ 38.847166][ T489] netlink_unicast+0x44b/0x710 [ 38.847318][ T489] ? __pfx_netlink_unicast+0x10/0x10 [ 38.847465][ T489] ? find_held_lock+0x2c/0x110 [ 38.847613][ T489] netlink_sendmsg+0x723/0xbe0 [ 38.847759][ T489] ? __pfx_netlink_sendmsg+0x10/0x10 [ 38.847907][ T489] ____sys_sendmsg+0x7ac/0xa10 [ 38.848055][ T489] ? __pfx_____sys_sendmsg+0x10/0x10 [ 38.848200][ T489] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 38.848390][ T489] ___sys_sendmsg+0xee/0x170 [ 38.848536][ T489] ? __pfx____sys_sendmsg+0x10/0x10 [ 38.848682][ T489] ? kasan_save_stack+0x34/0x50 [ 38.848830][ T489] ? kasan_save_stack+0x24/0x50 [ 38.848975][ T489] ? __kasan_record_aux_stack+0x8e/0xa0 [ 38.849124][ T489] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 38.849304][ T489] ? __x64_sys_close+0x7c/0xd0 [ 38.849450][ T489] ? do_syscall_64+0xc1/0x1d0 [ 38.849599][ T489] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 38.849781][ T489] ? __lock_acquire+0xb9a/0x1680 [ 38.849928][ T489] ? find_held_lock+0x2c/0x110 [ 38.850075][ T489] ? __lock_release+0x103/0x460 [ 38.850221][ T489] ? __virt_addr_valid+0x22b/0x430 [ 38.850368][ T489] ? __pfx___lock_release+0x10/0x10 [ 38.850511][ T489] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 38.850661][ T489] __sys_sendmsg+0x109/0x1a0 [ 38.850811][ T489] ? __pfx___sys_sendmsg+0x10/0x10 [ 38.850955][ T489] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 38.851138][ T489] do_syscall_64+0xc1/0x1d0 [ 38.851280][ T489] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 38.851459][ T489] RIP: 0033:0x7fd79068a9a7 [ 38.851615][ T489] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 38.852131][ T489] RSP: 002b:00007ffe1d2e8098 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 38.852351][ T489] RAX: ffffffffffffffda RBX: 00007ffe1d2e87c0 RCX: 00007fd79068a9a7 [ 38.852571][ T489] RDX: 0000000000000000 RSI: 00007ffe1d2e8100 RDI: 0000000000000005 [ 38.852793][ T489] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 38.853012][ T489] R10: 00007fd790548ef8 R11: 0000000000000246 R12: 0000000000000002 [ 38.853231][ T489] R13: 0000000067790122 R14: 0000000000498600 R15: 0000000000000000 [ 38.853453][ T489]