[ 13.937154][ T307] 8021q: 802.1Q VLAN Support v1.8 [ 17.300575][ T377] GACT probability NOT on [ 18.667170][ T413] br10: port 1(veth1.10) entered blocking state [ 18.667973][ T413] br10: port 1(veth1.10) entered disabled state [ 18.669140][ T413] veth1.10: entered allmulticast mode [ 18.669337][ T413] veth1: entered allmulticast mode [ 18.671396][ T413] veth1.10: entered promiscuous mode [ 18.671598][ T413] veth1: entered promiscuous mode [ 19.236647][ T430] br11: port 1(veth1.11) entered blocking state [ 19.237000][ T430] br11: port 1(veth1.11) entered disabled state [ 19.237478][ T430] veth1.11: entered allmulticast mode [ 19.239495][ T430] veth1.11: entered promiscuous mode [ 20.141933][ T460] br10: port 2(veth2.10) entered blocking state [ 20.142294][ T460] br10: port 2(veth2.10) entered disabled state [ 20.142592][ T460] veth2.10: entered allmulticast mode [ 20.142784][ T460] veth2: entered allmulticast mode [ 20.144715][ T460] veth2.10: entered promiscuous mode [ 20.144925][ T460] veth2: entered promiscuous mode [ 20.658105][ T477] br11: port 2(veth2.11) entered blocking state [ 20.658412][ T477] br11: port 2(veth2.11) entered disabled state [ 20.658710][ T477] veth2.11: entered allmulticast mode [ 20.661356][ T477] veth2.11: entered promiscuous mode [ 21.112275][ T489] br10: port 2(veth2.10) entered blocking state [ 21.112806][ T489] br10: port 2(veth2.10) entered forwarding state [ 21.113947][ T489] br10: port 1(veth1.10) entered blocking state [ 21.114270][ T489] br10: port 1(veth1.10) entered forwarding state [ 21.271020][ T494] br11: port 2(veth2.11) entered blocking state [ 21.271557][ T494] br11: port 2(veth2.11) entered forwarding state [ 21.272354][ T494] br11: port 1(veth1.11) entered blocking state [ 21.272771][ T494] br11: port 1(veth1.11) entered forwarding state [ 47.884239][ T619] br11: port 2(veth2.11) entered disabled state [ 47.885180][ T619] br11: port 1(veth1.11) entered disabled state [ 47.985134][ T621] br10: port 2(veth2.10) entered disabled state [ 47.986471][ T621] br10: port 1(veth1.10) entered disabled state [ 48.194814][ T625] veth2.11: left allmulticast mode [ 48.195065][ T625] veth2.11: left promiscuous mode [ 48.195408][ T625] br11: port 2(veth2.11) entered disabled state [ 48.457855][ T631] veth2: left allmulticast mode [ 48.458105][ T631] veth2: left promiscuous mode [ 48.555902][ T633] veth2.10: left allmulticast mode [ 48.557165][ T633] veth2.10: left promiscuous mode [ 48.557487][ T633] br10: port 2(veth2.10) entered disabled state [ 49.115365][ T643] veth1.11: left allmulticast mode [ 49.115622][ T643] veth1.11: left promiscuous mode [ 49.115938][ T643] br11: port 1(veth1.11) entered disabled state [ 49.329697][ T647] veth1: left allmulticast mode [ 49.329975][ T647] veth1: left promiscuous mode [ 49.421835][ T649] veth1.10: left allmulticast mode [ 49.422090][ T649] veth1.10: left promiscuous mode [ 49.422438][ T649] br10: port 1(veth1.10) entered disabled state [ 50.316395][ T663] [ 50.316537][ T663] ============================================ [ 50.316735][ T663] WARNING: possible recursive locking detected [ 50.316917][ T663] 6.13.0-rc5-virtme #1 Not tainted [ 50.317061][ T663] -------------------------------------------- [ 50.317248][ T663] ip/663 is trying to acquire lock: [ 50.317396][ T663] ffffffff8a5d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 50.317704][ T663] [ 50.317704][ T663] but task is already holding lock: [ 50.317915][ T663] ffffffff8a5d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 50.318208][ T663] [ 50.318208][ T663] other info that might help us debug this: [ 50.318451][ T663] Possible unsafe locking scenario: [ 50.318451][ T663] [ 50.318684][ T663] CPU0 [ 50.318797][ T663] ---- [ 50.318915][ T663] lock((netdev_chain).rwsem); [ 50.319078][ T663] lock((netdev_chain).rwsem); [ 50.319246][ T663] [ 50.319246][ T663] *** DEADLOCK *** [ 50.319246][ T663] [ 50.319476][ T663] May be due to missing lock nesting notation [ 50.319476][ T663] [ 50.319703][ T663] 2 locks held by ip/663: [ 50.319815][ T663] #0: ffffffff8a5e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 50.320101][ T663] #1: ffffffff8a5d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 50.320431][ T663] [ 50.320431][ T663] stack backtrace: [ 50.320623][ T663] CPU: 3 UID: 0 PID: 663 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 50.320869][ T663] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 50.321072][ T663] Call Trace: [ 50.321199][ T663] [ 50.321276][ T663] dump_stack_lvl+0x82/0xd0 [ 50.321445][ T663] print_deadlock_bug+0x40a/0x650 [ 50.321606][ T663] validate_chain+0x5bf/0xae0 [ 50.321766][ T663] ? __pfx_validate_chain+0x10/0x10 [ 50.321915][ T663] ? hlock_class+0x4e/0x130 [ 50.322076][ T663] ? mark_lock+0x38/0x3e0 [ 50.322189][ T663] __lock_acquire+0xb9a/0x1680 [ 50.322337][ T663] lock_acquire.part.0+0xeb/0x330 [ 50.322483][ T663] ? blocking_notifier_call_chain+0x50/0x90 [ 50.322674][ T663] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 50.322889][ T663] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 50.323039][ T663] ? trace_lock_acquire+0x14c/0x1f0 [ 50.323193][ T663] ? lock_acquire+0x32/0xc0 [ 50.323346][ T663] ? blocking_notifier_call_chain+0x50/0x90 [ 50.323539][ T663] down_read+0x9f/0x340 [ 50.323663][ T663] ? blocking_notifier_call_chain+0x50/0x90 [ 50.323866][ T663] ? __pfx_down_read+0x10/0x10 [ 50.324016][ T663] ? __lock_release+0x103/0x460 [ 50.324161][ T663] ? netconsole_netdev_event+0x2c1/0x620 [ 50.324317][ T663] ? __pfx___lock_release+0x10/0x10 [ 50.324466][ T663] blocking_notifier_call_chain+0x50/0x90 [ 50.324613][ T663] __netdev_upper_dev_unlink+0xd9/0x220 [ 50.324761][ T663] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 50.324958][ T663] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 50.325118][ T663] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 50.325303][ T663] ? rtnl_is_locked+0x15/0x20 [ 50.325463][ T663] netdev_upper_dev_unlink+0x71/0xa0 [ 50.325636][ T663] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 50.325820][ T663] ? netconsole_netdev_event+0x2c1/0x620 [ 50.325973][ T663] ? mutex_is_locked+0x1c/0x60 [ 50.326139][ T663] ? rtnl_is_locked+0x15/0x20 [ 50.326292][ T663] ? netdev_master_upper_dev_get+0x13/0x120 [ 50.326473][ T663] vrf_device_event+0x78/0xe0 [vrf] [ 50.326637][ T663] notifier_call_chain+0xcd/0x150 [ 50.326784][ T663] blocking_notifier_call_chain+0x66/0x90 [ 50.326931][ T663] unregister_netdevice_many_notify+0xa7b/0x1580 [ 50.327119][ T663] ? hlock_class+0x4e/0x130 [ 50.327277][ T663] ? mark_lock+0x38/0x3e0 [ 50.327401][ T663] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 50.327594][ T663] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 50.327796][ T663] ? kfree+0xf3/0x330 [ 50.327920][ T663] ? vlan_vid_del+0x310/0x5e0 [ 50.328079][ T663] ? vlan_vid_del+0x310/0x5e0 [ 50.328237][ T663] rtnl_dellink+0x348/0xa40 [ 50.328396][ T663] ? __pfx_rtnl_dellink+0x10/0x10 [ 50.328559][ T663] ? find_held_lock+0x2c/0x110 [ 50.328711][ T663] ? __lock_release+0x103/0x460 [ 50.328855][ T663] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 50.329015][ T663] ? __pfx___lock_release+0x10/0x10 [ 50.329174][ T663] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 50.329335][ T663] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 50.329495][ T663] ? __pfx_rtnl_dellink+0x10/0x10 [ 50.329648][ T663] rtnetlink_rcv_msg+0x712/0xc10 [ 50.329805][ T663] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 50.329953][ T663] ? hlock_class+0x4e/0x130 [ 50.330097][ T663] ? mark_lock+0x38/0x3e0 [ 50.330210][ T663] ? __lock_acquire+0xb9a/0x1680 [ 50.330365][ T663] netlink_rcv_skb+0x130/0x360 [ 50.330524][ T663] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 50.330685][ T663] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 50.330848][ T663] ? netlink_deliver_tap+0x13e/0x340 [ 50.330997][ T663] ? netlink_deliver_tap+0xc3/0x340 [ 50.331144][ T663] netlink_unicast+0x44b/0x710 [ 50.331292][ T663] ? __pfx_netlink_unicast+0x10/0x10 [ 50.331438][ T663] ? find_held_lock+0x2c/0x110 [ 50.331594][ T663] netlink_sendmsg+0x723/0xbe0 [ 50.331744][ T663] ? __pfx_netlink_sendmsg+0x10/0x10 [ 50.331891][ T663] ____sys_sendmsg+0x7ac/0xa10 [ 50.332040][ T663] ? __pfx_____sys_sendmsg+0x10/0x10 [ 50.332196][ T663] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 50.332382][ T663] ___sys_sendmsg+0xee/0x170 [ 50.332529][ T663] ? __pfx____sys_sendmsg+0x10/0x10 [ 50.332679][ T663] ? kasan_save_stack+0x34/0x50 [ 50.332827][ T663] ? kasan_save_stack+0x24/0x50 [ 50.332973][ T663] ? __kasan_record_aux_stack+0x8e/0xa0 [ 50.333121][ T663] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 50.333316][ T663] ? __x64_sys_close+0x7c/0xd0 [ 50.333472][ T663] ? do_syscall_64+0xc1/0x1d0 [ 50.333621][ T663] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 50.333815][ T663] ? __lock_acquire+0xb9a/0x1680 [ 50.333988][ T663] ? find_held_lock+0x2c/0x110 [ 50.334147][ T663] ? __lock_release+0x103/0x460 [ 50.334292][ T663] ? __virt_addr_valid+0x22b/0x430 [ 50.334444][ T663] ? __pfx___lock_release+0x10/0x10 [ 50.334598][ T663] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 50.334748][ T663] __sys_sendmsg+0x109/0x1a0 [ 50.334895][ T663] ? __pfx___sys_sendmsg+0x10/0x10 [ 50.335046][ T663] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 50.335257][ T663] do_syscall_64+0xc1/0x1d0 [ 50.335407][ T663] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 50.335603][ T663] RIP: 0033:0x7fec1acc69a7 [ 50.335780][ T663] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 50.336418][ T663] RSP: 002b:00007ffe1dfe1cc8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 50.336743][ T663] RAX: ffffffffffffffda RBX: 00007ffe1dfe23f0 RCX: 00007fec1acc69a7 [ 50.337079][ T663] RDX: 0000000000000000 RSI: 00007ffe1dfe1d30 RDI: 0000000000000005 [ 50.337425][ T663] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 50.337783][ T663] R10: 00007fec1ab84ef8 R11: 0000000000000246 R12: 0000000000000002 [ 50.338121][ T663] R13: 00000000677900b4 R14: 0000000000498600 R15: 0000000000000000 [ 50.338481][ T663] [ 50.363707][ T663] ip (663) used greatest stack depth: 24008 bytes left