[ 10.498693][ T259] ip (259) used greatest stack depth: 22984 bytes left [ 12.274204][ T306] 8021q: 802.1Q VLAN Support v1.8 [ 15.356405][ T376] GACT probability NOT on [ 16.626461][ T412] br10: port 1(veth1.10) entered blocking state [ 16.626900][ T412] br10: port 1(veth1.10) entered disabled state [ 16.627269][ T412] veth1.10: entered allmulticast mode [ 16.629245][ T412] veth1: entered allmulticast mode [ 16.632909][ T412] veth1.10: entered promiscuous mode [ 16.633215][ T412] veth1: entered promiscuous mode [ 17.091303][ T429] br11: port 1(veth1.11) entered blocking state [ 17.092063][ T429] br11: port 1(veth1.11) entered disabled state [ 17.092353][ T429] veth1.11: entered allmulticast mode [ 17.094244][ T429] veth1.11: entered promiscuous mode [ 17.870371][ T459] br10: port 2(veth2.10) entered blocking state [ 17.870670][ T459] br10: port 2(veth2.10) entered disabled state [ 17.870947][ T459] veth2.10: entered allmulticast mode [ 17.871122][ T459] veth2: entered allmulticast mode [ 17.873020][ T459] veth2.10: entered promiscuous mode [ 17.873212][ T459] veth2: entered promiscuous mode [ 18.335643][ T476] br11: port 2(veth2.11) entered blocking state [ 18.335964][ T476] br11: port 2(veth2.11) entered disabled state [ 18.336259][ T476] veth2.11: entered allmulticast mode [ 18.338315][ T476] veth2.11: entered promiscuous mode [ 18.715847][ T488] br10: port 2(veth2.10) entered blocking state [ 18.716242][ T488] br10: port 2(veth2.10) entered forwarding state [ 18.717035][ T488] br10: port 1(veth1.10) entered blocking state [ 18.717297][ T488] br10: port 1(veth1.10) entered forwarding state [ 18.835887][ T493] br11: port 2(veth2.11) entered blocking state [ 18.836178][ T493] br11: port 2(veth2.11) entered forwarding state [ 18.836663][ T493] br11: port 1(veth1.11) entered blocking state [ 18.836910][ T493] br11: port 1(veth1.11) entered forwarding state [ 45.171955][ T619] br11: port 2(veth2.11) entered disabled state [ 45.173056][ T619] br11: port 1(veth1.11) entered disabled state [ 45.254825][ T621] br10: port 2(veth2.10) entered disabled state [ 45.255394][ T621] br10: port 1(veth1.10) entered disabled state [ 45.448191][ T625] veth2.11: left allmulticast mode [ 45.448421][ T625] veth2.11: left promiscuous mode [ 45.449218][ T625] br11: port 2(veth2.11) entered disabled state [ 45.672804][ T629] veth2: left allmulticast mode [ 45.673035][ T629] veth2: left promiscuous mode [ 45.755761][ T633] veth2.10: left allmulticast mode [ 45.755988][ T633] veth2.10: left promiscuous mode [ 45.756300][ T633] br10: port 2(veth2.10) entered disabled state [ 46.245077][ T643] veth1.11: left allmulticast mode [ 46.245300][ T643] veth1.11: left promiscuous mode [ 46.245640][ T643] br11: port 1(veth1.11) entered disabled state [ 46.481237][ T647] veth1: left allmulticast mode [ 46.481466][ T647] veth1: left promiscuous mode [ 46.568690][ T649] veth1.10: left allmulticast mode [ 46.568954][ T649] veth1.10: left promiscuous mode [ 46.569283][ T649] br10: port 1(veth1.10) entered disabled state [ 47.415625][ T663] [ 47.415778][ T663] ============================================ [ 47.415973][ T663] WARNING: possible recursive locking detected [ 47.416156][ T663] 6.13.0-rc5-virtme #1 Not tainted [ 47.416320][ T663] -------------------------------------------- [ 47.416500][ T663] ip/663 is trying to acquire lock: [ 47.416652][ T663] ffffffffa35d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 47.416969][ T663] [ 47.416969][ T663] but task is already holding lock: [ 47.417199][ T663] ffffffffa35d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 47.417512][ T663] [ 47.417512][ T663] other info that might help us debug this: [ 47.417732][ T663] Possible unsafe locking scenario: [ 47.417732][ T663] [ 47.417959][ T663] CPU0 [ 47.418069][ T663] ---- [ 47.418177][ T663] lock((netdev_chain).rwsem); [ 47.418340][ T663] lock((netdev_chain).rwsem); [ 47.418493][ T663] [ 47.418493][ T663] *** DEADLOCK *** [ 47.418493][ T663] [ 47.418703][ T663] May be due to missing lock nesting notation [ 47.418703][ T663] [ 47.418912][ T663] 2 locks held by ip/663: [ 47.419023][ T663] #0: ffffffffa35e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 47.419284][ T663] #1: ffffffffa35d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 47.419596][ T663] [ 47.419596][ T663] stack backtrace: [ 47.419774][ T663] CPU: 3 UID: 0 PID: 663 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 47.419991][ T663] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 47.420172][ T663] Call Trace: [ 47.420320][ T663] [ 47.420475][ T663] dump_stack_lvl+0x82/0xd0 [ 47.420626][ T663] print_deadlock_bug+0x40a/0x650 [ 47.420772][ T663] validate_chain+0x5bf/0xae0 [ 47.420918][ T663] ? __pfx_validate_chain+0x10/0x10 [ 47.421063][ T663] ? hlock_class+0x4e/0x130 [ 47.421209][ T663] ? mark_lock+0x38/0x3e0 [ 47.421320][ T663] __lock_acquire+0xb9a/0x1680 [ 47.421468][ T663] lock_acquire.part.0+0xeb/0x330 [ 47.421617][ T663] ? blocking_notifier_call_chain+0x50/0x90 [ 47.421796][ T663] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 47.421979][ T663] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 47.422126][ T663] ? trace_lock_acquire+0x14c/0x1f0 [ 47.422273][ T663] ? lock_acquire+0x32/0xc0 [ 47.422417][ T663] ? blocking_notifier_call_chain+0x50/0x90 [ 47.422600][ T663] down_read+0x9f/0x340 [ 47.422715][ T663] ? blocking_notifier_call_chain+0x50/0x90 [ 47.422896][ T663] ? __pfx_down_read+0x10/0x10 [ 47.423041][ T663] ? __lock_release+0x103/0x460 [ 47.423188][ T663] ? netconsole_netdev_event+0x2c1/0x620 [ 47.423334][ T663] ? __pfx___lock_release+0x10/0x10 [ 47.423478][ T663] blocking_notifier_call_chain+0x50/0x90 [ 47.423625][ T663] __netdev_upper_dev_unlink+0xd9/0x220 [ 47.423778][ T663] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 47.423957][ T663] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 47.424103][ T663] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 47.424283][ T663] ? rtnl_is_locked+0x15/0x20 [ 47.424431][ T663] netdev_upper_dev_unlink+0x71/0xa0 [ 47.424577][ T663] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 47.424767][ T663] ? netconsole_netdev_event+0x2c1/0x620 [ 47.424914][ T663] ? mutex_is_locked+0x1c/0x60 [ 47.425060][ T663] ? rtnl_is_locked+0x15/0x20 [ 47.425206][ T663] ? netdev_master_upper_dev_get+0x13/0x120 [ 47.425385][ T663] vrf_device_event+0x78/0xe0 [vrf] [ 47.425535][ T663] notifier_call_chain+0xcd/0x150 [ 47.425690][ T663] blocking_notifier_call_chain+0x66/0x90 [ 47.425843][ T663] unregister_netdevice_many_notify+0xa7b/0x1580 [ 47.426024][ T663] ? hlock_class+0x4e/0x130 [ 47.426169][ T663] ? mark_lock+0x38/0x3e0 [ 47.426280][ T663] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 47.426460][ T663] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 47.426644][ T663] ? kfree+0xf3/0x330 [ 47.426756][ T663] ? vlan_vid_del+0x310/0x5e0 [ 47.426906][ T663] ? vlan_vid_del+0x310/0x5e0 [ 47.427052][ T663] rtnl_dellink+0x348/0xa40 [ 47.427197][ T663] ? __pfx_rtnl_dellink+0x10/0x10 [ 47.427357][ T663] ? find_held_lock+0x2c/0x110 [ 47.427503][ T663] ? __lock_release+0x103/0x460 [ 47.427648][ T663] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 47.427793][ T663] ? __pfx___lock_release+0x10/0x10 [ 47.427938][ T663] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 47.428090][ T663] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 47.428235][ T663] ? __pfx_rtnl_dellink+0x10/0x10 [ 47.428380][ T663] rtnetlink_rcv_msg+0x712/0xc10 [ 47.428527][ T663] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 47.428671][ T663] ? hlock_class+0x4e/0x130 [ 47.428817][ T663] ? mark_lock+0x38/0x3e0 [ 47.428927][ T663] ? __lock_acquire+0xb9a/0x1680 [ 47.429079][ T663] netlink_rcv_skb+0x130/0x360 [ 47.429225][ T663] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 47.429376][ T663] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 47.429525][ T663] ? netlink_deliver_tap+0x13e/0x340 [ 47.429677][ T663] ? netlink_deliver_tap+0xc3/0x340 [ 47.429824][ T663] netlink_unicast+0x44b/0x710 [ 47.429971][ T663] ? __pfx_netlink_unicast+0x10/0x10 [ 47.430126][ T663] ? find_held_lock+0x2c/0x110 [ 47.430275][ T663] netlink_sendmsg+0x723/0xbe0 [ 47.430423][ T663] ? __pfx_netlink_sendmsg+0x10/0x10 [ 47.430569][ T663] ____sys_sendmsg+0x7ac/0xa10 [ 47.430718][ T663] ? __pfx_____sys_sendmsg+0x10/0x10 [ 47.430863][ T663] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 47.431060][ T663] ___sys_sendmsg+0xee/0x170 [ 47.431213][ T663] ? __pfx____sys_sendmsg+0x10/0x10 [ 47.431360][ T663] ? kasan_save_stack+0x34/0x50 [ 47.431507][ T663] ? kasan_save_stack+0x24/0x50 [ 47.431651][ T663] ? __kasan_record_aux_stack+0x8e/0xa0 [ 47.431796][ T663] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 47.431980][ T663] ? __x64_sys_close+0x7c/0xd0 [ 47.432123][ T663] ? do_syscall_64+0xc1/0x1d0 [ 47.432268][ T663] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 47.432454][ T663] ? __lock_acquire+0xb9a/0x1680 [ 47.432604][ T663] ? find_held_lock+0x2c/0x110 [ 47.432751][ T663] ? __lock_release+0x103/0x460 [ 47.432894][ T663] ? __virt_addr_valid+0x22b/0x430 [ 47.433040][ T663] ? __pfx___lock_release+0x10/0x10 [ 47.433185][ T663] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 47.433332][ T663] __sys_sendmsg+0x109/0x1a0 [ 47.433480][ T663] ? __pfx___sys_sendmsg+0x10/0x10 [ 47.433625][ T663] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 47.433810][ T663] do_syscall_64+0xc1/0x1d0 [ 47.433954][ T663] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 47.434136][ T663] RIP: 0033:0x7f7f7e8129a7 [ 47.434289][ T663] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 47.434800][ T663] RSP: 002b:00007ffee716d068 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 47.435021][ T663] RAX: ffffffffffffffda RBX: 00007ffee716d790 RCX: 00007f7f7e8129a7 [ 47.435237][ T663] RDX: 0000000000000000 RSI: 00007ffee716d0d0 RDI: 0000000000000005 [ 47.435461][ T663] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 47.435691][ T663] R10: 00007f7f7e6d0ef8 R11: 0000000000000246 R12: 0000000000000002 [ 47.435909][ T663] R13: 000000006779040f R14: 0000000000498600 R15: 0000000000000000 [ 47.436133][ T663]