[ 13.665606][ T308] 8021q: 802.1Q VLAN Support v1.8 [ 16.931856][ T380] GACT probability NOT on [ 18.328108][ T415] br10: port 1(veth1.10) entered blocking state [ 18.328820][ T415] br10: port 1(veth1.10) entered disabled state [ 18.329198][ T415] veth1.10: entered allmulticast mode [ 18.329389][ T415] veth1: entered allmulticast mode [ 18.331399][ T415] veth1.10: entered promiscuous mode [ 18.331598][ T415] veth1: entered promiscuous mode [ 18.810095][ T432] br11: port 1(veth1.11) entered blocking state [ 18.810414][ T432] br11: port 1(veth1.11) entered disabled state [ 18.810703][ T432] veth1.11: entered allmulticast mode [ 18.812612][ T432] veth1.11: entered promiscuous mode [ 19.641166][ T462] br10: port 2(veth2.10) entered blocking state [ 19.641493][ T462] br10: port 2(veth2.10) entered disabled state [ 19.641788][ T462] veth2.10: entered allmulticast mode [ 19.641981][ T462] veth2: entered allmulticast mode [ 19.644008][ T462] veth2.10: entered promiscuous mode [ 19.644771][ T462] veth2: entered promiscuous mode [ 20.155980][ T479] br11: port 2(veth2.11) entered blocking state [ 20.156515][ T479] br11: port 2(veth2.11) entered disabled state [ 20.156952][ T479] veth2.11: entered allmulticast mode [ 20.160131][ T479] veth2.11: entered promiscuous mode [ 20.563213][ T491] br10: port 2(veth2.10) entered blocking state [ 20.563622][ T491] br10: port 2(veth2.10) entered forwarding state [ 20.564349][ T491] br10: port 1(veth1.10) entered blocking state [ 20.564612][ T491] br10: port 1(veth1.10) entered forwarding state [ 20.689278][ T496] br11: port 2(veth2.11) entered blocking state [ 20.689624][ T496] br11: port 2(veth2.11) entered forwarding state [ 20.690097][ T496] br11: port 1(veth1.11) entered blocking state [ 20.690388][ T496] br11: port 1(veth1.11) entered forwarding state [ 101.511221][ T839] br11: port 2(veth2.11) entered disabled state [ 101.512885][ T839] br11: port 1(veth1.11) entered disabled state [ 101.614914][ T841] br10: port 2(veth2.10) entered disabled state [ 101.615511][ T841] br10: port 1(veth1.10) entered disabled state [ 101.808703][ T845] veth2.11: left allmulticast mode [ 101.808934][ T845] veth2.11: left promiscuous mode [ 101.809299][ T845] br11: port 2(veth2.11) entered disabled state [ 102.022003][ T849] veth2: left allmulticast mode [ 102.022607][ T849] veth2: left promiscuous mode [ 102.114196][ T853] veth2.10: left allmulticast mode [ 102.114489][ T853] veth2.10: left promiscuous mode [ 102.114800][ T853] br10: port 2(veth2.10) entered disabled state [ 102.654226][ T863] veth1.11: left allmulticast mode [ 102.654458][ T863] veth1.11: left promiscuous mode [ 102.654795][ T863] br11: port 1(veth1.11) entered disabled state [ 102.863390][ T867] veth1: left allmulticast mode [ 102.863664][ T867] veth1: left promiscuous mode [ 102.967687][ T869] veth1.10: left allmulticast mode [ 102.967926][ T869] veth1.10: left promiscuous mode [ 102.968298][ T869] br10: port 1(veth1.10) entered disabled state [ 103.936493][ T883] [ 103.936681][ T883] ============================================ [ 103.936910][ T883] WARNING: possible recursive locking detected [ 103.937143][ T883] 6.13.0-rc5-virtme #1 Not tainted [ 103.937322][ T883] -------------------------------------------- [ 103.937536][ T883] ip/883 is trying to acquire lock: [ 103.937711][ T883] ffffffff8f7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 103.938072][ T883] [ 103.938072][ T883] but task is already holding lock: [ 103.938326][ T883] ffffffff8f7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 103.938679][ T883] [ 103.938679][ T883] other info that might help us debug this: [ 103.938934][ T883] Possible unsafe locking scenario: [ 103.938934][ T883] [ 103.939194][ T883] CPU0 [ 103.939328][ T883] ---- [ 103.939459][ T883] lock((netdev_chain).rwsem); [ 103.939638][ T883] lock((netdev_chain).rwsem); [ 103.939814][ T883] [ 103.939814][ T883] *** DEADLOCK *** [ 103.939814][ T883] [ 103.940071][ T883] May be due to missing lock nesting notation [ 103.940071][ T883] [ 103.940331][ T883] 2 locks held by ip/883: [ 103.940493][ T883] #0: ffffffff8f7e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 103.940928][ T883] #1: ffffffff8f7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 103.941416][ T883] [ 103.941416][ T883] stack backtrace: [ 103.941722][ T883] CPU: 0 UID: 0 PID: 883 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 103.942108][ T883] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 103.942421][ T883] Call Trace: [ 103.942616][ T883] [ 103.942752][ T883] dump_stack_lvl+0x82/0xd0 [ 103.943011][ T883] print_deadlock_bug+0x40a/0x650 [ 103.943277][ T883] validate_chain+0x5bf/0xae0 [ 103.943553][ T883] ? __pfx_validate_chain+0x10/0x10 [ 103.943808][ T883] ? hlock_class+0x4e/0x130 [ 103.944066][ T883] ? mark_lock+0x38/0x3e0 [ 103.944258][ T883] __lock_acquire+0xb9a/0x1680 [ 103.944512][ T883] lock_acquire.part.0+0xeb/0x330 [ 103.944767][ T883] ? blocking_notifier_call_chain+0x50/0x90 [ 103.945086][ T883] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 103.945415][ T883] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 103.945670][ T883] ? trace_lock_acquire+0x14c/0x1f0 [ 103.945916][ T883] ? lock_acquire+0x32/0xc0 [ 103.946170][ T883] ? blocking_notifier_call_chain+0x50/0x90 [ 103.946496][ T883] down_read+0x9f/0x340 [ 103.946686][ T883] ? blocking_notifier_call_chain+0x50/0x90 [ 103.946968][ T883] ? __pfx_down_read+0x10/0x10 [ 103.947145][ T883] ? __lock_release+0x103/0x460 [ 103.947331][ T883] ? netconsole_netdev_event+0x2c1/0x620 [ 103.947518][ T883] ? __pfx___lock_release+0x10/0x10 [ 103.947696][ T883] blocking_notifier_call_chain+0x50/0x90 [ 103.947873][ T883] __netdev_upper_dev_unlink+0xd9/0x220 [ 103.948049][ T883] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 103.948269][ T883] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 103.948463][ T883] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 103.948681][ T883] ? rtnl_is_locked+0x15/0x20 [ 103.948861][ T883] netdev_upper_dev_unlink+0x71/0xa0 [ 103.949036][ T883] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 103.949252][ T883] ? netconsole_netdev_event+0x2c1/0x620 [ 103.949433][ T883] ? mutex_is_locked+0x1c/0x60 [ 103.949618][ T883] ? rtnl_is_locked+0x15/0x20 [ 103.949799][ T883] ? netdev_master_upper_dev_get+0x13/0x120 [ 103.950022][ T883] vrf_device_event+0x78/0xe0 [vrf] [ 103.950198][ T883] notifier_call_chain+0xcd/0x150 [ 103.950384][ T883] blocking_notifier_call_chain+0x66/0x90 [ 103.950560][ T883] unregister_netdevice_many_notify+0xa7b/0x1580 [ 103.950776][ T883] ? hlock_class+0x4e/0x130 [ 103.950955][ T883] ? mark_lock+0x38/0x3e0 [ 103.951089][ T883] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 103.951305][ T883] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 103.951594][ T883] ? kfree+0xf3/0x330 [ 103.951731][ T883] ? vlan_vid_del+0x310/0x5e0 [ 103.951926][ T883] ? vlan_vid_del+0x310/0x5e0 [ 103.952101][ T883] rtnl_dellink+0x348/0xa40 [ 103.952281][ T883] ? __pfx_rtnl_dellink+0x10/0x10 [ 103.952487][ T883] ? find_held_lock+0x2c/0x110 [ 103.952667][ T883] ? __lock_release+0x103/0x460 [ 103.952841][ T883] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 103.953016][ T883] ? __pfx___lock_release+0x10/0x10 [ 103.953192][ T883] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 103.953379][ T883] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 103.953553][ T883] ? __pfx_rtnl_dellink+0x10/0x10 [ 103.953736][ T883] rtnetlink_rcv_msg+0x712/0xc10 [ 103.953914][ T883] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 103.954087][ T883] ? hlock_class+0x4e/0x130 [ 103.954259][ T883] ? mark_lock+0x38/0x3e0 [ 103.954405][ T883] ? __lock_acquire+0xb9a/0x1680 [ 103.954589][ T883] netlink_rcv_skb+0x130/0x360 [ 103.954766][ T883] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 103.954947][ T883] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 103.955128][ T883] ? netlink_deliver_tap+0x13e/0x340 [ 103.955310][ T883] ? netlink_deliver_tap+0xc3/0x340 [ 103.955496][ T883] netlink_unicast+0x44b/0x710 [ 103.955671][ T883] ? __pfx_netlink_unicast+0x10/0x10 [ 103.955845][ T883] ? find_held_lock+0x2c/0x110 [ 103.956025][ T883] netlink_sendmsg+0x723/0xbe0 [ 103.956202][ T883] ? __pfx_netlink_sendmsg+0x10/0x10 [ 103.956389][ T883] ____sys_sendmsg+0x7ac/0xa10 [ 103.956567][ T883] ? __pfx_____sys_sendmsg+0x10/0x10 [ 103.956742][ T883] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 103.956962][ T883] ___sys_sendmsg+0xee/0x170 [ 103.957135][ T883] ? __pfx____sys_sendmsg+0x10/0x10 [ 103.957313][ T883] ? kasan_save_stack+0x34/0x50 [ 103.957502][ T883] ? kasan_save_stack+0x24/0x50 [ 103.957673][ T883] ? __kasan_record_aux_stack+0x8e/0xa0 [ 103.957851][ T883] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 103.958070][ T883] ? __x64_sys_close+0x7c/0xd0 [ 103.958247][ T883] ? do_syscall_64+0xc1/0x1d0 [ 103.958440][ T883] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 103.958664][ T883] ? __lock_acquire+0xb9a/0x1680 [ 103.958843][ T883] ? find_held_lock+0x2c/0x110 [ 103.959027][ T883] ? __lock_release+0x103/0x460 [ 103.959199][ T883] ? __virt_addr_valid+0x22b/0x430 [ 103.959385][ T883] ? __pfx___lock_release+0x10/0x10 [ 103.959560][ T883] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 103.959740][ T883] __sys_sendmsg+0x109/0x1a0 [ 103.959915][ T883] ? __pfx___sys_sendmsg+0x10/0x10 [ 103.960093][ T883] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 103.960335][ T883] do_syscall_64+0xc1/0x1d0 [ 103.960513][ T883] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 103.960728][ T883] RIP: 0033:0x7f0d54a3c9a7 [ 103.960912][ T883] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 103.961537][ T883] RSP: 002b:00007ffd0e9681f8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 103.961813][ T883] RAX: ffffffffffffffda RBX: 00007ffd0e968920 RCX: 00007f0d54a3c9a7 [ 103.962057][ T883] RDX: 0000000000000000 RSI: 00007ffd0e968260 RDI: 0000000000000005 [ 103.962298][ T883] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 103.962585][ T883] R10: 00007f0d548faef8 R11: 0000000000000246 R12: 0000000000000002 [ 103.962832][ T883] R13: 000000006779568c R14: 0000000000498600 R15: 0000000000000000 [ 103.963081][ T883]