[ 51.206070][ T758] 8021q: 802.1Q VLAN Support v1.8 [ 53.842474][ T793] br0: port 1(veth1) entered blocking state [ 53.843007][ T793] br0: port 1(veth1) entered disabled state [ 53.843335][ T793] veth1: entered allmulticast mode [ 53.845844][ T793] veth1: entered promiscuous mode [ 53.935447][ T39] br0: port 1(veth1) entered blocking state [ 53.936063][ T39] br0: port 1(veth1) entered forwarding state [ 54.110823][ T796] br0: port 2(veth2) entered blocking state [ 54.111184][ T796] br0: port 2(veth2) entered disabled state [ 54.112183][ T796] veth2: entered allmulticast mode [ 54.114718][ T796] veth2: entered promiscuous mode [ 54.214062][ T136] br0: port 2(veth2) entered blocking state [ 54.214426][ T136] br0: port 2(veth2) entered forwarding state [ 123.183032][ T2579] br0: port 2(veth2) entered disabled state [ 123.293067][ T2581] veth2: left allmulticast mode [ 123.293401][ T2581] veth2: left promiscuous mode [ 123.293764][ T2581] br0: port 2(veth2) entered disabled state [ 123.375047][ T2582] br0: port 1(veth1) entered disabled state [ 123.456197][ T2583] veth1: left allmulticast mode [ 123.456634][ T2583] veth1: left promiscuous mode [ 123.457020][ T2583] br0: port 1(veth1) entered disabled state [ 124.203010][ T2601] br0: port 1(veth1) entered blocking state [ 124.203404][ T2601] br0: port 1(veth1) entered disabled state [ 124.203704][ T2601] veth1: entered allmulticast mode [ 124.205880][ T2601] veth1: entered promiscuous mode [ 124.285157][ T151] br0: port 1(veth1) entered blocking state [ 124.285470][ T151] br0: port 1(veth1) entered forwarding state [ 124.632292][ T2606] br0: port 2(veth2) entered blocking state [ 124.632748][ T2606] br0: port 2(veth2) entered disabled state [ 124.633070][ T2606] veth2: entered allmulticast mode [ 124.635037][ T2606] veth2: entered promiscuous mode [ 124.714036][ T151] br0: port 2(veth2) entered blocking state [ 124.714367][ T151] br0: port 2(veth2) entered forwarding state [ 194.736662][ T4398] br0: port 2(veth2) entered disabled state [ 194.803217][ T4399] veth2: left allmulticast mode [ 194.803765][ T4399] veth2: left promiscuous mode [ 194.804076][ T4399] br0: port 2(veth2) entered disabled state [ 194.889498][ T4400] br0: port 1(veth1) entered disabled state [ 194.968134][ T4401] veth1: left allmulticast mode [ 194.968398][ T4401] veth1: left promiscuous mode [ 194.968719][ T4401] br0: port 1(veth1) entered disabled state [ 195.685336][ T4419] br0: port 1(veth1) entered blocking state [ 195.685630][ T4419] br0: port 1(veth1) entered disabled state [ 195.685914][ T4419] veth1: entered allmulticast mode [ 195.688270][ T4419] veth1: entered promiscuous mode [ 195.767410][ T39] br0: port 1(veth1) entered blocking state [ 195.767886][ T39] br0: port 1(veth1) entered forwarding state [ 196.076865][ T4424] br0: port 2(veth2) entered blocking state [ 196.077178][ T4424] br0: port 2(veth2) entered disabled state [ 196.077751][ T4424] veth2: entered allmulticast mode [ 196.079967][ T4424] veth2: entered promiscuous mode [ 196.158998][ T55] br0: port 2(veth2) entered blocking state [ 196.159277][ T55] br0: port 2(veth2) entered forwarding state [ 342.580064][ T8274] br0: port 2(veth2) entered disabled state [ 342.651127][ T8275] veth2: left allmulticast mode [ 342.651384][ T8275] veth2: left promiscuous mode [ 342.652070][ T8275] br0: port 2(veth2) entered disabled state [ 342.733202][ T8276] br0: port 1(veth1) entered disabled state [ 342.818911][ T8277] veth1: left allmulticast mode [ 342.819223][ T8277] veth1: left promiscuous mode [ 342.819603][ T8277] br0: port 1(veth1) entered disabled state [ 343.936611][ T8298] [ 343.936843][ T8298] ============================================ [ 343.937035][ T8298] WARNING: possible recursive locking detected [ 343.937225][ T8298] 6.13.0-rc5-virtme #1 Not tainted [ 343.937384][ T8298] -------------------------------------------- [ 343.937570][ T8298] ip/8298 is trying to acquire lock: [ 343.937717][ T8298] ffffffffb7dd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 343.938042][ T8298] [ 343.938042][ T8298] but task is already holding lock: [ 343.938276][ T8298] ffffffffb7dd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 343.938569][ T8298] [ 343.938569][ T8298] other info that might help us debug this: [ 343.938781][ T8298] Possible unsafe locking scenario: [ 343.938781][ T8298] [ 343.939002][ T8298] CPU0 [ 343.939114][ T8298] ---- [ 343.939222][ T8298] lock((netdev_chain).rwsem); [ 343.939368][ T8298] lock((netdev_chain).rwsem); [ 343.939515][ T8298] [ 343.939515][ T8298] *** DEADLOCK *** [ 343.939515][ T8298] [ 343.939728][ T8298] May be due to missing lock nesting notation [ 343.939728][ T8298] [ 343.939941][ T8298] 2 locks held by ip/8298: [ 343.940093][ T8298] #0: ffffffffb7de7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 343.940376][ T8298] #1: ffffffffb7dd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 343.940695][ T8298] [ 343.940695][ T8298] stack backtrace: [ 343.940889][ T8298] CPU: 3 UID: 0 PID: 8298 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 343.941110][ T8298] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 343.941303][ T8298] Call Trace: [ 343.941418][ T8298] [ 343.941497][ T8298] dump_stack_lvl+0x82/0xd0 [ 343.941656][ T8298] print_deadlock_bug+0x40a/0x650 [ 343.941807][ T8298] validate_chain+0x5bf/0xae0 [ 343.941957][ T8298] ? __pfx_validate_chain+0x10/0x10 [ 343.942108][ T8298] ? hlock_class+0x4e/0x130 [ 343.942255][ T8298] ? mark_lock+0x38/0x3e0 [ 343.942373][ T8298] __lock_acquire+0xb9a/0x1680 [ 343.942526][ T8298] lock_acquire.part.0+0xeb/0x330 [ 343.942675][ T8298] ? blocking_notifier_call_chain+0x50/0x90 [ 343.942860][ T8298] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 343.943045][ T8298] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 343.943199][ T8298] ? trace_lock_acquire+0x14c/0x1f0 [ 343.943356][ T8298] ? lock_acquire+0x32/0xc0 [ 343.943509][ T8298] ? blocking_notifier_call_chain+0x50/0x90 [ 343.943692][ T8298] down_read+0x9f/0x340 [ 343.943805][ T8298] ? blocking_notifier_call_chain+0x50/0x90 [ 343.943987][ T8298] ? __pfx_down_read+0x10/0x10 [ 343.944149][ T8298] ? __lock_release+0x103/0x460 [ 343.944296][ T8298] ? netconsole_netdev_event+0x2c1/0x620 [ 343.944444][ T8298] ? __pfx___lock_release+0x10/0x10 [ 343.944600][ T8298] blocking_notifier_call_chain+0x50/0x90 [ 343.944749][ T8298] __netdev_upper_dev_unlink+0xd9/0x220 [ 343.944899][ T8298] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 343.945095][ T8298] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 343.945246][ T8298] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 343.945428][ T8298] ? rtnl_is_locked+0x15/0x20 [ 343.945581][ T8298] netdev_upper_dev_unlink+0x71/0xa0 [ 343.945739][ T8298] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 343.945920][ T8298] ? netconsole_netdev_event+0x2c1/0x620 [ 343.946076][ T8298] ? mutex_is_locked+0x1c/0x60 [ 343.946223][ T8298] ? rtnl_is_locked+0x15/0x20 [ 343.946369][ T8298] ? netdev_master_upper_dev_get+0x13/0x120 [ 343.946552][ T8298] vrf_device_event+0x78/0xe0 [vrf] [ 343.946720][ T8298] notifier_call_chain+0xcd/0x150 [ 343.946867][ T8298] blocking_notifier_call_chain+0x66/0x90 [ 343.947022][ T8298] unregister_netdevice_many_notify+0xa7b/0x1580 [ 343.947216][ T8298] ? hlock_class+0x4e/0x130 [ 343.947361][ T8298] ? mark_lock+0x38/0x3e0 [ 343.947473][ T8298] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 343.947656][ T8298] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 343.947855][ T8298] ? kfree+0xf3/0x330 [ 343.947968][ T8298] ? vlan_vid_del+0x310/0x5e0 [ 343.948120][ T8298] ? vlan_vid_del+0x310/0x5e0 [ 343.948268][ T8298] rtnl_dellink+0x348/0xa40 [ 343.948417][ T8298] ? __pfx_rtnl_dellink+0x10/0x10 [ 343.948577][ T8298] ? find_held_lock+0x2c/0x110 [ 343.948725][ T8298] ? __lock_release+0x103/0x460 [ 343.948869][ T8298] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 343.949022][ T8298] ? __pfx___lock_release+0x10/0x10 [ 343.949169][ T8298] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 343.949319][ T8298] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 343.949465][ T8298] ? __pfx_rtnl_dellink+0x10/0x10 [ 343.949610][ T8298] rtnetlink_rcv_msg+0x712/0xc10 [ 343.949757][ T8298] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 343.949903][ T8298] ? hlock_class+0x4e/0x130 [ 343.950054][ T8298] ? mark_lock+0x38/0x3e0 [ 343.950179][ T8298] ? __lock_acquire+0xb9a/0x1680 [ 343.950325][ T8298] netlink_rcv_skb+0x130/0x360 [ 343.950471][ T8298] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 343.950618][ T8298] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 343.950768][ T8298] ? netlink_deliver_tap+0x13e/0x340 [ 343.950916][ T8298] ? netlink_deliver_tap+0xc3/0x340 [ 343.951070][ T8298] netlink_unicast+0x44b/0x710 [ 343.951226][ T8298] ? __pfx_netlink_unicast+0x10/0x10 [ 343.951372][ T8298] ? find_held_lock+0x2c/0x110 [ 343.951520][ T8298] netlink_sendmsg+0x723/0xbe0 [ 343.951666][ T8298] ? __pfx_netlink_sendmsg+0x10/0x10 [ 343.951814][ T8298] ____sys_sendmsg+0x7ac/0xa10 [ 343.951960][ T8298] ? __pfx_____sys_sendmsg+0x10/0x10 [ 343.952112][ T8298] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 343.952308][ T8298] ___sys_sendmsg+0xee/0x170 [ 343.952459][ T8298] ? __pfx____sys_sendmsg+0x10/0x10 [ 343.952605][ T8298] ? kasan_save_stack+0x34/0x50 [ 343.952752][ T8298] ? kasan_save_stack+0x24/0x50 [ 343.952911][ T8298] ? __kasan_record_aux_stack+0x8e/0xa0 [ 343.953060][ T8298] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 343.953262][ T8298] ? __x64_sys_close+0x7c/0xd0 [ 343.953410][ T8298] ? do_syscall_64+0xc1/0x1d0 [ 343.953557][ T8298] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 343.953754][ T8298] ? __lock_acquire+0xb9a/0x1680 [ 343.953905][ T8298] ? find_held_lock+0x2c/0x110 [ 343.954069][ T8298] ? __lock_release+0x103/0x460 [ 343.954216][ T8298] ? __virt_addr_valid+0x22b/0x430 [ 343.954363][ T8298] ? __pfx___lock_release+0x10/0x10 [ 343.954516][ T8298] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 343.954668][ T8298] __sys_sendmsg+0x109/0x1a0 [ 343.954824][ T8298] ? __pfx___sys_sendmsg+0x10/0x10 [ 343.954973][ T8298] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 343.955174][ T8298] do_syscall_64+0xc1/0x1d0 [ 343.955320][ T8298] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 343.955517][ T8298] RIP: 0033:0x7f0b016559a7 [ 343.955686][ T8298] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 343.956231][ T8298] RSP: 002b:00007ffd6a6196a8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 343.956468][ T8298] RAX: ffffffffffffffda RBX: 00007ffd6a619dd0 RCX: 00007f0b016559a7 [ 343.956713][ T8298] RDX: 0000000000000000 RSI: 00007ffd6a619710 RDI: 0000000000000005 [ 343.956939][ T8298] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 343.957174][ T8298] R10: 00007f0b01513ef8 R11: 0000000000000246 R12: 0000000000000002 [ 343.957393][ T8298] R13: 000000006779029d R14: 0000000000498600 R15: 0000000000000000 [ 343.957618][ T8298]