[ 10.800085][ T251] ip (251) used greatest stack depth: 23792 bytes left [ 12.982443][ T308] 8021q: 802.1Q VLAN Support v1.8 [ 16.107377][ T378] GACT probability NOT on [ 16.146390][ T376] tc (376) used greatest stack depth: 23696 bytes left [ 17.342152][ T414] br10: port 1(veth1.10) entered blocking state [ 17.342581][ T414] br10: port 1(veth1.10) entered disabled state [ 17.342935][ T414] veth1.10: entered allmulticast mode [ 17.343115][ T414] veth1: entered allmulticast mode [ 17.345163][ T414] veth1.10: entered promiscuous mode [ 17.345592][ T414] veth1: entered promiscuous mode [ 17.823696][ T431] br11: port 1(veth1.11) entered blocking state [ 17.824007][ T431] br11: port 1(veth1.11) entered disabled state [ 17.824302][ T431] veth1.11: entered allmulticast mode [ 17.826229][ T431] veth1.11: entered promiscuous mode [ 18.593423][ T461] br10: port 2(veth2.10) entered blocking state [ 18.593744][ T461] br10: port 2(veth2.10) entered disabled state [ 18.594011][ T461] veth2.10: entered allmulticast mode [ 18.594575][ T461] veth2: entered allmulticast mode [ 18.605313][ T461] veth2.10: entered promiscuous mode [ 18.605521][ T461] veth2: entered promiscuous mode [ 19.081002][ T478] br11: port 2(veth2.11) entered blocking state [ 19.081291][ T478] br11: port 2(veth2.11) entered disabled state [ 19.081562][ T478] veth2.11: entered allmulticast mode [ 19.084628][ T478] veth2.11: entered promiscuous mode [ 19.468226][ T490] br10: port 2(veth2.10) entered blocking state [ 19.468632][ T490] br10: port 2(veth2.10) entered forwarding state [ 19.469288][ T490] br10: port 1(veth1.10) entered blocking state [ 19.469546][ T490] br10: port 1(veth1.10) entered forwarding state [ 19.574388][ T495] br11: port 2(veth2.11) entered blocking state [ 19.574688][ T495] br11: port 2(veth2.11) entered forwarding state [ 19.575126][ T495] br11: port 1(veth1.11) entered blocking state [ 19.575382][ T495] br11: port 1(veth1.11) entered forwarding state [ 99.991702][ T838] br11: port 2(veth2.11) entered disabled state [ 99.992746][ T838] br11: port 1(veth1.11) entered disabled state [ 100.083431][ T840] br10: port 2(veth2.10) entered disabled state [ 100.083994][ T840] br10: port 1(veth1.10) entered disabled state [ 100.283535][ T844] veth2.11: left allmulticast mode [ 100.283777][ T844] veth2.11: left promiscuous mode [ 100.284125][ T844] br11: port 2(veth2.11) entered disabled state [ 100.495878][ T848] veth2: left allmulticast mode [ 100.496107][ T848] veth2: left promiscuous mode [ 100.589476][ T852] veth2.10: left allmulticast mode [ 100.589693][ T852] veth2.10: left promiscuous mode [ 100.590001][ T852] br10: port 2(veth2.10) entered disabled state [ 101.087968][ T862] veth1.11: left allmulticast mode [ 101.089027][ T862] veth1.11: left promiscuous mode [ 101.089585][ T862] br11: port 1(veth1.11) entered disabled state [ 101.293351][ T866] veth1: left allmulticast mode [ 101.293632][ T866] veth1: left promiscuous mode [ 101.386534][ T868] veth1.10: left allmulticast mode [ 101.386794][ T868] veth1.10: left promiscuous mode [ 101.387124][ T868] br10: port 1(veth1.10) entered disabled state [ 102.245411][ T883] [ 102.245571][ T883] ============================================ [ 102.245758][ T883] WARNING: possible recursive locking detected [ 102.245936][ T883] 6.13.0-rc5-virtme #1 Not tainted [ 102.246088][ T883] -------------------------------------------- [ 102.246287][ T883] ip/883 is trying to acquire lock: [ 102.246437][ T883] ffffffffa8bd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 102.246736][ T883] [ 102.246736][ T883] but task is already holding lock: [ 102.246950][ T883] ffffffffa8bd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 102.247240][ T883] [ 102.247240][ T883] other info that might help us debug this: [ 102.247452][ T883] Possible unsafe locking scenario: [ 102.247452][ T883] [ 102.247665][ T883] CPU0 [ 102.247772][ T883] ---- [ 102.247880][ T883] lock((netdev_chain).rwsem); [ 102.248025][ T883] lock((netdev_chain).rwsem); [ 102.248170][ T883] [ 102.248170][ T883] *** DEADLOCK *** [ 102.248170][ T883] [ 102.248382][ T883] May be due to missing lock nesting notation [ 102.248382][ T883] [ 102.248592][ T883] 2 locks held by ip/883: [ 102.248704][ T883] #0: ffffffffa8be7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 102.248973][ T883] #1: ffffffffa8bd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 102.249271][ T883] [ 102.249271][ T883] stack backtrace: [ 102.249451][ T883] CPU: 2 UID: 0 PID: 883 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 102.249669][ T883] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 102.249857][ T883] Call Trace: [ 102.249966][ T883] [ 102.250041][ T883] dump_stack_lvl+0x82/0xd0 [ 102.250192][ T883] print_deadlock_bug+0x40a/0x650 [ 102.250342][ T883] validate_chain+0x5bf/0xae0 [ 102.250488][ T883] ? __pfx_validate_chain+0x10/0x10 [ 102.250635][ T883] ? hlock_class+0x4e/0x130 [ 102.250782][ T883] ? mark_lock+0x38/0x3e0 [ 102.250894][ T883] __lock_acquire+0xb9a/0x1680 [ 102.251046][ T883] lock_acquire.part.0+0xeb/0x330 [ 102.251190][ T883] ? blocking_notifier_call_chain+0x50/0x90 [ 102.251368][ T883] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 102.251553][ T883] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 102.251697][ T883] ? trace_lock_acquire+0x14c/0x1f0 [ 102.251842][ T883] ? lock_acquire+0x32/0xc0 [ 102.251986][ T883] ? blocking_notifier_call_chain+0x50/0x90 [ 102.252183][ T883] down_read+0x9f/0x340 [ 102.252294][ T883] ? blocking_notifier_call_chain+0x50/0x90 [ 102.252471][ T883] ? __pfx_down_read+0x10/0x10 [ 102.252615][ T883] ? __lock_release+0x103/0x460 [ 102.252760][ T883] ? netconsole_netdev_event+0x2c1/0x620 [ 102.252905][ T883] ? __pfx___lock_release+0x10/0x10 [ 102.253049][ T883] blocking_notifier_call_chain+0x50/0x90 [ 102.253197][ T883] __netdev_upper_dev_unlink+0xd9/0x220 [ 102.253343][ T883] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 102.253522][ T883] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 102.253667][ T883] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 102.253847][ T883] ? rtnl_is_locked+0x15/0x20 [ 102.253991][ T883] netdev_upper_dev_unlink+0x71/0xa0 [ 102.254149][ T883] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 102.254332][ T883] ? netconsole_netdev_event+0x2c1/0x620 [ 102.254481][ T883] ? mutex_is_locked+0x1c/0x60 [ 102.254628][ T883] ? rtnl_is_locked+0x15/0x20 [ 102.254770][ T883] ? netdev_master_upper_dev_get+0x13/0x120 [ 102.254950][ T883] vrf_device_event+0x78/0xe0 [vrf] [ 102.255098][ T883] notifier_call_chain+0xcd/0x150 [ 102.255252][ T883] blocking_notifier_call_chain+0x66/0x90 [ 102.255398][ T883] unregister_netdevice_many_notify+0xa7b/0x1580 [ 102.255577][ T883] ? hlock_class+0x4e/0x130 [ 102.255720][ T883] ? mark_lock+0x38/0x3e0 [ 102.255831][ T883] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 102.256010][ T883] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 102.256190][ T883] ? kfree+0xf3/0x330 [ 102.256304][ T883] ? vlan_vid_del+0x310/0x5e0 [ 102.256449][ T883] ? vlan_vid_del+0x310/0x5e0 [ 102.256596][ T883] rtnl_dellink+0x348/0xa40 [ 102.256742][ T883] ? __pfx_rtnl_dellink+0x10/0x10 [ 102.256900][ T883] ? find_held_lock+0x2c/0x110 [ 102.257045][ T883] ? __lock_release+0x103/0x460 [ 102.257188][ T883] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 102.257332][ T883] ? __pfx___lock_release+0x10/0x10 [ 102.257481][ T883] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 102.257626][ T883] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 102.257770][ T883] ? __pfx_rtnl_dellink+0x10/0x10 [ 102.257915][ T883] rtnetlink_rcv_msg+0x712/0xc10 [ 102.258059][ T883] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 102.258203][ T883] ? hlock_class+0x4e/0x130 [ 102.258348][ T883] ? mark_lock+0x38/0x3e0 [ 102.258462][ T883] ? __lock_acquire+0xb9a/0x1680 [ 102.258606][ T883] netlink_rcv_skb+0x130/0x360 [ 102.258751][ T883] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 102.258896][ T883] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 102.259043][ T883] ? netlink_deliver_tap+0x13e/0x340 [ 102.259190][ T883] ? netlink_deliver_tap+0xc3/0x340 [ 102.259343][ T883] netlink_unicast+0x44b/0x710 [ 102.259493][ T883] ? __pfx_netlink_unicast+0x10/0x10 [ 102.259637][ T883] ? find_held_lock+0x2c/0x110 [ 102.259784][ T883] netlink_sendmsg+0x723/0xbe0 [ 102.259927][ T883] ? __pfx_netlink_sendmsg+0x10/0x10 [ 102.260073][ T883] ____sys_sendmsg+0x7ac/0xa10 [ 102.260218][ T883] ? __pfx_____sys_sendmsg+0x10/0x10 [ 102.260362][ T883] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 102.260549][ T883] ___sys_sendmsg+0xee/0x170 [ 102.260694][ T883] ? __pfx____sys_sendmsg+0x10/0x10 [ 102.260840][ T883] ? kasan_save_stack+0x34/0x50 [ 102.260988][ T883] ? kasan_save_stack+0x24/0x50 [ 102.261132][ T883] ? __kasan_record_aux_stack+0x8e/0xa0 [ 102.261276][ T883] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 102.261459][ T883] ? __x64_sys_close+0x7c/0xd0 [ 102.261606][ T883] ? do_syscall_64+0xc1/0x1d0 [ 102.261750][ T883] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 102.261930][ T883] ? __lock_acquire+0xb9a/0x1680 [ 102.262075][ T883] ? find_held_lock+0x2c/0x110 [ 102.262221][ T883] ? __lock_release+0x103/0x460 [ 102.262364][ T883] ? __virt_addr_valid+0x22b/0x430 [ 102.262508][ T883] ? __pfx___lock_release+0x10/0x10 [ 102.262654][ T883] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 102.262804][ T883] __sys_sendmsg+0x109/0x1a0 [ 102.262948][ T883] ? __pfx___sys_sendmsg+0x10/0x10 [ 102.263091][ T883] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 102.263288][ T883] do_syscall_64+0xc1/0x1d0 [ 102.263432][ T883] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 102.263610][ T883] RIP: 0033:0x7f31bb0439a7 [ 102.263763][ T883] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 102.264286][ T883] RSP: 002b:00007ffcb9b58a28 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 102.264505][ T883] RAX: ffffffffffffffda RBX: 00007ffcb9b59150 RCX: 00007f31bb0439a7 [ 102.264725][ T883] RDX: 0000000000000000 RSI: 00007ffcb9b58a90 RDI: 0000000000000005 [ 102.264942][ T883] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 102.265156][ T883] R10: 00007f31baf01ef8 R11: 0000000000000246 R12: 0000000000000002 [ 102.265374][ T883] R13: 0000000067792dc8 R14: 0000000000498600 R15: 0000000000000000 [ 102.265594][ T883]