[ 18.125511][ T354] 8021q: 802.1Q VLAN Support v1.8 [ 18.652956][ T360] gre: GRE over IPv4 demultiplexor driver [ 18.732975][ T360] ip6_gre: GRE over IPv6 tunneling driver [ 18.908332][ T363] ip (363) used greatest stack depth: 24048 bytes left [ 19.021925][ T365] ip (365) used greatest stack depth: 23840 bytes left [ 29.016535][ T442] GACT probability NOT on [ 46.516709][ T656] [ 46.516899][ T656] ============================================ [ 46.517124][ T656] WARNING: possible recursive locking detected [ 46.517332][ T656] 6.13.0-rc5-virtme #1 Not tainted [ 46.517503][ T656] -------------------------------------------- [ 46.517708][ T656] ip/656 is trying to acquire lock: [ 46.517881][ T656] ffffffffa45d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 46.518230][ T656] [ 46.518230][ T656] but task is already holding lock: [ 46.518477][ T656] ffffffffa45d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 46.518809][ T656] [ 46.518809][ T656] other info that might help us debug this: [ 46.519057][ T656] Possible unsafe locking scenario: [ 46.519057][ T656] [ 46.519300][ T656] CPU0 [ 46.519424][ T656] ---- [ 46.519548][ T656] lock((netdev_chain).rwsem); [ 46.519722][ T656] lock((netdev_chain).rwsem); [ 46.519888][ T656] [ 46.519888][ T656] *** DEADLOCK *** [ 46.519888][ T656] [ 46.520133][ T656] May be due to missing lock nesting notation [ 46.520133][ T656] [ 46.520371][ T656] 2 locks held by ip/656: [ 46.520497][ T656] #0: ffffffffa45e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 46.520802][ T656] #1: ffffffffa45d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 46.521149][ T656] [ 46.521149][ T656] stack backtrace: [ 46.521360][ T656] CPU: 3 UID: 0 PID: 656 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 46.521616][ T656] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 46.521830][ T656] Call Trace: [ 46.521969][ T656] [ 46.522058][ T656] dump_stack_lvl+0x82/0xd0 [ 46.522230][ T656] print_deadlock_bug+0x40a/0x650 [ 46.522397][ T656] validate_chain+0x5bf/0xae0 [ 46.522565][ T656] ? __pfx_validate_chain+0x10/0x10 [ 46.522746][ T656] ? hlock_class+0x4e/0x130 [ 46.522914][ T656] ? mark_lock+0x38/0x3e0 [ 46.523041][ T656] __lock_acquire+0xb9a/0x1680 [ 46.523211][ T656] lock_acquire.part.0+0xeb/0x330 [ 46.523383][ T656] ? blocking_notifier_call_chain+0x50/0x90 [ 46.523595][ T656] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 46.523804][ T656] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 46.523973][ T656] ? trace_lock_acquire+0x14c/0x1f0 [ 46.524138][ T656] ? lock_acquire+0x32/0xc0 [ 46.524304][ T656] ? blocking_notifier_call_chain+0x50/0x90 [ 46.524530][ T656] down_read+0x9f/0x340 [ 46.524653][ T656] ? blocking_notifier_call_chain+0x50/0x90 [ 46.524860][ T656] ? __pfx_down_read+0x10/0x10 [ 46.525024][ T656] ? __lock_release+0x103/0x460 [ 46.525195][ T656] ? netconsole_netdev_event+0x2c1/0x620 [ 46.525362][ T656] ? __pfx___lock_release+0x10/0x10 [ 46.525555][ T656] blocking_notifier_call_chain+0x50/0x90 [ 46.525728][ T656] __netdev_upper_dev_unlink+0xd9/0x220 [ 46.525903][ T656] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 46.526112][ T656] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 46.526286][ T656] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 46.526492][ T656] ? rtnl_is_locked+0x15/0x20 [ 46.526672][ T656] netdev_upper_dev_unlink+0x71/0xa0 [ 46.526844][ T656] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 46.527061][ T656] ? netconsole_netdev_event+0x2c1/0x620 [ 46.527231][ T656] ? mutex_is_locked+0x1c/0x60 [ 46.527417][ T656] ? rtnl_is_locked+0x15/0x20 [ 46.527586][ T656] ? netdev_master_upper_dev_get+0x13/0x120 [ 46.527806][ T656] vrf_device_event+0x78/0xe0 [vrf] [ 46.527977][ T656] notifier_call_chain+0xcd/0x150 [ 46.528174][ T656] blocking_notifier_call_chain+0x66/0x90 [ 46.528353][ T656] unregister_netdevice_many_notify+0xa7b/0x1580 [ 46.528573][ T656] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 46.528778][ T656] ? net_generic+0xb1/0x1f0 [ip6_gre] [ 46.528949][ T656] ? __pfx___lock_release+0x10/0x10 [ 46.529119][ T656] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 46.529293][ T656] ? rtnl_is_locked+0x15/0x20 [ 46.529479][ T656] ? unregister_netdevice_queue+0x70/0x410 [ 46.529691][ T656] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 46.529898][ T656] ? net_generic+0xbb/0x1f0 [ip6_gre] [ 46.530074][ T656] rtnl_dellink+0x348/0xa40 [ 46.530244][ T656] ? __pfx_rtnl_dellink+0x10/0x10 [ 46.530427][ T656] ? find_held_lock+0x2c/0x110 [ 46.530602][ T656] ? __lock_release+0x103/0x460 [ 46.530786][ T656] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 46.530957][ T656] ? __pfx___lock_release+0x10/0x10 [ 46.531119][ T656] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 46.531285][ T656] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 46.531448][ T656] ? __pfx_rtnl_dellink+0x10/0x10 [ 46.531614][ T656] rtnetlink_rcv_msg+0x712/0xc10 [ 46.531785][ T656] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 46.531958][ T656] ? hlock_class+0x4e/0x130 [ 46.532127][ T656] ? mark_lock+0x38/0x3e0 [ 46.532255][ T656] ? __lock_acquire+0xb9a/0x1680 [ 46.532424][ T656] netlink_rcv_skb+0x130/0x360 [ 46.532592][ T656] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 46.532774][ T656] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 46.532943][ T656] ? netlink_deliver_tap+0x13e/0x340 [ 46.533114][ T656] ? netlink_deliver_tap+0xc3/0x340 [ 46.533293][ T656] netlink_unicast+0x44b/0x710 [ 46.533458][ T656] ? __pfx_netlink_unicast+0x10/0x10 [ 46.533610][ T656] ? find_held_lock+0x2c/0x110 [ 46.533769][ T656] netlink_sendmsg+0x723/0xbe0 [ 46.533934][ T656] ? __pfx_netlink_sendmsg+0x10/0x10 [ 46.534099][ T656] ____sys_sendmsg+0x7ac/0xa10 [ 46.534250][ T656] ? __pfx_____sys_sendmsg+0x10/0x10 [ 46.534404][ T656] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 46.534594][ T656] ___sys_sendmsg+0xee/0x170 [ 46.534753][ T656] ? __pfx____sys_sendmsg+0x10/0x10 [ 46.534915][ T656] ? kasan_save_stack+0x34/0x50 [ 46.535075][ T656] ? kasan_save_stack+0x24/0x50 [ 46.535237][ T656] ? __kasan_record_aux_stack+0x8e/0xa0 [ 46.535404][ T656] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 46.535618][ T656] ? __x64_sys_close+0x7c/0xd0 [ 46.535782][ T656] ? do_syscall_64+0xc1/0x1d0 [ 46.535944][ T656] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 46.536153][ T656] ? __lock_acquire+0xb9a/0x1680 [ 46.536323][ T656] ? find_held_lock+0x2c/0x110 [ 46.536489][ T656] ? __lock_release+0x103/0x460 [ 46.536652][ T656] ? __virt_addr_valid+0x22b/0x430 [ 46.536826][ T656] ? __pfx___lock_release+0x10/0x10 [ 46.536990][ T656] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 46.537156][ T656] __sys_sendmsg+0x109/0x1a0 [ 46.537324][ T656] ? __pfx___sys_sendmsg+0x10/0x10 [ 46.537489][ T656] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 46.537713][ T656] do_syscall_64+0xc1/0x1d0 [ 46.537878][ T656] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 46.538094][ T656] RIP: 0033:0x7fd93bac49a7 [ 46.538269][ T656] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 46.538850][ T656] RSP: 002b:00007ffe710f5848 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 46.539104][ T656] RAX: ffffffffffffffda RBX: 00007ffe710f5f70 RCX: 00007fd93bac49a7 [ 46.539354][ T656] RDX: 0000000000000000 RSI: 00007ffe710f58b0 RDI: 0000000000000005 [ 46.539600][ T656] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 46.539849][ T656] R10: 00007fd93b982ef8 R11: 0000000000000246 R12: 0000000000000002 [ 46.540095][ T656] R13: 0000000067792b51 R14: 0000000000498600 R15: 0000000000000000 [ 46.540351][ T656]