[ 285.828573][ T1839] gre: GRE over IPv4 demultiplexor driver [ 285.851947][ T1839] ip_gre: GRE over IPv4 tunneling driver [ 287.524479][ T1861] 8021q: 802.1Q VLAN Support v1.8 [ 290.587303][ T1899] GACT probability NOT on [ 456.539650][ T2110] [ 456.539819][ T2110] ============================================ [ 456.540025][ T2110] WARNING: possible recursive locking detected [ 456.540229][ T2110] 6.13.0-rc5-virtme #1 Not tainted [ 456.540393][ T2110] -------------------------------------------- [ 456.540597][ T2110] ip/2110 is trying to acquire lock: [ 456.540772][ T2110] ffffffff927d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 456.541105][ T2110] [ 456.541105][ T2110] but task is already holding lock: [ 456.541347][ T2110] ffffffff927d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 456.541676][ T2110] [ 456.541676][ T2110] other info that might help us debug this: [ 456.541912][ T2110] Possible unsafe locking scenario: [ 456.541912][ T2110] [ 456.542149][ T2110] CPU0 [ 456.542273][ T2110] ---- [ 456.542396][ T2110] lock((netdev_chain).rwsem); [ 456.542558][ T2110] lock((netdev_chain).rwsem); [ 456.542720][ T2110] [ 456.542720][ T2110] *** DEADLOCK *** [ 456.542720][ T2110] [ 456.542959][ T2110] May be due to missing lock nesting notation [ 456.542959][ T2110] [ 456.543200][ T2110] 2 locks held by ip/2110: [ 456.543363][ T2110] #0: ffffffff927e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 456.543687][ T2110] #1: ffffffff927d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 456.544024][ T2110] [ 456.544024][ T2110] stack backtrace: [ 456.544222][ T2110] CPU: 3 UID: 0 PID: 2110 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 456.544469][ T2110] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 456.544678][ T2110] Call Trace: [ 456.544803][ T2110] [ 456.544887][ T2110] dump_stack_lvl+0x82/0xd0 [ 456.545064][ T2110] print_deadlock_bug+0x40a/0x650 [ 456.545231][ T2110] validate_chain+0x5bf/0xae0 [ 456.545414][ T2110] ? __pfx_validate_chain+0x10/0x10 [ 456.545588][ T2110] ? hlock_class+0x4e/0x130 [ 456.545752][ T2110] ? mark_lock+0x38/0x3e0 [ 456.545876][ T2110] __lock_acquire+0xb9a/0x1680 [ 456.546043][ T2110] lock_acquire.part.0+0xeb/0x330 [ 456.546206][ T2110] ? blocking_notifier_call_chain+0x50/0x90 [ 456.546409][ T2110] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 456.546620][ T2110] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 456.546784][ T2110] ? trace_lock_acquire+0x14c/0x1f0 [ 456.546951][ T2110] ? lock_acquire+0x32/0xc0 [ 456.547114][ T2110] ? blocking_notifier_call_chain+0x50/0x90 [ 456.547317][ T2110] down_read+0x9f/0x340 [ 456.547441][ T2110] ? blocking_notifier_call_chain+0x50/0x90 [ 456.547673][ T2110] ? __pfx_down_read+0x10/0x10 [ 456.547847][ T2110] ? __lock_release+0x103/0x460 [ 456.548009][ T2110] ? netconsole_netdev_event+0x2c1/0x620 [ 456.548179][ T2110] ? __pfx___lock_release+0x10/0x10 [ 456.548342][ T2110] blocking_notifier_call_chain+0x50/0x90 [ 456.548497][ T2110] __netdev_upper_dev_unlink+0xd9/0x220 [ 456.548646][ T2110] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 456.548825][ T2110] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 456.548972][ T2110] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 456.549173][ T2110] ? rtnl_is_locked+0x15/0x20 [ 456.549338][ T2110] netdev_upper_dev_unlink+0x71/0xa0 [ 456.549500][ T2110] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 456.549701][ T2110] ? netconsole_netdev_event+0x2c1/0x620 [ 456.549882][ T2110] ? mutex_is_locked+0x1c/0x60 [ 456.550051][ T2110] ? rtnl_is_locked+0x15/0x20 [ 456.550214][ T2110] ? netdev_master_upper_dev_get+0x13/0x120 [ 456.550422][ T2110] vrf_device_event+0x78/0xe0 [vrf] [ 456.550590][ T2110] notifier_call_chain+0xcd/0x150 [ 456.550754][ T2110] blocking_notifier_call_chain+0x66/0x90 [ 456.550922][ T2110] unregister_netdevice_many_notify+0xa7b/0x1580 [ 456.551124][ T2110] ? hlock_class+0x4e/0x130 [ 456.551316][ T2110] ? mark_lock+0x38/0x3e0 [ 456.551441][ T2110] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 456.551682][ T2110] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 456.551891][ T2110] ? kfree+0xf3/0x330 [ 456.552019][ T2110] ? vlan_vid_del+0x310/0x5e0 [ 456.552188][ T2110] ? vlan_vid_del+0x310/0x5e0 [ 456.552353][ T2110] rtnl_dellink+0x348/0xa40 [ 456.552519][ T2110] ? __pfx_rtnl_dellink+0x10/0x10 [ 456.552697][ T2110] ? find_held_lock+0x2c/0x110 [ 456.552862][ T2110] ? __lock_release+0x103/0x460 [ 456.553029][ T2110] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 456.553188][ T2110] ? __pfx___lock_release+0x10/0x10 [ 456.553351][ T2110] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 456.553513][ T2110] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 456.553674][ T2110] ? __pfx_rtnl_dellink+0x10/0x10 [ 456.553836][ T2110] rtnetlink_rcv_msg+0x712/0xc10 [ 456.554003][ T2110] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 456.554169][ T2110] ? hlock_class+0x4e/0x130 [ 456.554330][ T2110] ? mark_lock+0x38/0x3e0 [ 456.554455][ T2110] ? __lock_acquire+0xb9a/0x1680 [ 456.554619][ T2110] netlink_rcv_skb+0x130/0x360 [ 456.554782][ T2110] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 456.554943][ T2110] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 456.555112][ T2110] ? netlink_deliver_tap+0x13e/0x340 [ 456.555295][ T2110] ? netlink_deliver_tap+0xc3/0x340 [ 456.555460][ T2110] netlink_unicast+0x44b/0x710 [ 456.555638][ T2110] ? __pfx_netlink_unicast+0x10/0x10 [ 456.555811][ T2110] ? find_held_lock+0x2c/0x110 [ 456.555978][ T2110] netlink_sendmsg+0x723/0xbe0 [ 456.556143][ T2110] ? __pfx_netlink_sendmsg+0x10/0x10 [ 456.556306][ T2110] ____sys_sendmsg+0x7ac/0xa10 [ 456.556475][ T2110] ? __pfx_____sys_sendmsg+0x10/0x10 [ 456.556639][ T2110] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 456.556845][ T2110] ___sys_sendmsg+0xee/0x170 [ 456.557008][ T2110] ? __pfx____sys_sendmsg+0x10/0x10 [ 456.557172][ T2110] ? kasan_save_stack+0x34/0x50 [ 456.557335][ T2110] ? kasan_save_stack+0x24/0x50 [ 456.557496][ T2110] ? __kasan_record_aux_stack+0x8e/0xa0 [ 456.557662][ T2110] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 456.557948][ T2110] ? __x64_sys_close+0x7c/0xd0 [ 456.558191][ T2110] ? do_syscall_64+0xc1/0x1d0 [ 456.558421][ T2110] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 456.558696][ T2110] ? __lock_acquire+0xb9a/0x1680 [ 456.558945][ T2110] ? find_held_lock+0x2c/0x110 [ 456.559189][ T2110] ? __lock_release+0x103/0x460 [ 456.559433][ T2110] ? __virt_addr_valid+0x22b/0x430 [ 456.559678][ T2110] ? __pfx___lock_release+0x10/0x10 [ 456.559898][ T2110] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 456.560127][ T2110] __sys_sendmsg+0x109/0x1a0 [ 456.560369][ T2110] ? __pfx___sys_sendmsg+0x10/0x10 [ 456.560616][ T2110] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 456.560936][ T2110] do_syscall_64+0xc1/0x1d0 [ 456.561197][ T2110] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 456.561494][ T2110] RIP: 0033:0x7fd65abed9a7 [ 456.561754][ T2110] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 456.562637][ T2110] RSP: 002b:00007ffd5aca3e98 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 456.563034][ T2110] RAX: ffffffffffffffda RBX: 00007ffd5aca45c0 RCX: 00007fd65abed9a7 [ 456.563411][ T2110] RDX: 0000000000000000 RSI: 00007ffd5aca3f00 RDI: 0000000000000005 [ 456.563784][ T2110] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 456.564165][ T2110] R10: 00007fd65aaabef8 R11: 0000000000000246 R12: 0000000000000002 [ 456.564551][ T2110] R13: 000000006778fe91 R14: 0000000000498600 R15: 0000000000000000 [ 456.564932][ T2110]