[ 33.409704][ T518] gre: GRE over IPv4 demultiplexor driver [ 33.430374][ T518] ip_gre: GRE over IPv4 tunneling driver [ 35.026946][ T540] 8021q: 802.1Q VLAN Support v1.8 [ 37.875461][ T577] GACT probability NOT on [ 37.898249][ T575] tc (575) used greatest stack depth: 23960 bytes left [ 194.764974][ T789] [ 194.765208][ T789] ============================================ [ 194.765404][ T789] WARNING: possible recursive locking detected [ 194.765591][ T789] 6.13.0-rc5-virtme #1 Not tainted [ 194.765743][ T789] -------------------------------------------- [ 194.765932][ T789] ip/789 is trying to acquire lock: [ 194.766077][ T789] ffffffffa89d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 194.766394][ T789] [ 194.766394][ T789] but task is already holding lock: [ 194.766610][ T789] ffffffffa89d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 194.766907][ T789] [ 194.766907][ T789] other info that might help us debug this: [ 194.767128][ T789] Possible unsafe locking scenario: [ 194.767128][ T789] [ 194.767345][ T789] CPU0 [ 194.767455][ T789] ---- [ 194.767567][ T789] lock((netdev_chain).rwsem); [ 194.767719][ T789] lock((netdev_chain).rwsem); [ 194.767867][ T789] [ 194.767867][ T789] *** DEADLOCK *** [ 194.767867][ T789] [ 194.768086][ T789] May be due to missing lock nesting notation [ 194.768086][ T789] [ 194.768299][ T789] 2 locks held by ip/789: [ 194.768410][ T789] #0: ffffffffa89e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 194.768676][ T789] #1: ffffffffa89d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 194.768982][ T789] [ 194.768982][ T789] stack backtrace: [ 194.769160][ T789] CPU: 1 UID: 0 PID: 789 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 194.769381][ T789] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 194.769561][ T789] Call Trace: [ 194.769674][ T789] [ 194.769750][ T789] dump_stack_lvl+0x82/0xd0 [ 194.769902][ T789] print_deadlock_bug+0x40a/0x650 [ 194.770058][ T789] validate_chain+0x5bf/0xae0 [ 194.770203][ T789] ? __pfx_validate_chain+0x10/0x10 [ 194.770351][ T789] ? hlock_class+0x4e/0x130 [ 194.770496][ T789] ? mark_lock+0x38/0x3e0 [ 194.770610][ T789] __lock_acquire+0xb9a/0x1680 [ 194.770758][ T789] lock_acquire.part.0+0xeb/0x330 [ 194.770905][ T789] ? blocking_notifier_call_chain+0x50/0x90 [ 194.771084][ T789] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 194.771275][ T789] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 194.771430][ T789] ? trace_lock_acquire+0x14c/0x1f0 [ 194.771583][ T789] ? lock_acquire+0x32/0xc0 [ 194.771729][ T789] ? blocking_notifier_call_chain+0x50/0x90 [ 194.771909][ T789] down_read+0x9f/0x340 [ 194.772019][ T789] ? blocking_notifier_call_chain+0x50/0x90 [ 194.772198][ T789] ? __pfx_down_read+0x10/0x10 [ 194.772349][ T789] ? __lock_release+0x103/0x460 [ 194.772494][ T789] ? netconsole_netdev_event+0x2c1/0x620 [ 194.772638][ T789] ? __pfx___lock_release+0x10/0x10 [ 194.772784][ T789] blocking_notifier_call_chain+0x50/0x90 [ 194.772931][ T789] __netdev_upper_dev_unlink+0xd9/0x220 [ 194.773077][ T789] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 194.773261][ T789] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 194.773407][ T789] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 194.773589][ T789] ? rtnl_is_locked+0x15/0x20 [ 194.773741][ T789] netdev_upper_dev_unlink+0x71/0xa0 [ 194.773886][ T789] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 194.774067][ T789] ? netconsole_netdev_event+0x2c1/0x620 [ 194.774213][ T789] ? mutex_is_locked+0x1c/0x60 [ 194.774363][ T789] ? rtnl_is_locked+0x15/0x20 [ 194.774509][ T789] ? netdev_master_upper_dev_get+0x13/0x120 [ 194.774691][ T789] vrf_device_event+0x78/0xe0 [vrf] [ 194.774840][ T789] notifier_call_chain+0xcd/0x150 [ 194.774987][ T789] blocking_notifier_call_chain+0x66/0x90 [ 194.775133][ T789] unregister_netdevice_many_notify+0xa7b/0x1580 [ 194.775315][ T789] ? hlock_class+0x4e/0x130 [ 194.775463][ T789] ? mark_lock+0x38/0x3e0 [ 194.775573][ T789] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 194.775754][ T789] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 194.775939][ T789] ? kfree+0xf3/0x330 [ 194.776050][ T789] ? vlan_vid_del+0x310/0x5e0 [ 194.776201][ T789] ? vlan_vid_del+0x310/0x5e0 [ 194.776348][ T789] rtnl_dellink+0x348/0xa40 [ 194.776504][ T789] ? __pfx_rtnl_dellink+0x10/0x10 [ 194.776666][ T789] ? find_held_lock+0x2c/0x110 [ 194.776815][ T789] ? __lock_release+0x103/0x460 [ 194.776963][ T789] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 194.777112][ T789] ? __pfx___lock_release+0x10/0x10 [ 194.777257][ T789] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 194.777404][ T789] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 194.777557][ T789] ? __pfx_rtnl_dellink+0x10/0x10 [ 194.777704][ T789] rtnetlink_rcv_msg+0x712/0xc10 [ 194.777850][ T789] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 194.777996][ T789] ? hlock_class+0x4e/0x130 [ 194.778140][ T789] ? mark_lock+0x38/0x3e0 [ 194.778253][ T789] ? __lock_acquire+0xb9a/0x1680 [ 194.778399][ T789] netlink_rcv_skb+0x130/0x360 [ 194.778547][ T789] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 194.778700][ T789] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 194.778852][ T789] ? netlink_deliver_tap+0x13e/0x340 [ 194.779004][ T789] ? netlink_deliver_tap+0xc3/0x340 [ 194.779151][ T789] netlink_unicast+0x44b/0x710 [ 194.779296][ T789] ? __pfx_netlink_unicast+0x10/0x10 [ 194.779441][ T789] ? find_held_lock+0x2c/0x110 [ 194.779587][ T789] netlink_sendmsg+0x723/0xbe0 [ 194.779740][ T789] ? __pfx_netlink_sendmsg+0x10/0x10 [ 194.779888][ T789] ____sys_sendmsg+0x7ac/0xa10 [ 194.780037][ T789] ? __pfx_____sys_sendmsg+0x10/0x10 [ 194.780181][ T789] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 194.780365][ T789] ___sys_sendmsg+0xee/0x170 [ 194.780509][ T789] ? __pfx____sys_sendmsg+0x10/0x10 [ 194.780658][ T789] ? kasan_save_stack+0x34/0x50 [ 194.780810][ T789] ? kasan_save_stack+0x24/0x50 [ 194.780954][ T789] ? __kasan_record_aux_stack+0x8e/0xa0 [ 194.781099][ T789] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 194.781279][ T789] ? __x64_sys_close+0x7c/0xd0 [ 194.781433][ T789] ? do_syscall_64+0xc1/0x1d0 [ 194.781579][ T789] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 194.781765][ T789] ? __lock_acquire+0xb9a/0x1680 [ 194.781920][ T789] ? find_held_lock+0x2c/0x110 [ 194.782068][ T789] ? __lock_release+0x103/0x460 [ 194.782212][ T789] ? __virt_addr_valid+0x22b/0x430 [ 194.782361][ T789] ? __pfx___lock_release+0x10/0x10 [ 194.782504][ T789] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 194.782650][ T789] __sys_sendmsg+0x109/0x1a0 [ 194.782797][ T789] ? __pfx___sys_sendmsg+0x10/0x10 [ 194.782950][ T789] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 194.783137][ T789] do_syscall_64+0xc1/0x1d0 [ 194.783282][ T789] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 194.783461][ T789] RIP: 0033:0x7fc2861bf9a7 [ 194.783618][ T789] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 194.784146][ T789] RSP: 002b:00007ffda36075f8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 194.784366][ T789] RAX: ffffffffffffffda RBX: 00007ffda3607d20 RCX: 00007fc2861bf9a7 [ 194.784585][ T789] RDX: 0000000000000000 RSI: 00007ffda3607660 RDI: 0000000000000005 [ 194.784802][ T789] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 194.785026][ T789] R10: 00007fc28607def8 R11: 0000000000000246 R12: 0000000000000002 [ 194.785245][ T789] R13: 0000000067790222 R14: 0000000000498600 R15: 0000000000000000 [ 194.785468][ T789] [ 194.801648][ T789] ip (789) used greatest stack depth: 23888 bytes left