[ 10.429116][ T249] ip (249) used greatest stack depth: 23680 bytes left [ 11.275430][ T273] ip (273) used greatest stack depth: 22744 bytes left [ 15.366642][ T328] gre: GRE over IPv4 demultiplexor driver [ 15.417290][ T328] ip6_gre: GRE over IPv6 tunneling driver [ 17.125665][ T351] 8021q: 802.1Q VLAN Support v1.8 [ 20.228082][ T389] GACT probability NOT on [ 1325.051784][T17311] [ 1325.051991][T17311] ============================================ [ 1325.052288][T17311] WARNING: possible recursive locking detected [ 1325.052583][T17311] 6.13.0-rc5-virtme #1 Not tainted [ 1325.052816][T17311] -------------------------------------------- [ 1325.053041][T17311] ip/17311 is trying to acquire lock: [ 1325.053243][T17311] ffffffffa73d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 1325.053626][T17311] [ 1325.053626][T17311] but task is already holding lock: [ 1325.053896][T17311] ffffffffa73d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 1325.054196][T17311] [ 1325.054196][T17311] other info that might help us debug this: [ 1325.054487][T17311] Possible unsafe locking scenario: [ 1325.054487][T17311] [ 1325.054719][T17311] CPU0 [ 1325.054853][T17311] ---- [ 1325.054965][T17311] lock((netdev_chain).rwsem); [ 1325.055114][T17311] lock((netdev_chain).rwsem); [ 1325.055259][T17311] [ 1325.055259][T17311] *** DEADLOCK *** [ 1325.055259][T17311] [ 1325.055491][T17311] May be due to missing lock nesting notation [ 1325.055491][T17311] [ 1325.055705][T17311] 2 locks held by ip/17311: [ 1325.055859][T17311] #0: ffffffffa73e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 1325.056129][T17311] #1: ffffffffa73d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 1325.056482][T17311] [ 1325.056482][T17311] stack backtrace: [ 1325.056664][T17311] CPU: 3 UID: 0 PID: 17311 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 1325.056890][T17311] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1325.057084][T17311] Call Trace: [ 1325.057197][T17311] [ 1325.057274][T17311] dump_stack_lvl+0x82/0xd0 [ 1325.057457][T17311] print_deadlock_bug+0x40a/0x650 [ 1325.057693][T17311] validate_chain+0x5bf/0xae0 [ 1325.057933][T17311] ? __pfx_validate_chain+0x10/0x10 [ 1325.058224][T17311] ? hlock_class+0x4e/0x130 [ 1325.058458][T17311] ? mark_lock+0x38/0x3e0 [ 1325.058645][T17311] __lock_acquire+0xb9a/0x1680 [ 1325.058884][T17311] lock_acquire.part.0+0xeb/0x330 [ 1325.059125][T17311] ? blocking_notifier_call_chain+0x50/0x90 [ 1325.059424][T17311] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 1325.059728][T17311] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1325.059966][T17311] ? trace_lock_acquire+0x14c/0x1f0 [ 1325.060201][T17311] ? lock_acquire+0x32/0xc0 [ 1325.060444][T17311] ? blocking_notifier_call_chain+0x50/0x90 [ 1325.060745][T17311] down_read+0x9f/0x340 [ 1325.060924][T17311] ? blocking_notifier_call_chain+0x50/0x90 [ 1325.061220][T17311] ? __pfx_down_read+0x10/0x10 [ 1325.061464][T17311] ? __lock_release+0x103/0x460 [ 1325.061699][T17311] ? netconsole_netdev_event+0x2c1/0x620 [ 1325.061943][T17311] ? __pfx___lock_release+0x10/0x10 [ 1325.062196][T17311] blocking_notifier_call_chain+0x50/0x90 [ 1325.062433][T17311] __netdev_upper_dev_unlink+0xd9/0x220 [ 1325.062674][T17311] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 1325.062961][T17311] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 1325.063195][T17311] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 1325.063485][T17311] ? rtnl_is_locked+0x15/0x20 [ 1325.063728][T17311] netdev_upper_dev_unlink+0x71/0xa0 [ 1325.063979][T17311] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 1325.064276][T17311] ? netconsole_netdev_event+0x2c1/0x620 [ 1325.064520][T17311] ? mutex_is_locked+0x1c/0x60 [ 1325.064770][T17311] ? rtnl_is_locked+0x15/0x20 [ 1325.065010][T17311] ? netdev_master_upper_dev_get+0x13/0x120 [ 1325.065315][T17311] vrf_device_event+0x78/0xe0 [vrf] [ 1325.065576][T17311] notifier_call_chain+0xcd/0x150 [ 1325.065822][T17311] blocking_notifier_call_chain+0x66/0x90 [ 1325.066056][T17311] unregister_netdevice_many_notify+0xa7b/0x1580 [ 1325.066360][T17311] ? hlock_class+0x4e/0x130 [ 1325.066602][T17311] ? mark_lock+0x38/0x3e0 [ 1325.066790][T17311] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 1325.067091][T17311] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 1325.067405][T17311] ? kfree+0xf3/0x330 [ 1325.067589][T17311] ? vlan_vid_del+0x310/0x5e0 [ 1325.067825][T17311] ? vlan_vid_del+0x310/0x5e0 [ 1325.068062][T17311] rtnl_dellink+0x348/0xa40 [ 1325.068302][T17311] ? __pfx_rtnl_dellink+0x10/0x10 [ 1325.068567][T17311] ? find_held_lock+0x2c/0x110 [ 1325.068809][T17311] ? __lock_release+0x103/0x460 [ 1325.069048][T17311] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 1325.069301][T17311] ? __pfx___lock_release+0x10/0x10 [ 1325.069537][T17311] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1325.069778][T17311] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 1325.070011][T17311] ? __pfx_rtnl_dellink+0x10/0x10 [ 1325.070260][T17311] rtnetlink_rcv_msg+0x712/0xc10 [ 1325.070499][T17311] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1325.070738][T17311] ? hlock_class+0x4e/0x130 [ 1325.070986][T17311] ? mark_lock+0x38/0x3e0 [ 1325.071172][T17311] ? __lock_acquire+0xb9a/0x1680 [ 1325.071409][T17311] netlink_rcv_skb+0x130/0x360 [ 1325.071645][T17311] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 1325.071882][T17311] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 1325.072126][T17311] ? netlink_deliver_tap+0x13e/0x340 [ 1325.072364][T17311] ? netlink_deliver_tap+0xc3/0x340 [ 1325.072609][T17311] netlink_unicast+0x44b/0x710 [ 1325.072844][T17311] ? __pfx_netlink_unicast+0x10/0x10 [ 1325.073086][T17311] ? find_held_lock+0x2c/0x110 [ 1325.073324][T17311] netlink_sendmsg+0x723/0xbe0 [ 1325.073561][T17311] ? __pfx_netlink_sendmsg+0x10/0x10 [ 1325.073800][T17311] ____sys_sendmsg+0x7ac/0xa10 [ 1325.074041][T17311] ? __pfx_____sys_sendmsg+0x10/0x10 [ 1325.074280][T17311] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 1325.074588][T17311] ___sys_sendmsg+0xee/0x170 [ 1325.074838][T17311] ? __pfx____sys_sendmsg+0x10/0x10 [ 1325.075082][T17311] ? kasan_save_stack+0x34/0x50 [ 1325.075307][T17311] ? kasan_save_stack+0x24/0x50 [ 1325.075544][T17311] ? __kasan_record_aux_stack+0x8e/0xa0 [ 1325.075782][T17311] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 1325.076091][T17311] ? __x64_sys_close+0x7c/0xd0 [ 1325.076326][T17311] ? do_syscall_64+0xc1/0x1d0 [ 1325.076573][T17311] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1325.076876][T17311] ? __lock_acquire+0xb9a/0x1680 [ 1325.077132][T17311] ? find_held_lock+0x2c/0x110 [ 1325.077371][T17311] ? __lock_release+0x103/0x460 [ 1325.077611][T17311] ? __virt_addr_valid+0x22b/0x430 [ 1325.077853][T17311] ? __pfx___lock_release+0x10/0x10 [ 1325.078104][T17311] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1325.078339][T17311] __sys_sendmsg+0x109/0x1a0 [ 1325.078509][T17311] ? __pfx___sys_sendmsg+0x10/0x10 [ 1325.078690][T17311] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 1325.078934][T17311] do_syscall_64+0xc1/0x1d0 [ 1325.079117][T17311] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 1325.079301][T17311] RIP: 0033:0x7f39e043f9a7 [ 1325.079504][T17311] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 1325.080129][T17311] RSP: 002b:00007ffe7852a178 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 1325.080403][T17311] RAX: ffffffffffffffda RBX: 00007ffe7852a8a0 RCX: 00007f39e043f9a7 [ 1325.080712][T17311] RDX: 0000000000000000 RSI: 00007ffe7852a1e0 RDI: 0000000000000005 [ 1325.080937][T17311] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 1325.081266][T17311] R10: 00007f39e02fdef8 R11: 0000000000000246 R12: 0000000000000002 [ 1325.081535][T17311] R13: 000000006779539a R14: 0000000000498600 R15: 0000000000000000 [ 1325.081867][T17311]