[ 10.900205][ T258] ip (258) used greatest stack depth: 23664 bytes left [ 14.205941][ T311] gre: GRE over IPv4 demultiplexor driver [ 14.220929][ T311] ip_gre: GRE over IPv4 tunneling driver [ 14.926843][ T322] GACT probability NOT on [ 15.121861][ T324] ip6_gre: GRE over IPv6 tunneling driver [ 15.254344][ T50] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 15.384213][ T50] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 15.700258][ T11] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 15.988177][ T9] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 16.295750][ T339] br1: port 1(veth1) entered blocking state [ 16.296423][ T339] br1: port 1(veth1) entered disabled state [ 16.296782][ T339] veth1: entered allmulticast mode [ 16.298777][ T339] veth1: entered promiscuous mode [ 16.376552][ T40] br1: port 1(veth1) entered blocking state [ 16.377007][ T40] br1: port 1(veth1) entered forwarding state [ 16.457558][ T342] br1: port 2(veth2) entered blocking state [ 16.457838][ T342] br1: port 2(veth2) entered disabled state [ 16.458138][ T342] veth2: entered allmulticast mode [ 16.460292][ T342] veth2: entered promiscuous mode [ 16.536122][ T69] br1: port 2(veth2) entered blocking state [ 16.536433][ T69] br1: port 2(veth2) entered forwarding state [ 16.757381][ T11] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 16.758088][ T11] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 17.023200][ T9] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 17.379186][ T357] br2: port 1(veth4) entered blocking state [ 17.379567][ T357] br2: port 1(veth4) entered disabled state [ 17.379904][ T357] veth4: entered allmulticast mode [ 17.382017][ T357] veth4: entered promiscuous mode [ 17.382941][ T357] br2: port 1(veth4) entered blocking state [ 17.383453][ T357] br2: port 1(veth4) entered forwarding state [ 17.445190][ T11] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 17.780215][ T61] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 18.036152][ T9] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 20.404236][ C1] ip6_tnl_xmit_ctl: 3 callbacks suppressed [ 20.404707][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 24.081240][ T390] Mirror/redirect action on [ 27.636271][ C0] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 42.997163][ C0] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 61.145408][ T584] veth4: left allmulticast mode [ 61.145702][ T584] veth4: left promiscuous mode [ 61.146084][ T584] br2: port 1(veth4) entered disabled state [ 61.708602][ T590] br1: port 1(veth1) entered disabled state [ 61.805222][ T591] br1: port 2(veth2) entered disabled state [ 61.881290][ T592] veth2: left allmulticast mode [ 61.881529][ T592] veth2: left promiscuous mode [ 61.881845][ T592] br1: port 2(veth2) entered disabled state [ 61.883573][ T592] veth1: left allmulticast mode [ 61.883773][ T592] veth1: left promiscuous mode [ 61.884098][ T592] br1: port 1(veth1) entered disabled state [ 62.140135][ T594] [ 62.140315][ T594] ============================================ [ 62.140509][ T594] WARNING: possible recursive locking detected [ 62.140709][ T594] 6.13.0-rc5-virtme #1 Not tainted [ 62.140862][ T594] -------------------------------------------- [ 62.141059][ T594] ip/594 is trying to acquire lock: [ 62.141205][ T594] ffffffff979d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 62.141517][ T594] [ 62.141517][ T594] but task is already holding lock: [ 62.141727][ T594] ffffffff979d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 62.142039][ T594] [ 62.142039][ T594] other info that might help us debug this: [ 62.142263][ T594] Possible unsafe locking scenario: [ 62.142263][ T594] [ 62.142476][ T594] CPU0 [ 62.142586][ T594] ---- [ 62.142693][ T594] lock((netdev_chain).rwsem); [ 62.142838][ T594] lock((netdev_chain).rwsem); [ 62.142985][ T594] [ 62.142985][ T594] *** DEADLOCK *** [ 62.142985][ T594] [ 62.143196][ T594] May be due to missing lock nesting notation [ 62.143196][ T594] [ 62.143409][ T594] 2 locks held by ip/594: [ 62.143522][ T594] #0: ffffffff979e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 62.143789][ T594] #1: ffffffff979d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 62.144083][ T594] [ 62.144083][ T594] stack backtrace: [ 62.144271][ T594] CPU: 3 UID: 0 PID: 594 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 62.144491][ T594] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 62.144674][ T594] Call Trace: [ 62.144787][ T594] [ 62.144864][ T594] dump_stack_lvl+0x82/0xd0 [ 62.145016][ T594] print_deadlock_bug+0x40a/0x650 [ 62.145164][ T594] validate_chain+0x5bf/0xae0 [ 62.145336][ T594] ? __pfx_validate_chain+0x10/0x10 [ 62.145497][ T594] ? hlock_class+0x4e/0x130 [ 62.145642][ T594] ? mark_lock+0x38/0x3e0 [ 62.145756][ T594] __lock_acquire+0xb9a/0x1680 [ 62.145908][ T594] lock_acquire.part.0+0xeb/0x330 [ 62.146056][ T594] ? blocking_notifier_call_chain+0x50/0x90 [ 62.146238][ T594] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 62.146425][ T594] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 62.146592][ T594] ? trace_lock_acquire+0x14c/0x1f0 [ 62.146754][ T594] ? lock_acquire+0x32/0xc0 [ 62.146919][ T594] ? blocking_notifier_call_chain+0x50/0x90 [ 62.147122][ T594] down_read+0x9f/0x340 [ 62.147251][ T594] ? blocking_notifier_call_chain+0x50/0x90 [ 62.147452][ T594] ? __pfx_down_read+0x10/0x10 [ 62.147619][ T594] ? __lock_release+0x103/0x460 [ 62.147795][ T594] ? netconsole_netdev_event+0x2c1/0x620 [ 62.147974][ T594] ? __pfx___lock_release+0x10/0x10 [ 62.148148][ T594] blocking_notifier_call_chain+0x50/0x90 [ 62.148322][ T594] __netdev_upper_dev_unlink+0xd9/0x220 [ 62.148497][ T594] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 62.148712][ T594] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 62.148888][ T594] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 62.149102][ T594] ? rtnl_is_locked+0x15/0x20 [ 62.149278][ T594] netdev_upper_dev_unlink+0x71/0xa0 [ 62.149454][ T594] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 62.149689][ T594] ? netconsole_netdev_event+0x2c1/0x620 [ 62.149863][ T594] ? mutex_is_locked+0x1c/0x60 [ 62.150041][ T594] ? rtnl_is_locked+0x15/0x20 [ 62.150218][ T594] ? netdev_master_upper_dev_get+0x13/0x120 [ 62.150435][ T594] vrf_device_event+0x78/0xe0 [vrf] [ 62.150621][ T594] notifier_call_chain+0xcd/0x150 [ 62.150802][ T594] blocking_notifier_call_chain+0x66/0x90 [ 62.150974][ T594] unregister_netdevice_many_notify+0xa7b/0x1580 [ 62.151184][ T594] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 62.151392][ T594] ? rtnl_dellink+0x228/0xa40 [ 62.151563][ T594] ? sock_def_readable+0x11e/0x300 [ 62.151733][ T594] ? __pfx___mutex_lock+0x10/0x10 [ 62.151902][ T594] ? rtnl_is_locked+0x15/0x20 [ 62.152069][ T594] ? unregister_netdevice_queue+0x70/0x410 [ 62.152273][ T594] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 62.152478][ T594] ? __nla_validate_parse+0x48/0x3d0 [ 62.152648][ T594] rtnl_dellink+0x348/0xa40 [ 62.152824][ T594] ? __pfx_rtnl_dellink+0x10/0x10 [ 62.153005][ T594] ? find_held_lock+0x2c/0x110 [ 62.153172][ T594] ? __lock_release+0x103/0x460 [ 62.153338][ T594] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 62.153505][ T594] ? __pfx___lock_release+0x10/0x10 [ 62.153674][ T594] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 62.153843][ T594] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 62.154018][ T594] ? __pfx_rtnl_dellink+0x10/0x10 [ 62.154187][ T594] rtnetlink_rcv_msg+0x712/0xc10 [ 62.154353][ T594] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 62.154517][ T594] ? hlock_class+0x4e/0x130 [ 62.154684][ T594] ? mark_lock+0x38/0x3e0 [ 62.154813][ T594] ? __lock_acquire+0xb9a/0x1680 [ 62.154979][ T594] netlink_rcv_skb+0x130/0x360 [ 62.155146][ T594] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 62.155318][ T594] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 62.155487][ T594] ? netlink_deliver_tap+0x13e/0x340 [ 62.155657][ T594] ? netlink_deliver_tap+0xc3/0x340 [ 62.155824][ T594] netlink_unicast+0x44b/0x710 [ 62.155992][ T594] ? __pfx_netlink_unicast+0x10/0x10 [ 62.156158][ T594] ? find_held_lock+0x2c/0x110 [ 62.156331][ T594] netlink_sendmsg+0x723/0xbe0 [ 62.156497][ T594] ? __pfx_netlink_sendmsg+0x10/0x10 [ 62.156666][ T594] ____sys_sendmsg+0x7ac/0xa10 [ 62.156834][ T594] ? __pfx_____sys_sendmsg+0x10/0x10 [ 62.156994][ T594] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 62.157197][ T594] ___sys_sendmsg+0xee/0x170 [ 62.157361][ T594] ? __pfx____sys_sendmsg+0x10/0x10 [ 62.157536][ T594] ? kasan_save_stack+0x34/0x50 [ 62.157704][ T594] ? kasan_save_stack+0x24/0x50 [ 62.157869][ T594] ? __kasan_record_aux_stack+0x8e/0xa0 [ 62.158033][ T594] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 62.158244][ T594] ? __x64_sys_close+0x7c/0xd0 [ 62.158410][ T594] ? do_syscall_64+0xc1/0x1d0 [ 62.158577][ T594] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 62.158790][ T594] ? __lock_acquire+0xb9a/0x1680 [ 62.158968][ T594] ? find_held_lock+0x2c/0x110 [ 62.159138][ T594] ? __lock_release+0x103/0x460 [ 62.159307][ T594] ? __virt_addr_valid+0x22b/0x430 [ 62.159483][ T594] ? __pfx___lock_release+0x10/0x10 [ 62.159653][ T594] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 62.159825][ T594] __sys_sendmsg+0x109/0x1a0 [ 62.159993][ T594] ? __pfx___sys_sendmsg+0x10/0x10 [ 62.160170][ T594] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 62.160388][ T594] do_syscall_64+0xc1/0x1d0 [ 62.160557][ T594] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 62.160780][ T594] RIP: 0033:0x7f97c01479a7 [ 62.160966][ T594] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 62.161575][ T594] RSP: 002b:00007fffdf553558 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 62.161837][ T594] RAX: ffffffffffffffda RBX: 00007fffdf553c80 RCX: 00007f97c01479a7 [ 62.162094][ T594] RDX: 0000000000000000 RSI: 00007fffdf5535c0 RDI: 0000000000000005 [ 62.162352][ T594] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 62.162615][ T594] R10: 00007f97c0005ef8 R11: 0000000000000246 R12: 0000000000000002 [ 62.162873][ T594] R13: 0000000067792e4d R14: 0000000000498600 R15: 0000000000000000 [ 62.163133][ T594]