[ 10.496416][ T250] ip (250) used greatest stack depth: 22920 bytes left [ 14.378449][ T314] gre: GRE over IPv4 demultiplexor driver [ 14.393760][ T314] ip_gre: GRE over IPv4 tunneling driver [ 15.100082][ T324] GACT probability NOT on [ 15.328235][ T326] ip6_gre: GRE over IPv6 tunneling driver [ 15.470653][ T327] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 15.582918][ T64] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 15.848346][ T9] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 16.486542][ T68] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 16.489542][ T341] br1: port 1(veth1) entered blocking state [ 16.489960][ T341] br1: port 1(veth1) entered disabled state [ 16.490292][ T341] veth1: entered allmulticast mode [ 16.492386][ T341] veth1: entered promiscuous mode [ 16.566549][ T37] br1: port 1(veth1) entered blocking state [ 16.566959][ T37] br1: port 1(veth1) entered forwarding state [ 16.645483][ T343] br1: port 2(veth2) entered blocking state [ 16.645796][ T343] br1: port 2(veth2) entered disabled state [ 16.646076][ T343] veth2: entered allmulticast mode [ 16.647975][ T343] veth2: entered promiscuous mode [ 16.723215][ T59] br1: port 2(veth2) entered blocking state [ 16.723630][ T59] br1: port 2(veth2) entered forwarding state [ 17.205586][ T327] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 17.448394][ T327] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 17.512563][ T68] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 17.513679][ T68] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 17.580570][ T358] br2: port 1(veth4) entered blocking state [ 17.581261][ T358] br2: port 1(veth4) entered disabled state [ 17.581715][ T358] veth4: entered allmulticast mode [ 17.584869][ T358] veth4: entered promiscuous mode [ 17.586172][ T358] br2: port 1(veth4) entered blocking state [ 17.586759][ T358] br2: port 1(veth4) entered forwarding state [ 17.601158][ T288] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 17.606575][ T68] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 21.222617][ C0] ip6_tnl_xmit_ctl: 3 callbacks suppressed [ 21.223110][ C0] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 24.502243][ T391] Mirror/redirect action on [ 28.647007][ C0] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 43.494509][ C3] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 62.144919][ T585] veth4: left allmulticast mode [ 62.145158][ T585] veth4: left promiscuous mode [ 62.145932][ T585] br2: port 1(veth4) entered disabled state [ 62.733577][ T591] br1: port 1(veth1) entered disabled state [ 62.823381][ T592] br1: port 2(veth2) entered disabled state [ 62.930894][ T593] veth2: left allmulticast mode [ 62.931151][ T593] veth2: left promiscuous mode [ 62.931517][ T593] br1: port 2(veth2) entered disabled state [ 62.933176][ T593] veth1: left allmulticast mode [ 62.934079][ T593] veth1: left promiscuous mode [ 62.934614][ T593] br1: port 1(veth1) entered disabled state [ 63.305305][ T595] [ 63.305470][ T595] ============================================ [ 63.305688][ T595] WARNING: possible recursive locking detected [ 63.305909][ T595] 6.13.0-rc5-virtme #1 Not tainted [ 63.306081][ T595] -------------------------------------------- [ 63.306296][ T595] ip/595 is trying to acquire lock: [ 63.306475][ T595] ffffffff8d7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 63.306837][ T595] [ 63.306837][ T595] but task is already holding lock: [ 63.307095][ T595] ffffffff8d7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 63.307464][ T595] [ 63.307464][ T595] other info that might help us debug this: [ 63.307739][ T595] Possible unsafe locking scenario: [ 63.307739][ T595] [ 63.308005][ T595] CPU0 [ 63.308135][ T595] ---- [ 63.308265][ T595] lock((netdev_chain).rwsem); [ 63.308444][ T595] lock((netdev_chain).rwsem); [ 63.308618][ T595] [ 63.308618][ T595] *** DEADLOCK *** [ 63.308618][ T595] [ 63.308874][ T595] May be due to missing lock nesting notation [ 63.308874][ T595] [ 63.309127][ T595] 2 locks held by ip/595: [ 63.309259][ T595] #0: ffffffff8d7e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 63.309568][ T595] #1: ffffffff8d7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 63.309911][ T595] [ 63.309911][ T595] stack backtrace: [ 63.310125][ T595] CPU: 3 UID: 0 PID: 595 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 63.310389][ T595] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 63.310606][ T595] Call Trace: [ 63.310735][ T595] [ 63.310826][ T595] dump_stack_lvl+0x82/0xd0 [ 63.311002][ T595] print_deadlock_bug+0x40a/0x650 [ 63.311177][ T595] validate_chain+0x5bf/0xae0 [ 63.311347][ T595] ? __pfx_validate_chain+0x10/0x10 [ 63.311554][ T595] ? hlock_class+0x4e/0x130 [ 63.311727][ T595] ? mark_lock+0x38/0x3e0 [ 63.311858][ T595] __lock_acquire+0xb9a/0x1680 [ 63.312031][ T595] lock_acquire.part.0+0xeb/0x330 [ 63.312199][ T595] ? blocking_notifier_call_chain+0x50/0x90 [ 63.312422][ T595] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 63.312649][ T595] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 63.312820][ T595] ? trace_lock_acquire+0x14c/0x1f0 [ 63.312999][ T595] ? lock_acquire+0x32/0xc0 [ 63.313168][ T595] ? blocking_notifier_call_chain+0x50/0x90 [ 63.313378][ T595] down_read+0x9f/0x340 [ 63.313510][ T595] ? blocking_notifier_call_chain+0x50/0x90 [ 63.313723][ T595] ? __pfx_down_read+0x10/0x10 [ 63.313894][ T595] ? __lock_release+0x103/0x460 [ 63.314066][ T595] ? netconsole_netdev_event+0x2c1/0x620 [ 63.314237][ T595] ? __pfx___lock_release+0x10/0x10 [ 63.314416][ T595] blocking_notifier_call_chain+0x50/0x90 [ 63.314589][ T595] __netdev_upper_dev_unlink+0xd9/0x220 [ 63.314760][ T595] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 63.314974][ T595] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 63.315147][ T595] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 63.315357][ T595] ? rtnl_is_locked+0x15/0x20 [ 63.315538][ T595] netdev_upper_dev_unlink+0x71/0xa0 [ 63.315708][ T595] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 63.315921][ T595] ? netconsole_netdev_event+0x2c1/0x620 [ 63.316099][ T595] ? mutex_is_locked+0x1c/0x60 [ 63.316271][ T595] ? rtnl_is_locked+0x15/0x20 [ 63.316440][ T595] ? netdev_master_upper_dev_get+0x13/0x120 [ 63.316656][ T595] vrf_device_event+0x78/0xe0 [vrf] [ 63.316833][ T595] notifier_call_chain+0xcd/0x150 [ 63.317006][ T595] blocking_notifier_call_chain+0x66/0x90 [ 63.317176][ T595] unregister_netdevice_many_notify+0xa7b/0x1580 [ 63.317397][ T595] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 63.317614][ T595] ? rtnl_dellink+0x228/0xa40 [ 63.317786][ T595] ? sock_def_readable+0x11e/0x300 [ 63.317961][ T595] ? __pfx___mutex_lock+0x10/0x10 [ 63.318132][ T595] ? rtnl_is_locked+0x15/0x20 [ 63.318302][ T595] ? unregister_netdevice_queue+0x70/0x410 [ 63.318521][ T595] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 63.318735][ T595] ? __nla_validate_parse+0x48/0x3d0 [ 63.318907][ T595] rtnl_dellink+0x348/0xa40 [ 63.319078][ T595] ? __pfx_rtnl_dellink+0x10/0x10 [ 63.319262][ T595] ? find_held_lock+0x2c/0x110 [ 63.319441][ T595] ? __lock_release+0x103/0x460 [ 63.319620][ T595] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 63.319814][ T595] ? __pfx___lock_release+0x10/0x10 [ 63.320008][ T595] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 63.320204][ T595] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 63.320394][ T595] ? __pfx_rtnl_dellink+0x10/0x10 [ 63.320592][ T595] rtnetlink_rcv_msg+0x712/0xc10 [ 63.320788][ T595] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 63.320987][ T595] ? hlock_class+0x4e/0x130 [ 63.321181][ T595] ? mark_lock+0x38/0x3e0 [ 63.321329][ T595] ? __lock_acquire+0xb9a/0x1680 [ 63.321540][ T595] netlink_rcv_skb+0x130/0x360 [ 63.321736][ T595] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 63.321932][ T595] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 63.322131][ T595] ? netlink_deliver_tap+0x13e/0x340 [ 63.322328][ T595] ? netlink_deliver_tap+0xc3/0x340 [ 63.322514][ T595] netlink_unicast+0x44b/0x710 [ 63.322699][ T595] ? __pfx_netlink_unicast+0x10/0x10 [ 63.322868][ T595] ? find_held_lock+0x2c/0x110 [ 63.323040][ T595] netlink_sendmsg+0x723/0xbe0 [ 63.323211][ T595] ? __pfx_netlink_sendmsg+0x10/0x10 [ 63.323388][ T595] ____sys_sendmsg+0x7ac/0xa10 [ 63.323565][ T595] ? __pfx_____sys_sendmsg+0x10/0x10 [ 63.323734][ T595] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 63.323950][ T595] ___sys_sendmsg+0xee/0x170 [ 63.324124][ T595] ? __pfx____sys_sendmsg+0x10/0x10 [ 63.324295][ T595] ? kasan_save_stack+0x34/0x50 [ 63.324469][ T595] ? kasan_save_stack+0x24/0x50 [ 63.324642][ T595] ? __kasan_record_aux_stack+0x8e/0xa0 [ 63.324813][ T595] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 63.325034][ T595] ? __x64_sys_close+0x7c/0xd0 [ 63.325206][ T595] ? do_syscall_64+0xc1/0x1d0 [ 63.325385][ T595] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 63.325602][ T595] ? __lock_acquire+0xb9a/0x1680 [ 63.325777][ T595] ? find_held_lock+0x2c/0x110 [ 63.325951][ T595] ? __lock_release+0x103/0x460 [ 63.326126][ T595] ? __virt_addr_valid+0x22b/0x430 [ 63.326298][ T595] ? __pfx___lock_release+0x10/0x10 [ 63.326475][ T595] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 63.326650][ T595] __sys_sendmsg+0x109/0x1a0 [ 63.326821][ T595] ? __pfx___sys_sendmsg+0x10/0x10 [ 63.326990][ T595] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 63.327209][ T595] do_syscall_64+0xc1/0x1d0 [ 63.327385][ T595] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 63.327630][ T595] RIP: 0033:0x7fdb01a169a7 [ 63.327834][ T595] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 63.328471][ T595] RSP: 002b:00007ffe49ab4278 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 63.328741][ T595] RAX: ffffffffffffffda RBX: 00007ffe49ab49a0 RCX: 00007fdb01a169a7 [ 63.328998][ T595] RDX: 0000000000000000 RSI: 00007ffe49ab42e0 RDI: 0000000000000005 [ 63.329252][ T595] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 63.329509][ T595] R10: 00007fdb018d4ef8 R11: 0000000000000246 R12: 0000000000000002 [ 63.329772][ T595] R13: 000000006779538e R14: 0000000000498600 R15: 0000000000000000 [ 63.330029][ T595]