[ 12.140500][ T251] ip (251) used greatest stack depth: 24400 bytes left [ 16.839191][ T321] gre: GRE over IPv4 demultiplexor driver [ 16.860257][ T321] ip_gre: GRE over IPv4 tunneling driver [ 17.266599][ T327] ip (327) used greatest stack depth: 24376 bytes left [ 17.746021][ T331] GACT probability NOT on [ 18.036441][ T333] ip6_gre: GRE over IPv6 tunneling driver [ 18.268659][ T9] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 18.398541][ T9] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 18.993978][ T11] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 19.249555][ T35] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 19.558153][ T347] br1: port 1(veth1) entered blocking state [ 19.558844][ T347] br1: port 1(veth1) entered disabled state [ 19.559487][ T347] veth1: entered allmulticast mode [ 19.563591][ T347] veth1: entered promiscuous mode [ 19.675480][ T151] br1: port 1(veth1) entered blocking state [ 19.676100][ T151] br1: port 1(veth1) entered forwarding state [ 19.770078][ T349] br1: port 2(veth2) entered blocking state [ 19.770383][ T349] br1: port 2(veth2) entered disabled state [ 19.770680][ T349] veth2: entered allmulticast mode [ 19.772648][ T349] veth2: entered promiscuous mode [ 19.891059][ T37] br1: port 2(veth2) entered blocking state [ 19.891481][ T37] br1: port 2(veth2) entered forwarding state [ 20.017979][ T11] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 20.019116][ T11] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 20.025905][ T50] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 20.492543][ T50] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 20.690878][ T359] 8021q: 802.1Q VLAN Support v1.8 [ 21.361543][ T50] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 21.490741][ T11] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 21.840804][ T373] br1: port 3(veth4) entered blocking state [ 21.841093][ T373] br1: port 3(veth4) entered disabled state [ 21.841629][ T373] veth4: entered allmulticast mode [ 21.843620][ T373] veth4: entered promiscuous mode [ 21.844451][ T373] br1: port 3(veth4) entered blocking state [ 21.844868][ T373] br1: port 3(veth4) entered forwarding state [ 24.561795][ C1] ip6_tnl_xmit_ctl: 3 callbacks suppressed [ 24.562348][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 28.293008][ T398] Mirror/redirect action on [ 28.328176][ T397] tc (397) used greatest stack depth: 24232 bytes left [ 33.266455][ C2] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 51.185877][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 91.633519][ C2] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 169.457631][ C0] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 274.319484][ T1470] br1: port 3(veth4) entered disabled state [ 279.918065][ T1492] br1: port 3(veth4) entered forwarding state [ 290.476072][ T1548] br1: port 3(veth4) entered disabled state [ 296.227208][ T1570] br1: port 3(veth4) entered forwarding state [ 302.248098][ T1600] veth2: left allmulticast mode [ 302.248381][ T1600] veth2: left promiscuous mode [ 302.248727][ T1600] br1: port 2(veth2) entered disabled state [ 302.342267][ T1601] veth4: left allmulticast mode [ 302.342583][ T1601] veth4: left promiscuous mode [ 302.342929][ T1601] br1: port 3(veth4) entered disabled state [ 302.668051][ T1604] [ 302.668235][ T1604] ============================================ [ 302.668429][ T1604] WARNING: possible recursive locking detected [ 302.668634][ T1604] 6.13.0-rc5-virtme #1 Not tainted [ 302.668858][ T1604] -------------------------------------------- [ 302.669040][ T1604] ip/1604 is trying to acquire lock: [ 302.669200][ T1604] ffffffff9d9d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 302.669581][ T1604] [ 302.669581][ T1604] but task is already holding lock: [ 302.669809][ T1604] ffffffff9d9d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 302.670122][ T1604] [ 302.670122][ T1604] other info that might help us debug this: [ 302.670371][ T1604] Possible unsafe locking scenario: [ 302.670371][ T1604] [ 302.670693][ T1604] CPU0 [ 302.670809][ T1604] ---- [ 302.670945][ T1604] lock((netdev_chain).rwsem); [ 302.671131][ T1604] lock((netdev_chain).rwsem); [ 302.671293][ T1604] [ 302.671293][ T1604] *** DEADLOCK *** [ 302.671293][ T1604] [ 302.671523][ T1604] May be due to missing lock nesting notation [ 302.671523][ T1604] [ 302.671781][ T1604] 2 locks held by ip/1604: [ 302.671974][ T1604] #0: ffffffff9d9e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 302.672335][ T1604] #1: ffffffff9d9d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 302.672673][ T1604] [ 302.672673][ T1604] stack backtrace: [ 302.672867][ T1604] CPU: 0 UID: 0 PID: 1604 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 302.673110][ T1604] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 302.673321][ T1604] Call Trace: [ 302.673514][ T1604] [ 302.673641][ T1604] dump_stack_lvl+0x82/0xd0 [ 302.673811][ T1604] print_deadlock_bug+0x40a/0x650 [ 302.673992][ T1604] validate_chain+0x5bf/0xae0 [ 302.674221][ T1604] ? __pfx_validate_chain+0x10/0x10 [ 302.674380][ T1604] ? hlock_class+0x4e/0x130 [ 302.674576][ T1604] ? mark_lock+0x38/0x3e0 [ 302.674690][ T1604] __lock_acquire+0xb9a/0x1680 [ 302.674848][ T1604] lock_acquire.part.0+0xeb/0x330 [ 302.674998][ T1604] ? blocking_notifier_call_chain+0x50/0x90 [ 302.675212][ T1604] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 302.675508][ T1604] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 302.675660][ T1604] ? trace_lock_acquire+0x14c/0x1f0 [ 302.675809][ T1604] ? lock_acquire+0x32/0xc0 [ 302.675963][ T1604] ? blocking_notifier_call_chain+0x50/0x90 [ 302.676158][ T1604] down_read+0x9f/0x340 [ 302.676308][ T1604] ? blocking_notifier_call_chain+0x50/0x90 [ 302.676553][ T1604] ? __pfx_down_read+0x10/0x10 [ 302.676712][ T1604] ? __lock_release+0x103/0x460 [ 302.676868][ T1604] ? netconsole_netdev_event+0x2c1/0x620 [ 302.677027][ T1604] ? __pfx___lock_release+0x10/0x10 [ 302.677194][ T1604] blocking_notifier_call_chain+0x50/0x90 [ 302.677361][ T1604] __netdev_upper_dev_unlink+0xd9/0x220 [ 302.677518][ T1604] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 302.677704][ T1604] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 302.677858][ T1604] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 302.678109][ T1604] ? rtnl_is_locked+0x15/0x20 [ 302.678304][ T1604] netdev_upper_dev_unlink+0x71/0xa0 [ 302.678453][ T1604] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 302.678650][ T1604] ? netconsole_netdev_event+0x2c1/0x620 [ 302.678804][ T1604] ? mutex_is_locked+0x1c/0x60 [ 302.678956][ T1604] ? rtnl_is_locked+0x15/0x20 [ 302.679108][ T1604] ? netdev_master_upper_dev_get+0x13/0x120 [ 302.679408][ T1604] vrf_device_event+0x78/0xe0 [vrf] [ 302.679662][ T1604] notifier_call_chain+0xcd/0x150 [ 302.679846][ T1604] blocking_notifier_call_chain+0x66/0x90 [ 302.680011][ T1604] unregister_netdevice_many_notify+0xa7b/0x1580 [ 302.680221][ T1604] ? __lock_release+0x103/0x460 [ 302.680381][ T1604] ? __pfx___lock_release+0x10/0x10 [ 302.680549][ T1604] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 302.680780][ T1604] ? hlock_class+0x4e/0x130 [ 302.680943][ T1604] ? mark_held_locks+0x9e/0xe0 [ 302.681179][ T1604] ? __pfx_vlan_info_rcu_free+0x10/0x10 [ 302.681347][ T1604] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 302.681587][ T1604] rtnl_dellink+0x348/0xa40 [ 302.681751][ T1604] ? __pfx_rtnl_dellink+0x10/0x10 [ 302.681924][ T1604] ? find_held_lock+0x2c/0x110 [ 302.682085][ T1604] ? __lock_release+0x103/0x460 [ 302.682286][ T1604] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 302.682501][ T1604] ? __pfx___lock_release+0x10/0x10 [ 302.682667][ T1604] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 302.682826][ T1604] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 302.682987][ T1604] ? __pfx_rtnl_dellink+0x10/0x10 [ 302.683151][ T1604] rtnetlink_rcv_msg+0x712/0xc10 [ 302.683394][ T1604] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 302.683571][ T1604] ? hlock_class+0x4e/0x130 [ 302.683732][ T1604] ? mark_lock+0x38/0x3e0 [ 302.683856][ T1604] ? __lock_acquire+0xb9a/0x1680 [ 302.684015][ T1604] netlink_rcv_skb+0x130/0x360 [ 302.684182][ T1604] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 302.684346][ T1604] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 302.684548][ T1604] ? netlink_deliver_tap+0x13e/0x340 [ 302.684727][ T1604] ? netlink_deliver_tap+0xc3/0x340 [ 302.684888][ T1604] netlink_unicast+0x44b/0x710 [ 302.685113][ T1604] ? __pfx_netlink_unicast+0x10/0x10 [ 302.685303][ T1604] ? find_held_lock+0x2c/0x110 [ 302.685469][ T1604] netlink_sendmsg+0x723/0xbe0 [ 302.685628][ T1604] ? __pfx_netlink_sendmsg+0x10/0x10 [ 302.685790][ T1604] ____sys_sendmsg+0x7ac/0xa10 [ 302.685949][ T1604] ? __pfx_____sys_sendmsg+0x10/0x10 [ 302.686107][ T1604] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 302.686416][ T1604] ___sys_sendmsg+0xee/0x170 [ 302.686582][ T1604] ? __pfx____sys_sendmsg+0x10/0x10 [ 302.686741][ T1604] ? kasan_save_stack+0x34/0x50 [ 302.686960][ T1604] ? kasan_save_stack+0x24/0x50 [ 302.687119][ T1604] ? __kasan_record_aux_stack+0x8e/0xa0 [ 302.687317][ T1604] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 302.687516][ T1604] ? __x64_sys_close+0x7c/0xd0 [ 302.687680][ T1604] ? do_syscall_64+0xc1/0x1d0 [ 302.687840][ T1604] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 302.688088][ T1604] ? __lock_acquire+0xb9a/0x1680 [ 302.688281][ T1604] ? find_held_lock+0x2c/0x110 [ 302.688448][ T1604] ? __lock_release+0x103/0x460 [ 302.688665][ T1604] ? __virt_addr_valid+0x22b/0x430 [ 302.688828][ T1604] ? __pfx___lock_release+0x10/0x10 [ 302.688992][ T1604] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 302.689160][ T1604] __sys_sendmsg+0x109/0x1a0 [ 302.689330][ T1604] ? __pfx___sys_sendmsg+0x10/0x10 [ 302.689492][ T1604] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 302.689742][ T1604] do_syscall_64+0xc1/0x1d0 [ 302.689940][ T1604] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 302.690141][ T1604] RIP: 0033:0x7f6fc5b069a7 [ 302.690394][ T1604] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 302.690974][ T1604] RSP: 002b:00007ffddff8fa58 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 302.691252][ T1604] RAX: ffffffffffffffda RBX: 00007ffddff90180 RCX: 00007f6fc5b069a7 [ 302.691562][ T1604] RDX: 0000000000000000 RSI: 00007ffddff8fac0 RDI: 0000000000000005 [ 302.691788][ T1604] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 302.692048][ T1604] R10: 00007f6fc59c4ef8 R11: 0000000000000246 R12: 0000000000000002 [ 302.692315][ T1604] R13: 000000006779511f R14: 0000000000498600 R15: 0000000000000000 [ 302.692545][ T1604] [ 302.715456][ T1604] ip (1604) used greatest stack depth: 23840 bytes left [ 303.169214][ T1611] br1: port 1(veth1) entered disabled state [ 303.290898][ T1613] veth1: left allmulticast mode [ 303.291132][ T1613] veth1: left promiscuous mode [ 303.291477][ T1613] br1: port 1(veth1) entered disabled state