[ 11.619422][ T272] ip (272) used greatest stack depth: 23984 bytes left [ 14.655891][ T313] gre: GRE over IPv4 demultiplexor driver [ 14.669378][ T313] ip_gre: GRE over IPv4 tunneling driver [ 14.730088][ T312] ip (312) used greatest stack depth: 23728 bytes left [ 15.317826][ T323] GACT probability NOT on [ 15.515432][ T325] ip6_gre: GRE over IPv6 tunneling driver [ 15.657231][ T25] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 15.771101][ T65] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 15.785072][ T55] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 16.675064][ T65] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 16.725026][ T340] br1: port 1(veth1) entered blocking state [ 16.725498][ T340] br1: port 1(veth1) entered disabled state [ 16.725926][ T340] veth1: entered allmulticast mode [ 16.728359][ T340] veth1: entered promiscuous mode [ 16.804050][ T55] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 16.817056][ T123] br1: port 1(veth1) entered blocking state [ 16.817574][ T123] br1: port 1(veth1) entered forwarding state [ 16.897245][ T343] br1: port 2(veth2) entered blocking state [ 16.897705][ T343] br1: port 2(veth2) entered disabled state [ 16.898084][ T343] veth2: entered allmulticast mode [ 16.900346][ T343] veth2: entered promiscuous mode [ 16.990931][ T40] br1: port 2(veth2) entered blocking state [ 16.991275][ T40] br1: port 2(veth2) entered forwarding state [ 17.521082][ T9] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 17.699230][ T65] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 17.700036][ T9] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 17.700065][ T65] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 18.211100][ T65] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 21.603145][ C1] ip6_tnl_xmit_ctl: 3 callbacks suppressed [ 21.603666][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 24.182793][ T381] Mirror/redirect action on [ 29.667751][ C3] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 46.051188][ C0] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 77.283194][ C0] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 96.631106][ T740] br1: port 1(veth1) entered disabled state [ 96.714783][ T741] br1: port 2(veth2) entered disabled state [ 96.797584][ T742] veth2: left allmulticast mode [ 96.797891][ T742] veth2: left promiscuous mode [ 96.798255][ T742] br1: port 2(veth2) entered disabled state [ 96.800475][ T742] veth1: left allmulticast mode [ 96.800721][ T742] veth1: left promiscuous mode [ 96.802227][ T742] br1: port 1(veth1) entered disabled state [ 97.070762][ T744] [ 97.070937][ T744] ============================================ [ 97.071145][ T744] WARNING: possible recursive locking detected [ 97.071352][ T744] 6.13.0-rc5-virtme #1 Not tainted [ 97.071519][ T744] -------------------------------------------- [ 97.071721][ T744] ip/744 is trying to acquire lock: [ 97.071887][ T744] ffffffffacfd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 97.072230][ T744] [ 97.072230][ T744] but task is already holding lock: [ 97.072470][ T744] ffffffffacfd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 97.072799][ T744] [ 97.072799][ T744] other info that might help us debug this: [ 97.073043][ T744] Possible unsafe locking scenario: [ 97.073043][ T744] [ 97.073276][ T744] CPU0 [ 97.073396][ T744] ---- [ 97.073514][ T744] lock((netdev_chain).rwsem); [ 97.073673][ T744] lock((netdev_chain).rwsem); [ 97.073831][ T744] [ 97.073831][ T744] *** DEADLOCK *** [ 97.073831][ T744] [ 97.074068][ T744] May be due to missing lock nesting notation [ 97.074068][ T744] [ 97.074305][ T744] 2 locks held by ip/744: [ 97.074425][ T744] #0: ffffffffacfe7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 97.074714][ T744] #1: ffffffffacfd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 97.075035][ T744] [ 97.075035][ T744] stack backtrace: [ 97.075230][ T744] CPU: 2 UID: 0 PID: 744 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 97.075475][ T744] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 97.075672][ T744] Call Trace: [ 97.075794][ T744] [ 97.075877][ T744] dump_stack_lvl+0x82/0xd0 [ 97.076047][ T744] print_deadlock_bug+0x40a/0x650 [ 97.076204][ T744] validate_chain+0x5bf/0xae0 [ 97.076364][ T744] ? __pfx_validate_chain+0x10/0x10 [ 97.076529][ T744] ? hlock_class+0x4e/0x130 [ 97.076689][ T744] ? mark_lock+0x38/0x3e0 [ 97.076808][ T744] __lock_acquire+0xb9a/0x1680 [ 97.076967][ T744] lock_acquire.part.0+0xeb/0x330 [ 97.077125][ T744] ? blocking_notifier_call_chain+0x50/0x90 [ 97.077326][ T744] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 97.077526][ T744] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 97.077690][ T744] ? trace_lock_acquire+0x14c/0x1f0 [ 97.077849][ T744] ? lock_acquire+0x32/0xc0 [ 97.078009][ T744] ? blocking_notifier_call_chain+0x50/0x90 [ 97.078206][ T744] down_read+0x9f/0x340 [ 97.078327][ T744] ? blocking_notifier_call_chain+0x50/0x90 [ 97.078523][ T744] ? __pfx_down_read+0x10/0x10 [ 97.078680][ T744] ? __lock_release+0x103/0x460 [ 97.078834][ T744] ? netconsole_netdev_event+0x2c1/0x620 [ 97.078998][ T744] ? __pfx___lock_release+0x10/0x10 [ 97.079158][ T744] blocking_notifier_call_chain+0x50/0x90 [ 97.079315][ T744] __netdev_upper_dev_unlink+0xd9/0x220 [ 97.079474][ T744] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 97.079671][ T744] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 97.079829][ T744] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 97.080025][ T744] ? rtnl_is_locked+0x15/0x20 [ 97.080184][ T744] netdev_upper_dev_unlink+0x71/0xa0 [ 97.080341][ T744] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 97.080537][ T744] ? netconsole_netdev_event+0x2c1/0x620 [ 97.080697][ T744] ? mutex_is_locked+0x1c/0x60 [ 97.080866][ T744] ? rtnl_is_locked+0x15/0x20 [ 97.081027][ T744] ? netdev_master_upper_dev_get+0x13/0x120 [ 97.081229][ T744] vrf_device_event+0x78/0xe0 [vrf] [ 97.081390][ T744] notifier_call_chain+0xcd/0x150 [ 97.081551][ T744] blocking_notifier_call_chain+0x66/0x90 [ 97.081711][ T744] unregister_netdevice_many_notify+0xa7b/0x1580 [ 97.081911][ T744] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 97.082110][ T744] ? rtnl_dellink+0x228/0xa40 [ 97.082276][ T744] ? sock_def_readable+0x11e/0x300 [ 97.082439][ T744] ? __pfx___mutex_lock+0x10/0x10 [ 97.082597][ T744] ? rtnl_is_locked+0x15/0x20 [ 97.082759][ T744] ? unregister_netdevice_queue+0x70/0x410 [ 97.082970][ T744] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 97.083167][ T744] ? __nla_validate_parse+0x48/0x3d0 [ 97.083329][ T744] rtnl_dellink+0x348/0xa40 [ 97.083499][ T744] ? __pfx_rtnl_dellink+0x10/0x10 [ 97.083677][ T744] ? find_held_lock+0x2c/0x110 [ 97.083839][ T744] ? __lock_release+0x103/0x460 [ 97.083998][ T744] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 97.084159][ T744] ? __pfx___lock_release+0x10/0x10 [ 97.084321][ T744] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 97.084480][ T744] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 97.084644][ T744] ? __pfx_rtnl_dellink+0x10/0x10 [ 97.084803][ T744] rtnetlink_rcv_msg+0x712/0xc10 [ 97.084962][ T744] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 97.085118][ T744] ? hlock_class+0x4e/0x130 [ 97.085273][ T744] ? mark_lock+0x38/0x3e0 [ 97.085393][ T744] ? __lock_acquire+0xb9a/0x1680 [ 97.085551][ T744] netlink_rcv_skb+0x130/0x360 [ 97.085708][ T744] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 97.085871][ T744] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 97.086031][ T744] ? netlink_deliver_tap+0x13e/0x340 [ 97.086197][ T744] ? netlink_deliver_tap+0xc3/0x340 [ 97.086358][ T744] netlink_unicast+0x44b/0x710 [ 97.086517][ T744] ? __pfx_netlink_unicast+0x10/0x10 [ 97.086675][ T744] ? find_held_lock+0x2c/0x110 [ 97.086836][ T744] netlink_sendmsg+0x723/0xbe0 [ 97.087002][ T744] ? __pfx_netlink_sendmsg+0x10/0x10 [ 97.087165][ T744] ____sys_sendmsg+0x7ac/0xa10 [ 97.087323][ T744] ? __pfx_____sys_sendmsg+0x10/0x10 [ 97.087480][ T744] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 97.087679][ T744] ___sys_sendmsg+0xee/0x170 [ 97.087839][ T744] ? __pfx____sys_sendmsg+0x10/0x10 [ 97.087996][ T744] ? kasan_save_stack+0x34/0x50 [ 97.088159][ T744] ? kasan_save_stack+0x24/0x50 [ 97.088315][ T744] ? __kasan_record_aux_stack+0x8e/0xa0 [ 97.088472][ T744] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 97.088675][ T744] ? __x64_sys_close+0x7c/0xd0 [ 97.088837][ T744] ? do_syscall_64+0xc1/0x1d0 [ 97.088994][ T744] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 97.089195][ T744] ? __lock_acquire+0xb9a/0x1680 [ 97.089361][ T744] ? find_held_lock+0x2c/0x110 [ 97.089523][ T744] ? __lock_release+0x103/0x460 [ 97.089677][ T744] ? __virt_addr_valid+0x22b/0x430 [ 97.089834][ T744] ? __pfx___lock_release+0x10/0x10 [ 97.089992][ T744] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 97.090155][ T744] __sys_sendmsg+0x109/0x1a0 [ 97.090310][ T744] ? __pfx___sys_sendmsg+0x10/0x10 [ 97.090470][ T744] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 97.090671][ T744] do_syscall_64+0xc1/0x1d0 [ 97.090840][ T744] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 97.091040][ T744] RIP: 0033:0x7f5db4cdb9a7 [ 97.091207][ T744] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 97.091763][ T744] RSP: 002b:00007fff9e24b7d8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 97.092001][ T744] RAX: ffffffffffffffda RBX: 00007fff9e24bf00 RCX: 00007f5db4cdb9a7 [ 97.092237][ T744] RDX: 0000000000000000 RSI: 00007fff9e24b840 RDI: 0000000000000005 [ 97.092474][ T744] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 97.092717][ T744] R10: 00007f5db4b99ef8 R11: 0000000000000246 R12: 0000000000000002 [ 97.092951][ T744] R13: 0000000067795661 R14: 0000000000498600 R15: 0000000000000000 [ 97.093195][ T744]