[ 85.525934][ T1462] gre: GRE over IPv4 demultiplexor driver [ 85.547872][ T1462] ip_gre: GRE over IPv4 tunneling driver [ 85.878969][ T1471] ip (1471) used greatest stack depth: 23608 bytes left [ 86.227480][ T1475] GACT probability NOT on [ 86.454519][ T1477] ip6_gre: GRE over IPv6 tunneling driver [ 86.614720][ T9] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 86.746516][ T239] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 87.316348][ T68] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 87.378489][ T239] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 87.422046][ T1490] br1: port 1(veth1) entered blocking state [ 87.422349][ T1490] br1: port 1(veth1) entered disabled state [ 87.422627][ T1490] veth1: entered allmulticast mode [ 87.424556][ T1490] veth1: entered promiscuous mode [ 87.504318][ T40] br1: port 1(veth1) entered blocking state [ 87.504733][ T40] br1: port 1(veth1) entered forwarding state [ 87.583368][ T1492] br1: port 2(veth2) entered blocking state [ 87.583735][ T1492] br1: port 2(veth2) entered disabled state [ 87.584157][ T1492] veth2: entered allmulticast mode [ 87.587251][ T1492] veth2: entered promiscuous mode [ 87.661449][ T37] br1: port 2(veth2) entered blocking state [ 87.661732][ T37] br1: port 2(veth2) entered forwarding state [ 88.193681][ T239] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 88.338987][ T68] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 88.339793][ T68] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 88.394738][ T68] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 88.598038][ T1507] br2: port 1(veth4) entered blocking state [ 88.598422][ T1507] br2: port 1(veth4) entered disabled state [ 88.598704][ T1507] veth4: entered allmulticast mode [ 88.600846][ T1507] veth4: entered promiscuous mode [ 88.602097][ T1507] br2: port 1(veth4) entered blocking state [ 88.602521][ T1507] br2: port 1(veth4) entered forwarding state [ 88.851464][ T239] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 89.234966][ T239] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 91.987420][ C1] ip6_tnl_xmit_ctl: 3 callbacks suppressed [ 91.987428][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 95.412303][ T1540] Mirror/redirect action on [ 99.794422][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 115.154747][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 132.277830][ T1734] veth4: left allmulticast mode [ 132.278058][ T1734] veth4: left promiscuous mode [ 132.278406][ T1734] br2: port 1(veth4) entered disabled state [ 132.351244][ T1734] ip (1734) used greatest stack depth: 23384 bytes left [ 132.837525][ T1740] br1: port 1(veth1) entered disabled state [ 132.915840][ T1741] br1: port 2(veth2) entered disabled state [ 133.005159][ T1742] veth2: left allmulticast mode [ 133.006429][ T1742] veth2: left promiscuous mode [ 133.006824][ T1742] br1: port 2(veth2) entered disabled state [ 133.008257][ T1742] veth1: left allmulticast mode [ 133.008517][ T1742] veth1: left promiscuous mode [ 133.008857][ T1742] br1: port 1(veth1) entered disabled state [ 133.257215][ T1744] [ 133.257371][ T1744] ============================================ [ 133.257571][ T1744] WARNING: possible recursive locking detected [ 133.257761][ T1744] 6.13.0-rc5-virtme #1 Not tainted [ 133.257917][ T1744] -------------------------------------------- [ 133.258106][ T1744] ip/1744 is trying to acquire lock: [ 133.258265][ T1744] ffffffffaa7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 133.258562][ T1744] [ 133.258562][ T1744] but task is already holding lock: [ 133.258774][ T1744] ffffffffaa7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 133.259064][ T1744] [ 133.259064][ T1744] other info that might help us debug this: [ 133.259304][ T1744] Possible unsafe locking scenario: [ 133.259304][ T1744] [ 133.259523][ T1744] CPU0 [ 133.259639][ T1744] ---- [ 133.259750][ T1744] lock((netdev_chain).rwsem); [ 133.259898][ T1744] lock((netdev_chain).rwsem); [ 133.260044][ T1744] [ 133.260044][ T1744] *** DEADLOCK *** [ 133.260044][ T1744] [ 133.260253][ T1744] May be due to missing lock nesting notation [ 133.260253][ T1744] [ 133.260474][ T1744] 2 locks held by ip/1744: [ 133.260620][ T1744] #0: ffffffffaa7e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 133.260885][ T1744] #1: ffffffffaa7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 133.261176][ T1744] [ 133.261176][ T1744] stack backtrace: [ 133.261355][ T1744] CPU: 3 UID: 0 PID: 1744 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 133.261580][ T1744] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 133.261761][ T1744] Call Trace: [ 133.261873][ T1744] [ 133.261950][ T1744] dump_stack_lvl+0x82/0xd0 [ 133.262105][ T1744] print_deadlock_bug+0x40a/0x650 [ 133.262256][ T1744] validate_chain+0x5bf/0xae0 [ 133.262408][ T1744] ? __pfx_validate_chain+0x10/0x10 [ 133.262562][ T1744] ? hlock_class+0x4e/0x130 [ 133.262714][ T1744] ? mark_lock+0x38/0x3e0 [ 133.262869][ T1744] __lock_acquire+0xb9a/0x1680 [ 133.263032][ T1744] lock_acquire.part.0+0xeb/0x330 [ 133.263193][ T1744] ? blocking_notifier_call_chain+0x50/0x90 [ 133.263394][ T1744] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 133.263611][ T1744] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 133.263781][ T1744] ? trace_lock_acquire+0x14c/0x1f0 [ 133.263953][ T1744] ? lock_acquire+0x32/0xc0 [ 133.264115][ T1744] ? blocking_notifier_call_chain+0x50/0x90 [ 133.264316][ T1744] down_read+0x9f/0x340 [ 133.264439][ T1744] ? blocking_notifier_call_chain+0x50/0x90 [ 133.264648][ T1744] ? __pfx_down_read+0x10/0x10 [ 133.264810][ T1744] ? __lock_release+0x103/0x460 [ 133.264974][ T1744] ? netconsole_netdev_event+0x2c1/0x620 [ 133.265144][ T1744] ? __pfx___lock_release+0x10/0x10 [ 133.265304][ T1744] blocking_notifier_call_chain+0x50/0x90 [ 133.265468][ T1744] __netdev_upper_dev_unlink+0xd9/0x220 [ 133.265630][ T1744] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 133.265829][ T1744] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 133.265992][ T1744] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 133.266208][ T1744] ? rtnl_is_locked+0x15/0x20 [ 133.266373][ T1744] netdev_upper_dev_unlink+0x71/0xa0 [ 133.266536][ T1744] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 133.266737][ T1744] ? netconsole_netdev_event+0x2c1/0x620 [ 133.266901][ T1744] ? mutex_is_locked+0x1c/0x60 [ 133.267065][ T1744] ? rtnl_is_locked+0x15/0x20 [ 133.267224][ T1744] ? netdev_master_upper_dev_get+0x13/0x120 [ 133.267433][ T1744] vrf_device_event+0x78/0xe0 [vrf] [ 133.267606][ T1744] notifier_call_chain+0xcd/0x150 [ 133.267769][ T1744] blocking_notifier_call_chain+0x66/0x90 [ 133.267930][ T1744] unregister_netdevice_many_notify+0xa7b/0x1580 [ 133.268130][ T1744] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 133.268341][ T1744] ? rtnl_dellink+0x228/0xa40 [ 133.268510][ T1744] ? sock_def_readable+0x11e/0x300 [ 133.268675][ T1744] ? __pfx___mutex_lock+0x10/0x10 [ 133.268843][ T1744] ? rtnl_is_locked+0x15/0x20 [ 133.269004][ T1744] ? unregister_netdevice_queue+0x70/0x410 [ 133.269204][ T1744] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 133.269406][ T1744] ? __nla_validate_parse+0x48/0x3d0 [ 133.269572][ T1744] rtnl_dellink+0x348/0xa40 [ 133.269738][ T1744] ? __pfx_rtnl_dellink+0x10/0x10 [ 133.269915][ T1744] ? find_held_lock+0x2c/0x110 [ 133.270080][ T1744] ? __lock_release+0x103/0x460 [ 133.270239][ T1744] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 133.270400][ T1744] ? __pfx___lock_release+0x10/0x10 [ 133.270565][ T1744] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 133.270729][ T1744] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 133.270895][ T1744] ? __pfx_rtnl_dellink+0x10/0x10 [ 133.271055][ T1744] rtnetlink_rcv_msg+0x712/0xc10 [ 133.271214][ T1744] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 133.271372][ T1744] ? hlock_class+0x4e/0x130 [ 133.271532][ T1744] ? mark_lock+0x38/0x3e0 [ 133.271656][ T1744] ? __lock_acquire+0xb9a/0x1680 [ 133.271816][ T1744] netlink_rcv_skb+0x130/0x360 [ 133.271977][ T1744] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 133.272145][ T1744] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 133.272312][ T1744] ? netlink_deliver_tap+0x13e/0x340 [ 133.272476][ T1744] ? netlink_deliver_tap+0xc3/0x340 [ 133.272638][ T1744] netlink_unicast+0x44b/0x710 [ 133.272800][ T1744] ? __pfx_netlink_unicast+0x10/0x10 [ 133.272961][ T1744] ? find_held_lock+0x2c/0x110 [ 133.273122][ T1744] netlink_sendmsg+0x723/0xbe0 [ 133.273293][ T1744] ? __pfx_netlink_sendmsg+0x10/0x10 [ 133.273456][ T1744] ____sys_sendmsg+0x7ac/0xa10 [ 133.273616][ T1744] ? __pfx_____sys_sendmsg+0x10/0x10 [ 133.273777][ T1744] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 133.273984][ T1744] ___sys_sendmsg+0xee/0x170 [ 133.274145][ T1744] ? __pfx____sys_sendmsg+0x10/0x10 [ 133.274308][ T1744] ? kasan_save_stack+0x34/0x50 [ 133.274479][ T1744] ? kasan_save_stack+0x24/0x50 [ 133.274639][ T1744] ? __kasan_record_aux_stack+0x8e/0xa0 [ 133.274801][ T1744] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 133.274999][ T1744] ? __x64_sys_close+0x7c/0xd0 [ 133.275160][ T1744] ? do_syscall_64+0xc1/0x1d0 [ 133.275318][ T1744] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 133.275520][ T1744] ? __lock_acquire+0xb9a/0x1680 [ 133.275687][ T1744] ? find_held_lock+0x2c/0x110 [ 133.275853][ T1744] ? __lock_release+0x103/0x460 [ 133.276015][ T1744] ? __virt_addr_valid+0x22b/0x430 [ 133.276176][ T1744] ? __pfx___lock_release+0x10/0x10 [ 133.276338][ T1744] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 133.276503][ T1744] __sys_sendmsg+0x109/0x1a0 [ 133.276664][ T1744] ? __pfx___sys_sendmsg+0x10/0x10 [ 133.276829][ T1744] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 133.277034][ T1744] do_syscall_64+0xc1/0x1d0 [ 133.277194][ T1744] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 133.277392][ T1744] RIP: 0033:0x7f21252e39a7 [ 133.277560][ T1744] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 133.278127][ T1744] RSP: 002b:00007ffe3d7c74f8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 133.278383][ T1744] RAX: ffffffffffffffda RBX: 00007ffe3d7c7c20 RCX: 00007f21252e39a7 [ 133.278627][ T1744] RDX: 0000000000000000 RSI: 00007ffe3d7c7560 RDI: 0000000000000005 [ 133.278865][ T1744] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 133.279112][ T1744] R10: 00007f21251a1ef8 R11: 0000000000000246 R12: 0000000000000002 [ 133.279350][ T1744] R13: 000000006779005d R14: 0000000000498600 R15: 0000000000000000 [ 133.279591][ T1744]