[ 33.571755][ T504] gre: GRE over IPv4 demultiplexor driver [ 33.594391][ T504] ip_gre: GRE over IPv4 tunneling driver [ 34.211509][ T516] GACT probability NOT on [ 34.432769][ T518] ip6_gre: GRE over IPv6 tunneling driver [ 34.617574][ T9] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 34.711350][ T55] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 35.166312][ T65] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 35.471374][ T55] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 35.703911][ T533] br1: port 1(veth1) entered blocking state [ 35.704460][ T533] br1: port 1(veth1) entered disabled state [ 35.704786][ T533] veth1: entered allmulticast mode [ 35.707002][ T533] veth1: entered promiscuous mode [ 35.807832][ T154] br1: port 1(veth1) entered blocking state [ 35.808313][ T154] br1: port 1(veth1) entered forwarding state [ 35.883295][ T535] br1: port 2(veth2) entered blocking state [ 35.883863][ T535] br1: port 2(veth2) entered disabled state [ 35.884160][ T535] veth2: entered allmulticast mode [ 35.886159][ T535] veth2: entered promiscuous mode [ 35.971422][ T57] br1: port 2(veth2) entered blocking state [ 35.971773][ T57] br1: port 2(veth2) entered forwarding state [ 36.175967][ T65] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 36.177059][ T65] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 36.382667][ T68] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 36.489327][ T9] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 36.656123][ T545] 8021q: 802.1Q VLAN Support v1.8 [ 36.854572][ T9] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 37.390365][ T65] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 37.688559][ T559] br1: port 3(veth4) entered blocking state [ 37.688894][ T559] br1: port 3(veth4) entered disabled state [ 37.689905][ T559] veth4: entered allmulticast mode [ 37.691904][ T559] veth4: entered promiscuous mode [ 37.692760][ T559] br1: port 3(veth4) entered blocking state [ 37.693199][ T559] br1: port 3(veth4) entered forwarding state [ 40.206356][ C3] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 48.591228][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 64.974367][ C2] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 99.790273][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 169.422327][ C2] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 279.665313][ T1653] br1: port 3(veth4) entered disabled state [ 285.190805][ T1675] br1: port 3(veth4) entered forwarding state [ 295.674009][ T1731] br1: port 3(veth4) entered disabled state [ 300.495729][ C2] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 301.130252][ T1753] br1: port 3(veth4) entered forwarding state [ 306.775442][ T1783] veth2: left allmulticast mode [ 306.775692][ T1783] veth2: left promiscuous mode [ 306.776023][ T1783] br1: port 2(veth2) entered disabled state [ 306.857765][ T1784] veth4: left allmulticast mode [ 306.857990][ T1784] veth4: left promiscuous mode [ 306.858319][ T1784] br1: port 3(veth4) entered disabled state [ 307.110923][ T1787] [ 307.111075][ T1787] ============================================ [ 307.111272][ T1787] WARNING: possible recursive locking detected [ 307.111455][ T1787] 6.13.0-rc5-virtme #1 Not tainted [ 307.111619][ T1787] -------------------------------------------- [ 307.111824][ T1787] ip/1787 is trying to acquire lock: [ 307.111974][ T1787] ffffffff8a7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 307.112293][ T1787] [ 307.112293][ T1787] but task is already holding lock: [ 307.112535][ T1787] ffffffff8a7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 307.112866][ T1787] [ 307.112866][ T1787] other info that might help us debug this: [ 307.113112][ T1787] Possible unsafe locking scenario: [ 307.113112][ T1787] [ 307.113357][ T1787] CPU0 [ 307.113469][ T1787] ---- [ 307.113591][ T1787] lock((netdev_chain).rwsem); [ 307.113745][ T1787] lock((netdev_chain).rwsem); [ 307.113895][ T1787] [ 307.113895][ T1787] *** DEADLOCK *** [ 307.113895][ T1787] [ 307.114112][ T1787] May be due to missing lock nesting notation [ 307.114112][ T1787] [ 307.114338][ T1787] 2 locks held by ip/1787: [ 307.114494][ T1787] #0: ffffffff8a7e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 307.114775][ T1787] #1: ffffffff8a7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 307.115105][ T1787] [ 307.115105][ T1787] stack backtrace: [ 307.115300][ T1787] CPU: 3 UID: 0 PID: 1787 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 307.115548][ T1787] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 307.115756][ T1787] Call Trace: [ 307.115882][ T1787] [ 307.115969][ T1787] dump_stack_lvl+0x82/0xd0 [ 307.116141][ T1787] print_deadlock_bug+0x40a/0x650 [ 307.116309][ T1787] validate_chain+0x5bf/0xae0 [ 307.116476][ T1787] ? __pfx_validate_chain+0x10/0x10 [ 307.116635][ T1787] ? hlock_class+0x4e/0x130 [ 307.116788][ T1787] ? mark_lock+0x38/0x3e0 [ 307.116915][ T1787] __lock_acquire+0xb9a/0x1680 [ 307.117070][ T1787] lock_acquire.part.0+0xeb/0x330 [ 307.117223][ T1787] ? blocking_notifier_call_chain+0x50/0x90 [ 307.117408][ T1787] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 307.117598][ T1787] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 307.117750][ T1787] ? trace_lock_acquire+0x14c/0x1f0 [ 307.117917][ T1787] ? lock_acquire+0x32/0xc0 [ 307.118075][ T1787] ? blocking_notifier_call_chain+0x50/0x90 [ 307.118272][ T1787] down_read+0x9f/0x340 [ 307.118395][ T1787] ? blocking_notifier_call_chain+0x50/0x90 [ 307.118595][ T1787] ? __pfx_down_read+0x10/0x10 [ 307.118760][ T1787] ? __lock_release+0x103/0x460 [ 307.118925][ T1787] ? netconsole_netdev_event+0x2c1/0x620 [ 307.119096][ T1787] ? __pfx___lock_release+0x10/0x10 [ 307.119262][ T1787] blocking_notifier_call_chain+0x50/0x90 [ 307.119417][ T1787] __netdev_upper_dev_unlink+0xd9/0x220 [ 307.119578][ T1787] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 307.119769][ T1787] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 307.119920][ T1787] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 307.120115][ T1787] ? rtnl_is_locked+0x15/0x20 [ 307.120268][ T1787] netdev_upper_dev_unlink+0x71/0xa0 [ 307.120431][ T1787] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 307.120631][ T1787] ? netconsole_netdev_event+0x2c1/0x620 [ 307.120788][ T1787] ? mutex_is_locked+0x1c/0x60 [ 307.120952][ T1787] ? rtnl_is_locked+0x15/0x20 [ 307.121109][ T1787] ? netdev_master_upper_dev_get+0x13/0x120 [ 307.121320][ T1787] vrf_device_event+0x78/0xe0 [vrf] [ 307.121490][ T1787] notifier_call_chain+0xcd/0x150 [ 307.121659][ T1787] blocking_notifier_call_chain+0x66/0x90 [ 307.121825][ T1787] unregister_netdevice_many_notify+0xa7b/0x1580 [ 307.122016][ T1787] ? __lock_release+0x103/0x460 [ 307.122175][ T1787] ? __pfx___lock_release+0x10/0x10 [ 307.122330][ T1787] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 307.122536][ T1787] ? hlock_class+0x4e/0x130 [ 307.122689][ T1787] ? mark_held_locks+0x9e/0xe0 [ 307.122841][ T1787] ? __pfx_vlan_info_rcu_free+0x10/0x10 [ 307.122993][ T1787] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 307.123186][ T1787] rtnl_dellink+0x348/0xa40 [ 307.123348][ T1787] ? __pfx_rtnl_dellink+0x10/0x10 [ 307.123513][ T1787] ? find_held_lock+0x2c/0x110 [ 307.123680][ T1787] ? __lock_release+0x103/0x460 [ 307.123832][ T1787] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 307.123986][ T1787] ? __pfx___lock_release+0x10/0x10 [ 307.124151][ T1787] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 307.124318][ T1787] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 307.124484][ T1787] ? __pfx_rtnl_dellink+0x10/0x10 [ 307.124652][ T1787] rtnetlink_rcv_msg+0x712/0xc10 [ 307.124820][ T1787] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 307.124981][ T1787] ? hlock_class+0x4e/0x130 [ 307.125136][ T1787] ? mark_lock+0x38/0x3e0 [ 307.125264][ T1787] ? __lock_acquire+0xb9a/0x1680 [ 307.125416][ T1787] netlink_rcv_skb+0x130/0x360 [ 307.125568][ T1787] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 307.125731][ T1787] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 307.125892][ T1787] ? netlink_deliver_tap+0x13e/0x340 [ 307.126043][ T1787] ? netlink_deliver_tap+0xc3/0x340 [ 307.126199][ T1787] netlink_unicast+0x44b/0x710 [ 307.126351][ T1787] ? __pfx_netlink_unicast+0x10/0x10 [ 307.126511][ T1787] ? find_held_lock+0x2c/0x110 [ 307.126670][ T1787] netlink_sendmsg+0x723/0xbe0 [ 307.126828][ T1787] ? __pfx_netlink_sendmsg+0x10/0x10 [ 307.126986][ T1787] ____sys_sendmsg+0x7ac/0xa10 [ 307.127154][ T1787] ? __pfx_____sys_sendmsg+0x10/0x10 [ 307.127305][ T1787] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 307.127494][ T1787] ___sys_sendmsg+0xee/0x170 [ 307.127657][ T1787] ? __pfx____sys_sendmsg+0x10/0x10 [ 307.127809][ T1787] ? kasan_save_stack+0x34/0x50 [ 307.127960][ T1787] ? kasan_save_stack+0x24/0x50 [ 307.128116][ T1787] ? __kasan_record_aux_stack+0x8e/0xa0 [ 307.128287][ T1787] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 307.128481][ T1787] ? __x64_sys_close+0x7c/0xd0 [ 307.128642][ T1787] ? do_syscall_64+0xc1/0x1d0 [ 307.128793][ T1787] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 307.128986][ T1787] ? __lock_acquire+0xb9a/0x1680 [ 307.129148][ T1787] ? find_held_lock+0x2c/0x110 [ 307.129311][ T1787] ? __lock_release+0x103/0x460 [ 307.129466][ T1787] ? __virt_addr_valid+0x22b/0x430 [ 307.129620][ T1787] ? __pfx___lock_release+0x10/0x10 [ 307.129772][ T1787] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 307.129925][ T1787] __sys_sendmsg+0x109/0x1a0 [ 307.130077][ T1787] ? __pfx___sys_sendmsg+0x10/0x10 [ 307.130231][ T1787] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 307.130443][ T1787] do_syscall_64+0xc1/0x1d0 [ 307.130597][ T1787] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 307.130798][ T1787] RIP: 0033:0x7f81696839a7 [ 307.130957][ T1787] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 307.131485][ T1787] RSP: 002b:00007fff64bfdcd8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 307.131718][ T1787] RAX: ffffffffffffffda RBX: 00007fff64bfe400 RCX: 00007f81696839a7 [ 307.131947][ T1787] RDX: 0000000000000000 RSI: 00007fff64bfdd40 RDI: 0000000000000005 [ 307.132189][ T1787] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 307.132436][ T1787] R10: 00007f8169541ef8 R11: 0000000000000246 R12: 0000000000000002 [ 307.132667][ T1787] R13: 000000006779028d R14: 0000000000498600 R15: 0000000000000000 [ 307.132896][ T1787] [ 307.553130][ T1794] br1: port 1(veth1) entered disabled state [ 307.694227][ T1796] veth1: left allmulticast mode [ 307.694554][ T1796] veth1: left promiscuous mode [ 307.694951][ T1796] br1: port 1(veth1) entered disabled state