[ 340.960488][ T2093] gre: GRE over IPv4 demultiplexor driver [ 340.976646][ T2093] ip_gre: GRE over IPv4 tunneling driver [ 341.727734][ T2106] ip6_gre: GRE over IPv6 tunneling driver [ 341.902239][ T50] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 342.028799][ T274] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 342.205789][ T11] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 342.524744][ T274] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 342.773871][ T2119] br1: port 1(veth1) entered blocking state [ 342.774206][ T2119] br1: port 1(veth1) entered disabled state [ 342.774508][ T2119] veth1: entered allmulticast mode [ 342.776463][ T2119] veth1: entered promiscuous mode [ 342.856482][ T687] br1: port 1(veth1) entered blocking state [ 342.856803][ T687] br1: port 1(veth1) entered forwarding state [ 342.944948][ T2121] br1: port 2(veth2) entered blocking state [ 342.945336][ T2121] br1: port 2(veth2) entered disabled state [ 342.945784][ T2121] veth2: entered allmulticast mode [ 342.947776][ T2121] veth2: entered promiscuous mode [ 343.031575][ T249] br1: port 2(veth2) entered blocking state [ 343.032016][ T249] br1: port 2(veth2) entered forwarding state [ 343.240004][ T11] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 343.241199][ T11] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 343.316696][ T274] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 343.552869][ T274] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 343.662559][ T2130] br1: port 2(veth2) entered disabled state [ 343.663757][ T2130] br1: port 1(veth1) entered disabled state [ 343.762213][ T2131] br1: port 3(veth4) entered blocking state [ 343.762587][ T2131] br1: port 3(veth4) entered disabled state [ 343.762907][ T2131] veth4: entered allmulticast mode [ 343.765326][ T2131] veth4: entered promiscuous mode [ 343.868825][ T274] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 343.927016][ T2133] br1: port 3(veth4) entered blocking state [ 343.927778][ T2133] br1: port 3(veth4) entered forwarding state [ 343.928302][ T2133] br1: port 2(veth2) entered blocking state [ 343.928589][ T2133] br1: port 2(veth2) entered forwarding state [ 343.929012][ T2133] br1: port 1(veth1) entered blocking state [ 343.929271][ T2133] br1: port 1(veth1) entered forwarding state [ 343.956767][ T11] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 344.449003][ T2139] 8021q: 802.1Q VLAN Support v1.8 [ 347.204859][ C1] ip6_tnl_xmit_ctl: 3 callbacks suppressed [ 347.205485][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 354.756867][ C0] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 370.116733][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 388.334323][ T2361] veth4: left allmulticast mode [ 388.334668][ T2361] veth4: left promiscuous mode [ 388.335024][ T2361] br1: port 3(veth4) entered disabled state [ 388.445406][ T2362] [ 388.445587][ T2362] ============================================ [ 388.445802][ T2362] WARNING: possible recursive locking detected [ 388.446012][ T2362] 6.13.0-rc5-virtme #1 Not tainted [ 388.446182][ T2362] -------------------------------------------- [ 388.446386][ T2362] ip/2362 is trying to acquire lock: [ 388.446549][ T2362] ffffffffa35d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 388.446909][ T2362] [ 388.446909][ T2362] but task is already holding lock: [ 388.447153][ T2362] ffffffffa35d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 388.447497][ T2362] [ 388.447497][ T2362] other info that might help us debug this: [ 388.447745][ T2362] Possible unsafe locking scenario: [ 388.447745][ T2362] [ 388.448001][ T2362] CPU0 [ 388.448127][ T2362] ---- [ 388.448262][ T2362] lock((netdev_chain).rwsem); [ 388.448432][ T2362] lock((netdev_chain).rwsem); [ 388.448603][ T2362] [ 388.448603][ T2362] *** DEADLOCK *** [ 388.448603][ T2362] [ 388.448849][ T2362] May be due to missing lock nesting notation [ 388.448849][ T2362] [ 388.449088][ T2362] 2 locks held by ip/2362: [ 388.449242][ T2362] #0: ffffffffa35e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 388.449519][ T2362] #1: ffffffffa35d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 388.449827][ T2362] [ 388.449827][ T2362] stack backtrace: [ 388.450015][ T2362] CPU: 0 UID: 0 PID: 2362 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 388.450238][ T2362] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 388.450422][ T2362] Call Trace: [ 388.450539][ T2362] [ 388.450627][ T2362] dump_stack_lvl+0x82/0xd0 [ 388.450783][ T2362] print_deadlock_bug+0x40a/0x650 [ 388.450932][ T2362] validate_chain+0x5bf/0xae0 [ 388.451083][ T2362] ? __pfx_validate_chain+0x10/0x10 [ 388.451234][ T2362] ? hlock_class+0x4e/0x130 [ 388.451399][ T2362] ? mark_lock+0x38/0x3e0 [ 388.451525][ T2362] __lock_acquire+0xb9a/0x1680 [ 388.451694][ T2362] lock_acquire.part.0+0xeb/0x330 [ 388.451866][ T2362] ? blocking_notifier_call_chain+0x50/0x90 [ 388.452081][ T2362] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 388.452288][ T2362] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 388.452455][ T2362] ? trace_lock_acquire+0x14c/0x1f0 [ 388.452622][ T2362] ? lock_acquire+0x32/0xc0 [ 388.452784][ T2362] ? blocking_notifier_call_chain+0x50/0x90 [ 388.452992][ T2362] down_read+0x9f/0x340 [ 388.453123][ T2362] ? blocking_notifier_call_chain+0x50/0x90 [ 388.453332][ T2362] ? __pfx_down_read+0x10/0x10 [ 388.453498][ T2362] ? __lock_release+0x103/0x460 [ 388.453668][ T2362] ? netconsole_netdev_event+0x2c1/0x620 [ 388.453835][ T2362] ? __pfx___lock_release+0x10/0x10 [ 388.454003][ T2362] blocking_notifier_call_chain+0x50/0x90 [ 388.454171][ T2362] __netdev_upper_dev_unlink+0xd9/0x220 [ 388.454341][ T2362] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 388.454547][ T2362] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 388.454714][ T2362] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 388.454923][ T2362] ? rtnl_is_locked+0x15/0x20 [ 388.455089][ T2362] netdev_upper_dev_unlink+0x71/0xa0 [ 388.455253][ T2362] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 388.455467][ T2362] ? netconsole_netdev_event+0x2c1/0x620 [ 388.455633][ T2362] ? mutex_is_locked+0x1c/0x60 [ 388.455798][ T2362] ? rtnl_is_locked+0x15/0x20 [ 388.455965][ T2362] ? netdev_master_upper_dev_get+0x13/0x120 [ 388.456170][ T2362] vrf_device_event+0x78/0xe0 [vrf] [ 388.456338][ T2362] notifier_call_chain+0xcd/0x150 [ 388.456506][ T2362] blocking_notifier_call_chain+0x66/0x90 [ 388.456678][ T2362] unregister_netdevice_many_notify+0xa7b/0x1580 [ 388.456882][ T2362] ? __lock_release+0x103/0x460 [ 388.457050][ T2362] ? __pfx___lock_release+0x10/0x10 [ 388.457217][ T2362] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 388.457426][ T2362] ? hlock_class+0x4e/0x130 [ 388.457590][ T2362] ? mark_held_locks+0x9e/0xe0 [ 388.457768][ T2362] ? __pfx_vlan_info_rcu_free+0x10/0x10 [ 388.457944][ T2362] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 388.458151][ T2362] rtnl_dellink+0x348/0xa40 [ 388.458316][ T2362] ? __pfx_rtnl_dellink+0x10/0x10 [ 388.458495][ T2362] ? find_held_lock+0x2c/0x110 [ 388.458666][ T2362] ? __lock_release+0x103/0x460 [ 388.458833][ T2362] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 388.459015][ T2362] ? __pfx___lock_release+0x10/0x10 [ 388.459189][ T2362] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 388.459359][ T2362] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 388.459523][ T2362] ? __pfx_rtnl_dellink+0x10/0x10 [ 388.459698][ T2362] rtnetlink_rcv_msg+0x712/0xc10 [ 388.459863][ T2362] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 388.460033][ T2362] ? hlock_class+0x4e/0x130 [ 388.460198][ T2362] ? mark_lock+0x38/0x3e0 [ 388.460326][ T2362] ? __lock_acquire+0xb9a/0x1680 [ 388.460496][ T2362] netlink_rcv_skb+0x130/0x360 [ 388.460667][ T2362] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 388.460834][ T2362] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 388.461004][ T2362] ? netlink_deliver_tap+0x13e/0x340 [ 388.461172][ T2362] ? netlink_deliver_tap+0xc3/0x340 [ 388.461341][ T2362] netlink_unicast+0x44b/0x710 [ 388.461508][ T2362] ? __pfx_netlink_unicast+0x10/0x10 [ 388.461678][ T2362] ? find_held_lock+0x2c/0x110 [ 388.461846][ T2362] netlink_sendmsg+0x723/0xbe0 [ 388.462017][ T2362] ? __pfx_netlink_sendmsg+0x10/0x10 [ 388.462185][ T2362] ____sys_sendmsg+0x7ac/0xa10 [ 388.462350][ T2362] ? __pfx_____sys_sendmsg+0x10/0x10 [ 388.462517][ T2362] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 388.462726][ T2362] ___sys_sendmsg+0xee/0x170 [ 388.462898][ T2362] ? __pfx____sys_sendmsg+0x10/0x10 [ 388.463064][ T2362] ? kasan_save_stack+0x34/0x50 [ 388.463233][ T2362] ? kasan_save_stack+0x24/0x50 [ 388.463402][ T2362] ? __kasan_record_aux_stack+0x8e/0xa0 [ 388.463571][ T2362] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 388.463782][ T2362] ? __x64_sys_close+0x7c/0xd0 [ 388.463949][ T2362] ? do_syscall_64+0xc1/0x1d0 [ 388.464119][ T2362] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 388.464324][ T2362] ? __lock_acquire+0xb9a/0x1680 [ 388.464493][ T2362] ? find_held_lock+0x2c/0x110 [ 388.464663][ T2362] ? __lock_release+0x103/0x460 [ 388.464833][ T2362] ? __virt_addr_valid+0x22b/0x430 [ 388.465000][ T2362] ? __pfx___lock_release+0x10/0x10 [ 388.465167][ T2362] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 388.465340][ T2362] __sys_sendmsg+0x109/0x1a0 [ 388.465505][ T2362] ? __pfx___sys_sendmsg+0x10/0x10 [ 388.465669][ T2362] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 388.465881][ T2362] do_syscall_64+0xc1/0x1d0 [ 388.466037][ T2362] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 388.466218][ T2362] RIP: 0033:0x7f99727c29a7 [ 388.466377][ T2362] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 388.466895][ T2362] RSP: 002b:00007ffc59084138 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 388.467123][ T2362] RAX: ffffffffffffffda RBX: 00007ffc59084860 RCX: 00007f99727c29a7 [ 388.467347][ T2362] RDX: 0000000000000000 RSI: 00007ffc590841a0 RDI: 0000000000000005 [ 388.467571][ T2362] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 388.467807][ T2362] R10: 00007f9972680ef8 R11: 0000000000000246 R12: 0000000000000002 [ 388.468026][ T2362] R13: 0000000067792ae1 R14: 0000000000498600 R15: 0000000000000000 [ 388.468253][ T2362] [ 388.494422][ T2362] ip (2362) used greatest stack depth: 23424 bytes left [ 388.810161][ T2368] br1: port 1(veth1) entered disabled state [ 388.872858][ T2369] br1: port 2(veth2) entered disabled state [ 388.933927][ T2370] veth2: left allmulticast mode [ 388.934137][ T2370] veth2: left promiscuous mode [ 388.934414][ T2370] br1: port 2(veth2) entered disabled state [ 388.935450][ T2370] veth1: left allmulticast mode [ 388.935642][ T2370] veth1: left promiscuous mode [ 388.935911][ T2370] br1: port 1(veth1) entered disabled state