[ 10.703168][ T249] ip (249) used greatest stack depth: 24008 bytes left [ 14.623283][ T313] gre: GRE over IPv4 demultiplexor driver [ 14.635144][ T313] ip_gre: GRE over IPv4 tunneling driver [ 14.955745][ T319] ip (319) used greatest stack depth: 23648 bytes left [ 15.347421][ T324] GACT probability NOT on [ 15.574943][ T326] ip6_gre: GRE over IPv6 tunneling driver [ 15.716849][ T9] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 15.843799][ T9] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 16.464595][ T66] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 16.697645][ T341] br1: port 1(veth1) entered blocking state [ 16.698155][ T341] br1: port 1(veth1) entered disabled state [ 16.698531][ T341] veth1: entered allmulticast mode [ 16.700949][ T341] veth1: entered promiscuous mode [ 16.779758][ T284] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 16.780289][ T40] br1: port 1(veth1) entered blocking state [ 16.780711][ T40] br1: port 1(veth1) entered forwarding state [ 16.850339][ T343] br1: port 2(veth2) entered blocking state [ 16.850675][ T343] br1: port 2(veth2) entered disabled state [ 16.850955][ T343] veth2: entered allmulticast mode [ 16.852844][ T343] veth2: entered promiscuous mode [ 16.940556][ T40] br1: port 2(veth2) entered blocking state [ 16.940893][ T40] br1: port 2(veth2) entered forwarding state [ 17.426813][ T284] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 17.485284][ T66] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 17.486344][ T66] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 17.529766][ T284] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 17.869203][ T66] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 17.912715][ T359] 8021q: 802.1Q VLAN Support v1.8 [ 18.059739][ T70] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 18.068833][ T362] br2: port 1(veth4.555) entered blocking state [ 18.069145][ T362] br2: port 1(veth4.555) entered disabled state [ 18.069430][ T362] veth4.555: entered allmulticast mode [ 18.069803][ T362] veth4: entered allmulticast mode [ 18.071782][ T362] veth4.555: entered promiscuous mode [ 18.072009][ T362] veth4: entered promiscuous mode [ 18.073039][ T362] br2: port 1(veth4.555) entered blocking state [ 18.073414][ T362] br2: port 1(veth4.555) entered forwarding state [ 21.387791][ C2] ip6_tnl_xmit_ctl: 3 callbacks suppressed [ 21.388353][ C2] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 24.838242][ T395] Mirror/redirect action on [ 29.132700][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 44.491711][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 73.792997][ T654] br2: port 1(veth4.555) entered disabled state [ 76.747789][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 79.243694][ T676] br2: port 1(veth4.555) entered forwarding state [ 89.763397][ T736] br2: port 1(veth4.555) entered disabled state [ 95.247222][ T758] br2: port 1(veth4.555) entered forwarding state [ 101.104061][ T788] [ 101.104249][ T788] ============================================ [ 101.104435][ T788] WARNING: possible recursive locking detected [ 101.104626][ T788] 6.13.0-rc5-virtme #1 Not tainted [ 101.104774][ T788] -------------------------------------------- [ 101.104985][ T788] ip/788 is trying to acquire lock: [ 101.105132][ T788] ffffffff897d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 101.105428][ T788] [ 101.105428][ T788] but task is already holding lock: [ 101.105639][ T788] ffffffff897d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 101.105938][ T788] [ 101.105938][ T788] other info that might help us debug this: [ 101.106152][ T788] Possible unsafe locking scenario: [ 101.106152][ T788] [ 101.106366][ T788] CPU0 [ 101.106472][ T788] ---- [ 101.106581][ T788] lock((netdev_chain).rwsem); [ 101.106732][ T788] lock((netdev_chain).rwsem); [ 101.106881][ T788] [ 101.106881][ T788] *** DEADLOCK *** [ 101.106881][ T788] [ 101.107097][ T788] May be due to missing lock nesting notation [ 101.107097][ T788] [ 101.107311][ T788] 2 locks held by ip/788: [ 101.107428][ T788] #0: ffffffff897e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 101.107690][ T788] #1: ffffffff897d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 101.107982][ T788] [ 101.107982][ T788] stack backtrace: [ 101.108159][ T788] CPU: 3 UID: 0 PID: 788 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 101.108378][ T788] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 101.108556][ T788] Call Trace: [ 101.108666][ T788] [ 101.108743][ T788] dump_stack_lvl+0x82/0xd0 [ 101.108922][ T788] print_deadlock_bug+0x40a/0x650 [ 101.109072][ T788] validate_chain+0x5bf/0xae0 [ 101.109219][ T788] ? __pfx_validate_chain+0x10/0x10 [ 101.109367][ T788] ? hlock_class+0x4e/0x130 [ 101.109532][ T788] ? mark_lock+0x38/0x3e0 [ 101.109643][ T788] __lock_acquire+0xb9a/0x1680 [ 101.109791][ T788] lock_acquire.part.0+0xeb/0x330 [ 101.109934][ T788] ? blocking_notifier_call_chain+0x50/0x90 [ 101.110113][ T788] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 101.110299][ T788] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 101.110444][ T788] ? trace_lock_acquire+0x14c/0x1f0 [ 101.110594][ T788] ? lock_acquire+0x32/0xc0 [ 101.110740][ T788] ? blocking_notifier_call_chain+0x50/0x90 [ 101.110922][ T788] down_read+0x9f/0x340 [ 101.111034][ T788] ? blocking_notifier_call_chain+0x50/0x90 [ 101.111214][ T788] ? __pfx_down_read+0x10/0x10 [ 101.111360][ T788] ? __lock_release+0x103/0x460 [ 101.111505][ T788] ? netconsole_netdev_event+0x2c1/0x620 [ 101.111655][ T788] ? __pfx___lock_release+0x10/0x10 [ 101.111802][ T788] blocking_notifier_call_chain+0x50/0x90 [ 101.111947][ T788] __netdev_upper_dev_unlink+0xd9/0x220 [ 101.112092][ T788] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 101.112272][ T788] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 101.112416][ T788] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 101.112594][ T788] ? rtnl_is_locked+0x15/0x20 [ 101.112747][ T788] netdev_upper_dev_unlink+0x71/0xa0 [ 101.112922][ T788] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 101.113104][ T788] ? netconsole_netdev_event+0x2c1/0x620 [ 101.113249][ T788] ? mutex_is_locked+0x1c/0x60 [ 101.113396][ T788] ? rtnl_is_locked+0x15/0x20 [ 101.113540][ T788] ? netdev_master_upper_dev_get+0x13/0x120 [ 101.113720][ T788] vrf_device_event+0x78/0xe0 [vrf] [ 101.113873][ T788] notifier_call_chain+0xcd/0x150 [ 101.114020][ T788] blocking_notifier_call_chain+0x66/0x90 [ 101.114163][ T788] unregister_netdevice_many_notify+0xa7b/0x1580 [ 101.114341][ T788] ? __lock_release+0x103/0x460 [ 101.114485][ T788] ? __pfx___lock_release+0x10/0x10 [ 101.114630][ T788] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 101.114822][ T788] ? hlock_class+0x4e/0x130 [ 101.114967][ T788] ? mark_held_locks+0x9e/0xe0 [ 101.115113][ T788] ? __pfx_vlan_info_rcu_free+0x10/0x10 [ 101.115257][ T788] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 101.115438][ T788] rtnl_dellink+0x348/0xa40 [ 101.115585][ T788] ? __pfx_rtnl_dellink+0x10/0x10 [ 101.115745][ T788] ? find_held_lock+0x2c/0x110 [ 101.115892][ T788] ? __lock_release+0x103/0x460 [ 101.116040][ T788] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 101.116185][ T788] ? __pfx___lock_release+0x10/0x10 [ 101.116331][ T788] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 101.116477][ T788] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 101.116621][ T788] ? __pfx_rtnl_dellink+0x10/0x10 [ 101.116765][ T788] rtnetlink_rcv_msg+0x712/0xc10 [ 101.116935][ T788] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 101.117088][ T788] ? hlock_class+0x4e/0x130 [ 101.117233][ T788] ? mark_lock+0x38/0x3e0 [ 101.117346][ T788] ? __lock_acquire+0xb9a/0x1680 [ 101.117492][ T788] netlink_rcv_skb+0x130/0x360 [ 101.117638][ T788] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 101.117784][ T788] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 101.117931][ T788] ? netlink_deliver_tap+0x13e/0x340 [ 101.118084][ T788] ? netlink_deliver_tap+0xc3/0x340 [ 101.118228][ T788] netlink_unicast+0x44b/0x710 [ 101.118373][ T788] ? __pfx_netlink_unicast+0x10/0x10 [ 101.118519][ T788] ? find_held_lock+0x2c/0x110 [ 101.118675][ T788] netlink_sendmsg+0x723/0xbe0 [ 101.118823][ T788] ? __pfx_netlink_sendmsg+0x10/0x10 [ 101.118971][ T788] ____sys_sendmsg+0x7ac/0xa10 [ 101.119121][ T788] ? __pfx_____sys_sendmsg+0x10/0x10 [ 101.119265][ T788] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 101.119460][ T788] ___sys_sendmsg+0xee/0x170 [ 101.119608][ T788] ? __pfx____sys_sendmsg+0x10/0x10 [ 101.119754][ T788] ? kasan_save_stack+0x34/0x50 [ 101.119901][ T788] ? kasan_save_stack+0x24/0x50 [ 101.120045][ T788] ? __kasan_record_aux_stack+0x8e/0xa0 [ 101.120196][ T788] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 101.120380][ T788] ? __x64_sys_close+0x7c/0xd0 [ 101.120526][ T788] ? do_syscall_64+0xc1/0x1d0 [ 101.120674][ T788] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 101.120878][ T788] ? __lock_acquire+0xb9a/0x1680 [ 101.121036][ T788] ? find_held_lock+0x2c/0x110 [ 101.121183][ T788] ? __lock_release+0x103/0x460 [ 101.121328][ T788] ? __virt_addr_valid+0x22b/0x430 [ 101.121479][ T788] ? __pfx___lock_release+0x10/0x10 [ 101.121625][ T788] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 101.121773][ T788] __sys_sendmsg+0x109/0x1a0 [ 101.121918][ T788] ? __pfx___sys_sendmsg+0x10/0x10 [ 101.122065][ T788] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 101.122257][ T788] do_syscall_64+0xc1/0x1d0 [ 101.122407][ T788] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 101.122587][ T788] RIP: 0033:0x7fc1e86489a7 [ 101.122739][ T788] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 101.123247][ T788] RSP: 002b:00007ffe770ef9a8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 101.123474][ T788] RAX: ffffffffffffffda RBX: 00007ffe770f00d0 RCX: 00007fc1e86489a7 [ 101.123691][ T788] RDX: 0000000000000000 RSI: 00007ffe770efa10 RDI: 0000000000000005 [ 101.123911][ T788] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 101.124131][ T788] R10: 00007fc1e8506ef8 R11: 0000000000000246 R12: 0000000000000002 [ 101.124352][ T788] R13: 000000006779560f R14: 0000000000498600 R15: 0000000000000000 [ 101.124576][ T788] [ 101.218009][ T790] veth4.555: left allmulticast mode [ 101.218278][ T790] veth4: left allmulticast mode [ 101.218528][ T790] veth4.555: left promiscuous mode [ 101.218896][ T790] veth4: left promiscuous mode [ 101.219530][ T790] br2: port 1(veth4.555) entered disabled state [ 101.736273][ T796] br1: port 1(veth1) entered disabled state [ 101.791366][ T797] br1: port 2(veth2) entered disabled state [ 101.837958][ T798] veth2: left allmulticast mode [ 101.838170][ T798] veth2: left promiscuous mode [ 101.838437][ T798] br1: port 2(veth2) entered disabled state [ 101.845176][ T798] veth1: left allmulticast mode [ 101.845354][ T798] veth1: left promiscuous mode [ 101.845838][ T798] br1: port 1(veth1) entered disabled state