[ 86.978172][ T1459] gre: GRE over IPv4 demultiplexor driver [ 86.995697][ T1459] ip_gre: GRE over IPv4 tunneling driver [ 87.759800][ T1473] GACT probability NOT on [ 87.780727][ T1471] tc (1471) used greatest stack depth: 23272 bytes left [ 88.013807][ T1475] ip6_gre: GRE over IPv6 tunneling driver [ 88.170949][ T62] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 88.300635][ T62] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 88.836500][ T67] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 89.089696][ T1488] br1: port 1(veth1) entered blocking state [ 89.090128][ T1488] br1: port 1(veth1) entered disabled state [ 89.090521][ T1488] veth1: entered allmulticast mode [ 89.093692][ T1488] veth1: entered promiscuous mode [ 89.196834][ T39] br1: port 1(veth1) entered blocking state [ 89.197349][ T39] br1: port 1(veth1) entered forwarding state [ 89.276883][ T1491] br1: port 2(veth2) entered blocking state [ 89.277197][ T1491] br1: port 2(veth2) entered disabled state [ 89.277497][ T1491] veth2: entered allmulticast mode [ 89.279471][ T1491] veth2: entered promiscuous mode [ 89.348496][ T54] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 89.357786][ T39] br1: port 2(veth2) entered blocking state [ 89.358429][ T39] br1: port 2(veth2) entered forwarding state [ 89.860654][ T67] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 89.861457][ T67] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 89.901753][ T54] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 89.997680][ T1500] br1: port 2(veth2) entered disabled state [ 89.999244][ T1500] br1: port 1(veth1) entered disabled state [ 90.036467][ T54] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 90.088596][ T1501] br1: port 3(veth4) entered blocking state [ 90.088881][ T1501] br1: port 3(veth4) entered disabled state [ 90.089177][ T1501] veth4: entered allmulticast mode [ 90.091040][ T1501] veth4: entered promiscuous mode [ 90.247499][ T1503] br1: port 3(veth4) entered blocking state [ 90.247885][ T1503] br1: port 3(veth4) entered forwarding state [ 90.248625][ T1503] br1: port 2(veth2) entered blocking state [ 90.249010][ T1503] br1: port 2(veth2) entered forwarding state [ 90.249606][ T1503] br1: port 1(veth1) entered blocking state [ 90.249985][ T1503] br1: port 1(veth1) entered forwarding state [ 90.500509][ T67] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 90.824741][ T1509] 8021q: 802.1Q VLAN Support v1.8 [ 90.884705][ T54] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 93.764515][ C1] ip6_tnl_xmit_ctl: 3 callbacks suppressed [ 93.765028][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 97.582846][ T1542] Mirror/redirect action on [ 101.828793][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 117.188622][ C0] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 134.208189][ T1734] veth4: left allmulticast mode [ 134.208887][ T1734] veth4: left promiscuous mode [ 134.209225][ T1734] br1: port 3(veth4) entered disabled state [ 134.338092][ T1735] [ 134.338278][ T1735] ============================================ [ 134.338580][ T1735] WARNING: possible recursive locking detected [ 134.338866][ T1735] 6.13.0-rc5-virtme #1 Not tainted [ 134.339097][ T1735] -------------------------------------------- [ 134.339379][ T1735] ip/1735 is trying to acquire lock: [ 134.339612][ T1735] ffffffffb8dd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 134.340101][ T1735] [ 134.340101][ T1735] but task is already holding lock: [ 134.340454][ T1735] ffffffffb8dd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 134.340926][ T1735] [ 134.340926][ T1735] other info that might help us debug this: [ 134.341275][ T1735] Possible unsafe locking scenario: [ 134.341275][ T1735] [ 134.341529][ T1735] CPU0 [ 134.341645][ T1735] ---- [ 134.341763][ T1735] lock((netdev_chain).rwsem); [ 134.341913][ T1735] lock((netdev_chain).rwsem); [ 134.342066][ T1735] [ 134.342066][ T1735] *** DEADLOCK *** [ 134.342066][ T1735] [ 134.342285][ T1735] May be due to missing lock nesting notation [ 134.342285][ T1735] [ 134.342537][ T1735] 2 locks held by ip/1735: [ 134.342684][ T1735] #0: ffffffffb8de7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 134.342994][ T1735] #1: ffffffffb8dd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 134.343350][ T1735] [ 134.343350][ T1735] stack backtrace: [ 134.343573][ T1735] CPU: 0 UID: 0 PID: 1735 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 134.343944][ T1735] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 134.344207][ T1735] Call Trace: [ 134.344386][ T1735] [ 134.344512][ T1735] dump_stack_lvl+0x82/0xd0 [ 134.344767][ T1735] print_deadlock_bug+0x40a/0x650 [ 134.345000][ T1735] validate_chain+0x5bf/0xae0 [ 134.345196][ T1735] ? __pfx_validate_chain+0x10/0x10 [ 134.345346][ T1735] ? hlock_class+0x4e/0x130 [ 134.345554][ T1735] ? mark_lock+0x38/0x3e0 [ 134.345720][ T1735] __lock_acquire+0xb9a/0x1680 [ 134.345910][ T1735] lock_acquire.part.0+0xeb/0x330 [ 134.346100][ T1735] ? blocking_notifier_call_chain+0x50/0x90 [ 134.346315][ T1735] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 134.346522][ T1735] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 134.346682][ T1735] ? trace_lock_acquire+0x14c/0x1f0 [ 134.346842][ T1735] ? lock_acquire+0x32/0xc0 [ 134.347003][ T1735] ? blocking_notifier_call_chain+0x50/0x90 [ 134.347214][ T1735] down_read+0x9f/0x340 [ 134.347339][ T1735] ? blocking_notifier_call_chain+0x50/0x90 [ 134.347543][ T1735] ? __pfx_down_read+0x10/0x10 [ 134.347702][ T1735] ? __lock_release+0x103/0x460 [ 134.347863][ T1735] ? netconsole_netdev_event+0x2c1/0x620 [ 134.348023][ T1735] ? __pfx___lock_release+0x10/0x10 [ 134.348203][ T1735] blocking_notifier_call_chain+0x50/0x90 [ 134.348365][ T1735] __netdev_upper_dev_unlink+0xd9/0x220 [ 134.348536][ T1735] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 134.348790][ T1735] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 134.348974][ T1735] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 134.349224][ T1735] ? rtnl_is_locked+0x15/0x20 [ 134.349415][ T1735] netdev_upper_dev_unlink+0x71/0xa0 [ 134.349562][ T1735] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 134.349773][ T1735] ? netconsole_netdev_event+0x2c1/0x620 [ 134.349952][ T1735] ? mutex_is_locked+0x1c/0x60 [ 134.350133][ T1735] ? rtnl_is_locked+0x15/0x20 [ 134.350279][ T1735] ? netdev_master_upper_dev_get+0x13/0x120 [ 134.350464][ T1735] vrf_device_event+0x78/0xe0 [vrf] [ 134.350679][ T1735] notifier_call_chain+0xcd/0x150 [ 134.350830][ T1735] blocking_notifier_call_chain+0x66/0x90 [ 134.351018][ T1735] unregister_netdevice_many_notify+0xa7b/0x1580 [ 134.351229][ T1735] ? __lock_release+0x103/0x460 [ 134.351377][ T1735] ? __pfx___lock_release+0x10/0x10 [ 134.351525][ T1735] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 134.351766][ T1735] ? hlock_class+0x4e/0x130 [ 134.351915][ T1735] ? mark_held_locks+0x9e/0xe0 [ 134.352063][ T1735] ? __pfx_vlan_info_rcu_free+0x10/0x10 [ 134.352232][ T1735] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 134.352438][ T1735] rtnl_dellink+0x348/0xa40 [ 134.352635][ T1735] ? __pfx_rtnl_dellink+0x10/0x10 [ 134.352856][ T1735] ? find_held_lock+0x2c/0x110 [ 134.353011][ T1735] ? __lock_release+0x103/0x460 [ 134.353169][ T1735] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 134.353317][ T1735] ? __pfx___lock_release+0x10/0x10 [ 134.353488][ T1735] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 134.353681][ T1735] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 134.353830][ T1735] ? __pfx_rtnl_dellink+0x10/0x10 [ 134.353980][ T1735] rtnetlink_rcv_msg+0x712/0xc10 [ 134.354181][ T1735] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 134.354340][ T1735] ? hlock_class+0x4e/0x130 [ 134.354488][ T1735] ? mark_lock+0x38/0x3e0 [ 134.354627][ T1735] ? __lock_acquire+0xb9a/0x1680 [ 134.354794][ T1735] netlink_rcv_skb+0x130/0x360 [ 134.355005][ T1735] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 134.355186][ T1735] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 134.355353][ T1735] ? netlink_deliver_tap+0x13e/0x340 [ 134.355515][ T1735] ? netlink_deliver_tap+0xc3/0x340 [ 134.355676][ T1735] netlink_unicast+0x44b/0x710 [ 134.355870][ T1735] ? __pfx_netlink_unicast+0x10/0x10 [ 134.356076][ T1735] ? find_held_lock+0x2c/0x110 [ 134.356260][ T1735] netlink_sendmsg+0x723/0xbe0 [ 134.356483][ T1735] ? __pfx_netlink_sendmsg+0x10/0x10 [ 134.356649][ T1735] ____sys_sendmsg+0x7ac/0xa10 [ 134.356819][ T1735] ? __pfx_____sys_sendmsg+0x10/0x10 [ 134.357033][ T1735] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 134.357325][ T1735] ___sys_sendmsg+0xee/0x170 [ 134.357502][ T1735] ? __pfx____sys_sendmsg+0x10/0x10 [ 134.357664][ T1735] ? kasan_save_stack+0x34/0x50 [ 134.357828][ T1735] ? kasan_save_stack+0x24/0x50 [ 134.357989][ T1735] ? __kasan_record_aux_stack+0x8e/0xa0 [ 134.358163][ T1735] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 134.358365][ T1735] ? __x64_sys_close+0x7c/0xd0 [ 134.358532][ T1735] ? do_syscall_64+0xc1/0x1d0 [ 134.358750][ T1735] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 134.358960][ T1735] ? __lock_acquire+0xb9a/0x1680 [ 134.359150][ T1735] ? find_held_lock+0x2c/0x110 [ 134.359357][ T1735] ? __lock_release+0x103/0x460 [ 134.359522][ T1735] ? __virt_addr_valid+0x22b/0x430 [ 134.359688][ T1735] ? __pfx___lock_release+0x10/0x10 [ 134.359897][ T1735] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 134.360044][ T1735] __sys_sendmsg+0x109/0x1a0 [ 134.360223][ T1735] ? __pfx___sys_sendmsg+0x10/0x10 [ 134.360432][ T1735] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 134.360622][ T1735] do_syscall_64+0xc1/0x1d0 [ 134.360774][ T1735] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 134.360957][ T1735] RIP: 0033:0x7f8f571939a7 [ 134.361137][ T1735] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 134.361693][ T1735] RSP: 002b:00007ffc52494938 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 134.361939][ T1735] RAX: ffffffffffffffda RBX: 00007ffc52495060 RCX: 00007f8f571939a7 [ 134.362185][ T1735] RDX: 0000000000000000 RSI: 00007ffc524949a0 RDI: 0000000000000005 [ 134.362411][ T1735] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 134.362630][ T1735] R10: 00007f8f57051ef8 R11: 0000000000000246 R12: 0000000000000002 [ 134.362853][ T1735] R13: 000000006779539a R14: 0000000000498600 R15: 0000000000000000 [ 134.363075][ T1735] [ 134.775551][ T1741] br1: port 1(veth1) entered disabled state [ 134.866776][ T1742] br1: port 2(veth2) entered disabled state [ 134.930027][ T1743] veth2: left allmulticast mode [ 134.930237][ T1743] veth2: left promiscuous mode [ 134.930541][ T1743] br1: port 2(veth2) entered disabled state [ 134.932008][ T1743] veth1: left allmulticast mode [ 134.932200][ T1743] veth1: left promiscuous mode [ 134.932480][ T1743] br1: port 1(veth1) entered disabled state