[ 13.224285][ T290] 8021q: 802.1Q VLAN Support v1.8 [ 14.450674][ T306] br0: port 1(veth1) entered blocking state [ 14.451594][ T306] br0: port 1(veth1) entered disabled state [ 14.452039][ T306] veth1: entered allmulticast mode [ 14.454192][ T306] veth1: entered promiscuous mode [ 14.561773][ T308] br0: port 2(veth2) entered blocking state [ 14.562076][ T308] br0: port 2(veth2) entered disabled state [ 14.562371][ T308] veth2: entered allmulticast mode [ 14.564227][ T308] veth2: entered promiscuous mode [ 14.737602][ T45] br0: port 1(veth1) entered blocking state [ 14.738029][ T45] br0: port 1(veth1) entered forwarding state [ 14.815896][ T151] br0: port 2(veth2) entered blocking state [ 14.816224][ T151] br0: port 2(veth2) entered forwarding state [ 42.946358][ T379] GACT probability NOT on [ 42.965479][ T377] tc (377) used greatest stack depth: 23440 bytes left [ 72.977042][ T595] [ 72.977191][ T595] ============================================ [ 72.977414][ T595] WARNING: possible recursive locking detected [ 72.977631][ T595] 6.13.0-rc5-virtme #1 Not tainted [ 72.977808][ T595] -------------------------------------------- [ 72.978016][ T595] ip/595 is trying to acquire lock: [ 72.978187][ T595] ffffffff909d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 72.978533][ T595] [ 72.978533][ T595] but task is already holding lock: [ 72.978787][ T595] ffffffff909d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 72.979175][ T595] [ 72.979175][ T595] other info that might help us debug this: [ 72.979440][ T595] Possible unsafe locking scenario: [ 72.979440][ T595] [ 72.979695][ T595] CPU0 [ 72.979827][ T595] ---- [ 72.979957][ T595] lock((netdev_chain).rwsem); [ 72.980129][ T595] lock((netdev_chain).rwsem); [ 72.980300][ T595] [ 72.980300][ T595] *** DEADLOCK *** [ 72.980300][ T595] [ 72.980555][ T595] May be due to missing lock nesting notation [ 72.980555][ T595] [ 72.980816][ T595] 2 locks held by ip/595: [ 72.980948][ T595] #0: ffffffff909e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 72.981265][ T595] #1: ffffffff909d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 72.981617][ T595] [ 72.981617][ T595] stack backtrace: [ 72.981841][ T595] CPU: 0 UID: 0 PID: 595 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 72.982103][ T595] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 72.982323][ T595] Call Trace: [ 72.982456][ T595] [ 72.982549][ T595] dump_stack_lvl+0x82/0xd0 [ 72.982731][ T595] print_deadlock_bug+0x40a/0x650 [ 72.982910][ T595] validate_chain+0x5bf/0xae0 [ 72.983090][ T595] ? __pfx_validate_chain+0x10/0x10 [ 72.983273][ T595] ? hlock_class+0x4e/0x130 [ 72.983447][ T595] ? mark_lock+0x38/0x3e0 [ 72.983579][ T595] __lock_acquire+0xb9a/0x1680 [ 72.983757][ T595] lock_acquire.part.0+0xeb/0x330 [ 72.983931][ T595] ? blocking_notifier_call_chain+0x50/0x90 [ 72.984153][ T595] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 72.984329][ T595] ? trace_lock_acquire+0x14c/0x1f0 [ 72.984508][ T595] ? lock_acquire+0x32/0xc0 [ 72.984683][ T595] ? blocking_notifier_call_chain+0x50/0x90 [ 72.984921][ T595] down_read+0x9f/0x340 [ 72.985058][ T595] ? blocking_notifier_call_chain+0x50/0x90 [ 72.985276][ T595] ? __pfx_down_read+0x10/0x10 [ 72.985451][ T595] blocking_notifier_call_chain+0x50/0x90 [ 72.985628][ T595] __dev_close_many+0xdf/0x2d0 [ 72.985804][ T595] ? __pfx___dev_close_many+0x10/0x10 [ 72.985981][ T595] dev_close_many+0x202/0x650 [ 72.986158][ T595] ? __pfx_dev_close_many+0x10/0x10 [ 72.986331][ T595] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 72.986549][ T595] vlan_device_event+0x143b/0x2130 [8021q] [ 72.986773][ T595] ? __pfx_vlan_device_event+0x10/0x10 [8021q] [ 72.987000][ T595] ? packet_notifier+0x3b0/0x810 [ 72.987178][ T595] notifier_call_chain+0xcd/0x150 [ 72.987353][ T595] blocking_notifier_call_chain+0x66/0x90 [ 72.987529][ T595] __dev_notify_flags+0x170/0x250 [ 72.987705][ T595] ? __pfx___dev_notify_flags+0x10/0x10 [ 72.987881][ T595] ? __dev_change_flags+0x24f/0x6c0 [ 72.988056][ T595] ? __pfx___dev_change_flags+0x10/0x10 [ 72.988238][ T595] ? rcu_read_lock_any_held+0x43/0xb0 [ 72.988415][ T595] ? validate_chain+0x1fe/0xae0 [ 72.988589][ T595] dev_change_flags+0xec/0x160 [ 72.988763][ T595] cycle_netdev+0x94/0xf0 [vrf] [ 72.988941][ T595] vrf_del_slave+0x40/0x60 [vrf] [ 72.989126][ T595] do_set_master+0xb5/0x1c0 [ 72.989301][ T595] do_setlink.constprop.0+0x80e/0x2300 [ 72.989474][ T595] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 72.989695][ T595] ? lock_acquire.part.0+0xeb/0x330 [ 72.989870][ T595] ? rtnl_newlink+0x653/0xa70 [ 72.990045][ T595] ? rtnl_newlink+0xb9/0xa70 [ 72.990218][ T595] ? rtnetlink_rcv_msg+0x712/0xc10 [ 72.990395][ T595] ? __mutex_trylock_common+0xfa/0x260 [ 72.990570][ T595] ? __pfx___mutex_trylock_common+0x10/0x10 [ 72.990785][ T595] ? lock_acquire+0x32/0xc0 [ 72.990970][ T595] ? trace_contention_end+0xef/0x150 [ 72.991200][ T595] ? __mutex_lock+0x190/0xbc0 [ 72.991377][ T595] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 72.991552][ T595] ? rtnl_newlink+0x653/0xa70 [ 72.991725][ T595] ? __pfx___mutex_lock+0x10/0x10 [ 72.991901][ T595] ? __rtnl_newlink+0x3f2/0xa80 [ 72.992074][ T595] rtnl_newlink+0x69c/0xa70 [ 72.992254][ T595] ? __pfx_rtnl_newlink+0x10/0x10 [ 72.992425][ T595] ? find_held_lock+0x2c/0x110 [ 72.992606][ T595] ? __pfx___lock_release+0x10/0x10 [ 72.992781][ T595] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 72.992958][ T595] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 72.993132][ T595] ? __pfx_rtnl_newlink+0x10/0x10 [ 72.993306][ T595] rtnetlink_rcv_msg+0x712/0xc10 [ 72.993479][ T595] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 72.993658][ T595] ? hlock_class+0x4e/0x130 [ 72.993832][ T595] ? mark_lock+0x38/0x3e0 [ 72.993965][ T595] ? __lock_acquire+0xb9a/0x1680 [ 72.994138][ T595] netlink_rcv_skb+0x130/0x360 [ 72.994308][ T595] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 72.994483][ T595] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 72.994659][ T595] ? netlink_deliver_tap+0x13e/0x340 [ 72.994837][ T595] ? netlink_deliver_tap+0xc3/0x340 [ 72.995011][ T595] netlink_unicast+0x44b/0x710 [ 72.995185][ T595] ? __pfx_netlink_unicast+0x10/0x10 [ 72.995358][ T595] ? find_held_lock+0x2c/0x110 [ 72.995534][ T595] netlink_sendmsg+0x723/0xbe0 [ 72.995708][ T595] ? __pfx_netlink_sendmsg+0x10/0x10 [ 72.995882][ T595] ____sys_sendmsg+0x7ac/0xa10 [ 72.996062][ T595] ? __pfx_____sys_sendmsg+0x10/0x10 [ 72.996234][ T595] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 72.996453][ T595] ___sys_sendmsg+0xee/0x170 [ 72.996629][ T595] ? __pfx____sys_sendmsg+0x10/0x10 [ 72.996805][ T595] ? kasan_save_stack+0x34/0x50 [ 72.996979][ T595] ? kasan_save_stack+0x24/0x50 [ 72.997147][ T595] ? __kasan_record_aux_stack+0x8e/0xa0 [ 72.997323][ T595] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 72.997541][ T595] ? __x64_sys_close+0x7c/0xd0 [ 72.997712][ T595] ? do_syscall_64+0xc1/0x1d0 [ 72.997884][ T595] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 72.998101][ T595] ? __lock_acquire+0xb9a/0x1680 [ 72.998275][ T595] ? find_held_lock+0x2c/0x110 [ 72.998447][ T595] ? __lock_release+0x103/0x460 [ 72.998619][ T595] ? __virt_addr_valid+0x22b/0x430 [ 72.998800][ T595] ? __pfx___lock_release+0x10/0x10 [ 72.998980][ T595] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 72.999161][ T595] __sys_sendmsg+0x109/0x1a0 [ 72.999332][ T595] ? __pfx___sys_sendmsg+0x10/0x10 [ 72.999505][ T595] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 72.999725][ T595] do_syscall_64+0xc1/0x1d0 [ 72.999938][ T595] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 73.000138][ T595] RIP: 0033:0x7f543dba39a7 [ 73.000302][ T595] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 73.000856][ T595] RSP: 002b:00007ffc3f7448c8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 73.001100][ T595] RAX: ffffffffffffffda RBX: 00007ffc3f744ff0 RCX: 00007f543dba39a7 [ 73.001336][ T595] RDX: 0000000000000000 RSI: 00007ffc3f744930 RDI: 0000000000000005 [ 73.001575][ T595] RBP: 0000000000000004 R08: 0000000000000003 R09: 0000000000000000 [ 73.001810][ T595] R10: 000000001d3a6910 R11: 0000000000000246 R12: 0000000000000004 [ 73.002053][ T595] R13: 000000006779033e R14: 0000000000498600 R15: 0000000000000000 [ 73.002300][ T595] [ 73.006329][ T595] br1: port 1(veth0) entered blocking state [ 73.006536][ T595] br1: port 1(veth0) entered disabled state [ 73.006791][ T595] veth0: entered allmulticast mode [ 73.008238][ T595] veth0: entered promiscuous mode [ 73.020590][ T595] ip (595) used greatest stack depth: 23248 bytes left [ 73.092165][ T596] br1: port 1(veth0) entered blocking state [ 73.092401][ T596] br1: port 1(veth0) entered forwarding state [ 75.346349][ T601] veth0: left allmulticast mode [ 75.346597][ T601] veth0: left promiscuous mode [ 75.346890][ T601] br1: port 1(veth0) entered disabled state [ 86.079344][ T717] br0: vlan filtering disabled, automatically disabling multicast vlan snooping [ 86.449839][ T729] br0: port 2(veth2) entered disabled state [ 86.508065][ T730] br0: port 1(veth1) entered disabled state [ 86.581966][ T731] veth2: left allmulticast mode [ 86.582218][ T731] veth2: left promiscuous mode [ 86.582506][ T731] br0: port 2(veth2) entered disabled state [ 86.583842][ T731] veth1: left allmulticast mode [ 86.584043][ T731] veth1: left promiscuous mode [ 86.584329][ T731] br0: port 1(veth1) entered disabled state