[ 14.795103][ T301] 8021q: 802.1Q VLAN Support v1.8 [ 16.454678][ T319] ip (319) used greatest stack depth: 24056 bytes left [ 17.928293][ T344] br1: port 1(vx100) entered blocking state [ 17.929694][ T344] br1: port 1(vx100) entered disabled state [ 17.930123][ T344] vx100: entered allmulticast mode [ 17.932674][ T344] vx100: entered promiscuous mode [ 17.933935][ T344] br1: port 1(vx100) entered blocking state [ 17.934636][ T344] br1: port 1(vx100) entered forwarding state [ 18.106755][ T346] br1: port 2(veth1) entered blocking state [ 18.108200][ T346] br1: port 2(veth1) entered disabled state [ 18.108504][ T346] veth1: entered allmulticast mode [ 18.110452][ T346] veth1: entered promiscuous mode [ 18.187615][ T40] br1: port 2(veth1) entered blocking state [ 18.188242][ T40] br1: port 2(veth1) entered forwarding state [ 18.562863][ T352] br2: port 1(vx200) entered blocking state [ 18.563162][ T352] br2: port 1(vx200) entered disabled state [ 18.563443][ T352] vx200: entered allmulticast mode [ 18.565366][ T352] vx200: entered promiscuous mode [ 18.566514][ T352] br2: port 1(vx200) entered blocking state [ 18.566780][ T352] br2: port 1(vx200) entered forwarding state [ 18.839759][ T355] br2: port 2(veth2.20) entered blocking state [ 18.840071][ T355] br2: port 2(veth2.20) entered disabled state [ 18.840359][ T355] veth2.20: entered allmulticast mode [ 18.842249][ T355] veth2.20: entered promiscuous mode [ 18.929389][ T357] veth2: entered allmulticast mode [ 18.929623][ T357] veth2: entered promiscuous mode [ 18.938001][ T357] br2: port 2(veth2.20) entered blocking state [ 18.938491][ T357] br2: port 2(veth2.20) entered forwarding state [ 22.226663][ T402] br3: port 1(w1) entered blocking state [ 22.226929][ T402] br3: port 1(w1) entered disabled state [ 22.227168][ T402] w1: entered allmulticast mode [ 22.229134][ T402] w1: entered promiscuous mode [ 22.692940][ T408] br3: port 2(vx100) entered blocking state [ 22.693283][ T408] br3: port 2(vx100) entered disabled state [ 22.693602][ T408] vx100: entered allmulticast mode [ 22.695617][ T408] vx100: entered promiscuous mode [ 22.697708][ T408] br3: port 2(vx100) entered blocking state [ 22.698039][ T408] br3: port 2(vx100) entered forwarding state [ 23.343866][ T39] br3: port 1(w1) entered blocking state [ 23.344459][ T39] br3: port 1(w1) entered forwarding state [ 26.206931][ T456] br3: port 1(w1) entered blocking state [ 26.207212][ T456] br3: port 1(w1) entered disabled state [ 26.207461][ T456] w1: entered allmulticast mode [ 26.210614][ T456] w1: entered promiscuous mode [ 26.752960][ T462] br3: port 2(vx200) entered blocking state [ 26.753242][ T462] br3: port 2(vx200) entered disabled state [ 26.753506][ T462] vx200: entered allmulticast mode [ 26.755857][ T462] vx200: entered promiscuous mode [ 26.757088][ T462] br3: port 2(vx200) entered blocking state [ 26.757400][ T462] br3: port 2(vx200) entered forwarding state [ 27.361213][ T40] br3: port 1(w1) entered blocking state [ 27.361491][ T40] br3: port 1(w1) entered forwarding state [ 29.113367][ T501] br3: port 3(w1.20) entered blocking state [ 29.113725][ T501] br3: port 3(w1.20) entered disabled state [ 29.114071][ T501] w1.20: entered allmulticast mode [ 29.116035][ T501] w1.20: entered promiscuous mode [ 29.843015][ T514] br3: port 3(w1.20) entered blocking state [ 29.843369][ T514] br3: port 3(w1.20) entered forwarding state [ 40.131021][ T11] w1.20: left allmulticast mode [ 40.131601][ T11] w1.20: left promiscuous mode [ 40.132778][ T11] br3: port 3(w1.20) entered disabled state [ 40.137529][ T11] vx200: left allmulticast mode [ 40.137886][ T11] vx200: left promiscuous mode [ 40.138366][ T11] br3: port 2(vx200) entered disabled state [ 40.142034][ T11] w1: left allmulticast mode [ 40.142290][ T11] w1: left promiscuous mode [ 40.142645][ T11] br3: port 1(w1) entered disabled state [ 40.580554][ T11] vx100: left allmulticast mode [ 40.581148][ T11] vx100: left promiscuous mode [ 40.581509][ T11] br3: port 2(vx100) entered disabled state [ 40.584183][ T11] w1: left allmulticast mode [ 40.584728][ T11] w1: left promiscuous mode [ 40.585526][ T11] br3: port 1(w1) entered disabled state [ 42.610237][ T612] vx200: left allmulticast mode [ 42.610732][ T612] vx200: left promiscuous mode [ 42.611320][ T612] br2: port 1(vx200) entered disabled state [ 42.901698][ T615] veth2: left allmulticast mode [ 42.901958][ T615] veth2: left promiscuous mode [ 42.904407][ T615] br2: port 2(veth2.20) entered disabled state [ 42.926274][ T615] veth2.20 (unregistering): left allmulticast mode [ 42.926759][ T615] veth2.20 (unregistering): left promiscuous mode [ 42.927035][ T615] br2: port 2(veth2.20) entered disabled state [ 42.927902][ T615] [ 42.927999][ T615] ============================================ [ 42.928200][ T615] WARNING: possible recursive locking detected [ 42.928387][ T615] 6.13.0-rc5-virtme #1 Not tainted [ 42.928546][ T615] -------------------------------------------- [ 42.928749][ T615] ip/615 is trying to acquire lock: [ 42.928913][ T615] ffffffffa05d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 42.929239][ T615] [ 42.929239][ T615] but task is already holding lock: [ 42.929482][ T615] ffffffffa05d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 42.929796][ T615] [ 42.929796][ T615] other info that might help us debug this: [ 42.930043][ T615] Possible unsafe locking scenario: [ 42.930043][ T615] [ 42.930282][ T615] CPU0 [ 42.930411][ T615] ---- [ 42.930536][ T615] lock((netdev_chain).rwsem); [ 42.930690][ T615] lock((netdev_chain).rwsem); [ 42.930844][ T615] [ 42.930844][ T615] *** DEADLOCK *** [ 42.930844][ T615] [ 42.931088][ T615] May be due to missing lock nesting notation [ 42.931088][ T615] [ 42.931319][ T615] 2 locks held by ip/615: [ 42.931443][ T615] #0: ffffffffa05e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 42.931722][ T615] #1: ffffffffa05d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 42.932046][ T615] [ 42.932046][ T615] stack backtrace: [ 42.932253][ T615] CPU: 3 UID: 0 PID: 615 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 42.932499][ T615] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 42.932719][ T615] Call Trace: [ 42.932840][ T615] [ 42.932921][ T615] dump_stack_lvl+0x82/0xd0 [ 42.933095][ T615] print_deadlock_bug+0x40a/0x650 [ 42.933279][ T615] validate_chain+0x5bf/0xae0 [ 42.933434][ T615] ? __pfx_validate_chain+0x10/0x10 [ 42.933590][ T615] ? hlock_class+0x4e/0x130 [ 42.933743][ T615] ? mark_lock+0x38/0x3e0 [ 42.933862][ T615] __lock_acquire+0xb9a/0x1680 [ 42.934017][ T615] ? hlock_class+0x4e/0x130 [ 42.934172][ T615] lock_acquire.part.0+0xeb/0x330 [ 42.934337][ T615] ? blocking_notifier_call_chain+0x50/0x90 [ 42.934537][ T615] ? validate_chain+0x5a7/0xae0 [ 42.934690][ T615] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 42.934849][ T615] ? trace_lock_acquire+0x14c/0x1f0 [ 42.935007][ T615] ? lock_acquire+0x32/0xc0 [ 42.935175][ T615] ? blocking_notifier_call_chain+0x50/0x90 [ 42.935377][ T615] down_read+0x9f/0x340 [ 42.935508][ T615] ? blocking_notifier_call_chain+0x50/0x90 [ 42.935708][ T615] ? __pfx_down_read+0x10/0x10 [ 42.935870][ T615] ? __lock_acquire+0xb9a/0x1680 [ 42.936030][ T615] blocking_notifier_call_chain+0x50/0x90 [ 42.936191][ T615] __netdev_upper_dev_unlink+0xd9/0x220 [ 42.936346][ T615] ? br_fdb_delete_by_port+0x36/0x260 [bridge] [ 42.936600][ T615] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 42.936807][ T615] ? find_held_lock+0x2c/0x110 [ 42.936976][ T615] ? del_nbp+0x377/0xbe0 [bridge] [ 42.937196][ T615] ? hlock_class+0x4e/0x130 [ 42.937355][ T615] netdev_upper_dev_unlink+0x71/0xa0 [ 42.937519][ T615] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 42.937726][ T615] ? mutex_spin_on_owner+0x1f2/0x2b0 [ 42.937898][ T615] ? rtnl_is_locked+0x15/0x20 [ 42.938069][ T615] del_nbp+0x602/0xbe0 [bridge] [ 42.938281][ T615] br_del_if+0xa3/0x1f0 [bridge] [ 42.938483][ T615] br_device_event+0x53d/0x800 [bridge] [ 42.938671][ T615] ? __pfx_br_device_event+0x10/0x10 [bridge] [ 42.938892][ T615] ? netconsole_netdev_event+0x2c1/0x620 [ 42.939047][ T615] ? packet_notifier+0x3b0/0x810 [ 42.939222][ T615] notifier_call_chain+0xcd/0x150 [ 42.939384][ T615] blocking_notifier_call_chain+0x66/0x90 [ 42.939546][ T615] unregister_netdevice_many_notify+0xa7b/0x1580 [ 42.939735][ T615] ? __lock_release+0x103/0x460 [ 42.939989][ T615] ? __pfx___lock_release+0x10/0x10 [ 42.940148][ T615] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 42.940344][ T615] ? hlock_class+0x4e/0x130 [ 42.940507][ T615] ? mark_held_locks+0x9e/0xe0 [ 42.940664][ T615] ? __pfx_vlan_info_rcu_free+0x10/0x10 [ 42.940831][ T615] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 42.941028][ T615] rtnl_dellink+0x348/0xa40 [ 42.941189][ T615] ? __pfx_rtnl_dellink+0x10/0x10 [ 42.941362][ T615] ? find_held_lock+0x2c/0x110 [ 42.941519][ T615] ? __lock_release+0x103/0x460 [ 42.941674][ T615] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 42.941832][ T615] ? __pfx___lock_release+0x10/0x10 [ 42.941990][ T615] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 42.942149][ T615] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 42.942304][ T615] ? __pfx_rtnl_dellink+0x10/0x10 [ 42.942465][ T615] rtnetlink_rcv_msg+0x712/0xc10 [ 42.942623][ T615] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 42.942779][ T615] ? hlock_class+0x4e/0x130 [ 42.942934][ T615] ? mark_lock+0x38/0x3e0 [ 42.943063][ T615] ? __lock_acquire+0xb9a/0x1680 [ 42.943223][ T615] netlink_rcv_skb+0x130/0x360 [ 42.943383][ T615] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 42.943542][ T615] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 42.943703][ T615] ? netlink_deliver_tap+0x13e/0x340 [ 42.943863][ T615] ? netlink_deliver_tap+0xc3/0x340 [ 42.944023][ T615] netlink_unicast+0x44b/0x710 [ 42.944188][ T615] ? __pfx_netlink_unicast+0x10/0x10 [ 42.944347][ T615] ? find_held_lock+0x2c/0x110 [ 42.944507][ T615] netlink_sendmsg+0x723/0xbe0 [ 42.944665][ T615] ? __pfx_netlink_sendmsg+0x10/0x10 [ 42.944826][ T615] ____sys_sendmsg+0x7ac/0xa10 [ 42.944989][ T615] ? __pfx_____sys_sendmsg+0x10/0x10 [ 42.945157][ T615] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 42.945378][ T615] ___sys_sendmsg+0xee/0x170 [ 42.945536][ T615] ? __pfx____sys_sendmsg+0x10/0x10 [ 42.945695][ T615] ? kasan_save_stack+0x34/0x50 [ 42.945854][ T615] ? kasan_save_stack+0x24/0x50 [ 42.946013][ T615] ? __kasan_record_aux_stack+0x8e/0xa0 [ 42.946175][ T615] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 42.946378][ T615] ? __x64_sys_close+0x7c/0xd0 [ 42.946537][ T615] ? do_syscall_64+0xc1/0x1d0 [ 42.946698][ T615] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 42.946900][ T615] ? __lock_acquire+0xb9a/0x1680 [ 42.947060][ T615] ? find_held_lock+0x2c/0x110 [ 42.947236][ T615] ? __lock_release+0x103/0x460 [ 42.947395][ T615] ? __virt_addr_valid+0x22b/0x430 [ 42.947557][ T615] ? __pfx___lock_release+0x10/0x10 [ 42.947716][ T615] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 42.947880][ T615] __sys_sendmsg+0x109/0x1a0 [ 42.948038][ T615] ? __pfx___sys_sendmsg+0x10/0x10 [ 42.948198][ T615] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 42.948401][ T615] do_syscall_64+0xc1/0x1d0 [ 42.948558][ T615] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 42.948752][ T615] RIP: 0033:0x7f215a13b9a7 [ 42.948923][ T615] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 42.949489][ T615] RSP: 002b:00007ffdc2dd1228 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 42.949730][ T615] RAX: ffffffffffffffda RBX: 00007ffdc2dd1950 RCX: 00007f215a13b9a7 [ 42.949971][ T615] RDX: 0000000000000000 RSI: 00007ffdc2dd1290 RDI: 0000000000000005 [ 42.950216][ T615] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 42.950456][ T615] R10: 00007f2159ff9ef8 R11: 0000000000000246 R12: 0000000000000002 [ 42.950697][ T615] R13: 0000000067795438 R14: 0000000000498600 R15: 0000000000000000 [ 42.950938][ T615] [ 42.973687][ T615] ip (615) used greatest stack depth: 23608 bytes left [ 43.223735][ T619] br1: port 2(veth1) entered disabled state [ 43.282554][ T620] veth1: left allmulticast mode [ 43.282752][ T620] veth1: left promiscuous mode [ 43.283411][ T620] br1: port 2(veth1) entered disabled state [ 43.345457][ T621] vx100: left allmulticast mode [ 43.345692][ T621] vx100: left promiscuous mode [ 43.345997][ T621] br1: port 1(vx100) entered disabled state