[ 15.903712][ T326] br1: port 1(vx10) entered blocking state [ 15.905211][ T326] br1: port 1(vx10) entered disabled state [ 15.905873][ T326] vx10: entered allmulticast mode [ 15.910038][ T326] vx10: entered promiscuous mode [ 15.911601][ T326] br1: port 1(vx10) entered blocking state [ 15.912230][ T326] br1: port 1(vx10) entered forwarding state [ 16.284677][ T331] br1: port 2(vx20) entered blocking state [ 16.284973][ T331] br1: port 2(vx20) entered disabled state [ 16.285386][ T331] vx20: entered allmulticast mode [ 16.287338][ T331] vx20: entered promiscuous mode [ 16.288054][ T331] br1: port 2(vx20) entered blocking state [ 16.288334][ T331] br1: port 2(vx20) entered forwarding state [ 16.460856][ T333] br1: port 3(veth1) entered blocking state [ 16.461171][ T333] br1: port 3(veth1) entered disabled state [ 16.461474][ T333] veth1: entered allmulticast mode [ 16.463528][ T333] veth1: entered promiscuous mode [ 16.551965][ T37] br1: port 3(veth1) entered blocking state [ 16.552410][ T37] br1: port 3(veth1) entered forwarding state [ 16.708219][ T336] br1: port 4(veth2) entered blocking state [ 16.708537][ T336] br1: port 4(veth2) entered disabled state [ 16.708806][ T336] veth2: entered allmulticast mode [ 16.710685][ T336] veth2: entered promiscuous mode [ 16.790149][ T37] br1: port 4(veth2) entered blocking state [ 16.790448][ T37] br1: port 4(veth2) entered forwarding state [ 17.131856][ T342] br1: port 5(vx4001) entered blocking state [ 17.132150][ T342] br1: port 5(vx4001) entered disabled state [ 17.132419][ T342] vx4001: entered allmulticast mode [ 17.134318][ T342] vx4001: entered promiscuous mode [ 17.135034][ T342] br1: port 5(vx4001) entered blocking state [ 17.135286][ T342] br1: port 5(vx4001) entered forwarding state [ 17.804397][ T351] 8021q: 802.1Q VLAN Support v1.8 [ 18.064171][ T354] br1: entered promiscuous mode [ 18.067807][ T354] br1: left promiscuous mode [ 18.077960][ T354] br1: entered promiscuous mode [ 24.031765][ T437] br1: port 1(vx10) entered blocking state [ 24.032093][ T437] br1: port 1(vx10) entered disabled state [ 24.033604][ T437] vx10: entered allmulticast mode [ 24.035664][ T437] vx10: entered promiscuous mode [ 24.036554][ T437] br1: port 1(vx10) entered blocking state [ 24.036835][ T437] br1: port 1(vx10) entered forwarding state [ 24.369924][ T441] br1: port 2(vx20) entered blocking state [ 24.370279][ T441] br1: port 2(vx20) entered disabled state [ 24.370600][ T441] vx20: entered allmulticast mode [ 24.372641][ T441] vx20: entered promiscuous mode [ 24.373592][ T441] br1: port 2(vx20) entered blocking state [ 24.373893][ T441] br1: port 2(vx20) entered forwarding state [ 24.731021][ T445] br1: port 3(vx4001) entered blocking state [ 24.731357][ T445] br1: port 3(vx4001) entered disabled state [ 24.731682][ T445] vx4001: entered allmulticast mode [ 24.733646][ T445] vx4001: entered promiscuous mode [ 24.734182][ T445] br1: port 3(vx4001) entered blocking state [ 24.734423][ T445] br1: port 3(vx4001) entered forwarding state [ 24.929226][ T447] br1: port 4(w1) entered blocking state [ 24.929464][ T447] br1: port 4(w1) entered disabled state [ 24.929698][ T447] w1: entered allmulticast mode [ 24.931618][ T447] w1: entered promiscuous mode [ 25.016615][ T40] br1: port 4(w1) entered blocking state [ 25.016877][ T40] br1: port 4(w1) entered forwarding state [ 25.183076][ T450] br1: port 5(w3) entered blocking state [ 25.183715][ T450] br1: port 5(w3) entered disabled state [ 25.183949][ T450] w3: entered allmulticast mode [ 25.185796][ T450] w3: entered promiscuous mode [ 25.263639][ T39] br1: port 5(w3) entered blocking state [ 25.263914][ T39] br1: port 5(w3) entered forwarding state [ 26.043356][ T460] br1: entered promiscuous mode [ 26.046183][ T460] br1: left promiscuous mode [ 26.066010][ T460] br1: entered promiscuous mode [ 26.894648][ C1] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 26.896930][ C1] IPv6: vlan10-v: IPv6 duplicate address fe80::200:5eff:fe00:101 used by 00:00:5e:00:01:01 detected! [ 27.343359][ C1] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 27.344246][ C1] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 27.344736][ C1] IPv6: vlan20-v: IPv6 duplicate address fe80::200:5eff:fe00:101 used by 00:00:5e:00:01:01 detected! [ 27.407248][ C0] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 44.288945][ T66] w3: left allmulticast mode [ 44.289546][ T66] w3: left promiscuous mode [ 44.289954][ T66] br1: port 5(w3) entered disabled state [ 44.293616][ T66] w1: left allmulticast mode [ 44.293853][ T66] w1: left promiscuous mode [ 44.294330][ T66] br1: port 4(w1) entered disabled state [ 44.296183][ T66] vx4001: left allmulticast mode [ 44.296437][ T66] vx4001: left promiscuous mode [ 44.296774][ T66] br1: port 3(vx4001) entered disabled state [ 44.299257][ T66] vx20: left allmulticast mode [ 44.299534][ T66] vx20: left promiscuous mode [ 44.299905][ T66] br1: port 2(vx20) entered disabled state [ 44.301642][ T66] vx10: left allmulticast mode [ 44.301857][ T66] vx10: left promiscuous mode [ 44.303759][ T66] br1: port 1(vx10) entered disabled state [ 44.330052][ T66] [ 44.330193][ T66] ============================================ [ 44.330410][ T66] WARNING: possible recursive locking detected [ 44.330603][ T66] 6.13.0-rc5-virtme #1 Not tainted [ 44.330781][ T66] -------------------------------------------- [ 44.331007][ T66] kworker/u16:1/66 is trying to acquire lock: [ 44.331209][ T66] ffffffffab5d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 44.331573][ T66] [ 44.331573][ T66] but task is already holding lock: [ 44.331831][ T66] ffffffffab5d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 44.332219][ T66] [ 44.332219][ T66] other info that might help us debug this: [ 44.332482][ T66] Possible unsafe locking scenario: [ 44.332482][ T66] [ 44.332732][ T66] CPU0 [ 44.332875][ T66] ---- [ 44.333007][ T66] lock((netdev_chain).rwsem); [ 44.333180][ T66] lock((netdev_chain).rwsem); [ 44.333373][ T66] [ 44.333373][ T66] *** DEADLOCK *** [ 44.333373][ T66] [ 44.333638][ T66] May be due to missing lock nesting notation [ 44.333638][ T66] [ 44.333875][ T66] 5 locks held by kworker/u16:1/66: [ 44.334052][ T66] #0: ffff8880010ad948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 44.334404][ T66] #1: ffffc90000477da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 44.334691][ T66] #2: ffffffffab5cc090 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xa50 [ 44.334976][ T66] #3: ffffffffab5e7a48 (rtnl_mutex){+.+.}-{4:4}, at: cleanup_net+0x45e/0xa50 [ 44.335253][ T66] #4: ffffffffab5d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 44.335564][ T66] [ 44.335564][ T66] stack backtrace: [ 44.335755][ T66] CPU: 0 UID: 0 PID: 66 Comm: kworker/u16:1 Not tainted 6.13.0-rc5-virtme #1 [ 44.336022][ T66] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 44.336219][ T66] Workqueue: netns cleanup_net [ 44.336387][ T66] Call Trace: [ 44.336512][ T66] <TASK> [ 44.336589][ T66] dump_stack_lvl+0x82/0xd0 [ 44.336765][ T66] print_deadlock_bug+0x40a/0x650 [ 44.336932][ T66] validate_chain+0x5bf/0xae0 [ 44.337112][ T66] ? __pfx_validate_chain+0x10/0x10 [ 44.337313][ T66] ? hlock_class+0x4e/0x130 [ 44.337489][ T66] ? mark_lock+0x38/0x3e0 [ 44.337618][ T66] __lock_acquire+0xb9a/0x1680 [ 44.337783][ T66] ? spin_bug+0x1b1/0x1d0 [ 44.337907][ T66] ? debug_object_assert_init+0x2a9/0x370 [ 44.338077][ T66] lock_acquire.part.0+0xeb/0x330 [ 44.338251][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 44.338473][ T66] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 44.338647][ T66] ? trace_lock_acquire+0x14c/0x1f0 [ 44.338812][ T66] ? lock_acquire+0x32/0xc0 [ 44.338975][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 44.339195][ T66] down_read+0x9f/0x340 [ 44.339339][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 44.339569][ T66] ? __pfx_down_read+0x10/0x10 [ 44.339746][ T66] blocking_notifier_call_chain+0x50/0x90 [ 44.339940][ T66] __dev_close_many+0xdf/0x2d0 [ 44.340120][ T66] ? __pfx___dev_close_many+0x10/0x10 [ 44.340304][ T66] dev_close_many+0x202/0x650 [ 44.340492][ T66] ? __lock_release+0x103/0x460 [ 44.340665][ T66] ? __pfx_dev_close_many+0x10/0x10 [ 44.340836][ T66] ? __pfx___lock_release+0x10/0x10 [ 44.341002][ T66] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 44.341164][ T66] vlan_device_event+0x143b/0x2130 [8021q] [ 44.341397][ T66] ? net_generic+0xbb/0x1f0 [vxlan] [ 44.341613][ T66] ? __pfx_vlan_device_event+0x10/0x10 [8021q] [ 44.341842][ T66] ? __pfx_vxlan_netdevice_event+0x10/0x10 [vxlan] [ 44.342080][ T66] ? packet_notifier+0x3b0/0x810 [ 44.342269][ T66] notifier_call_chain+0xcd/0x150 [ 44.342496][ T66] blocking_notifier_call_chain+0x66/0x90 [ 44.342671][ T66] dev_close_many+0x2d8/0x650 [ 44.342859][ T66] ? __lock_release+0x103/0x460 [ 44.343049][ T66] ? __virt_addr_valid+0x22b/0x430 [ 44.343242][ T66] ? __pfx_dev_close_many+0x10/0x10 [ 44.343436][ T66] unregister_netdevice_many_notify+0x8e5/0x1580 [ 44.343656][ T66] ? mark_held_locks+0x9e/0xe0 [ 44.343856][ T66] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 44.344070][ T66] ? mutex_is_locked+0x1c/0x60 [ 44.344239][ T66] ? rtnl_is_locked+0x15/0x20 [ 44.344427][ T66] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 44.344641][ T66] ? mutex_is_locked+0x1c/0x60 [ 44.344832][ T66] ? nexthop_net_exit_batch_rtnl+0x83/0x210 [ 44.345033][ T66] cleanup_net+0x4cf/0xa50 [ 44.345197][ T66] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 44.345357][ T66] ? __pfx_cleanup_net+0x10/0x10 [ 44.345517][ T66] ? trace_lock_acquire+0x14c/0x1f0 [ 44.345680][ T66] ? lock_acquire+0x32/0xc0 [ 44.345842][ T66] ? process_one_work+0xe0b/0x16d0 [ 44.346001][ T66] process_one_work+0xe55/0x16d0 [ 44.346156][ T66] ? __pfx___lock_release+0x10/0x10 [ 44.346307][ T66] ? __pfx_process_one_work+0x10/0x10 [ 44.346469][ T66] ? assign_work+0x16c/0x240 [ 44.346630][ T66] worker_thread+0x58c/0xce0 [ 44.346789][ T66] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 44.346991][ T66] ? __pfx_worker_thread+0x10/0x10 [ 44.347150][ T66] ? __pfx_worker_thread+0x10/0x10 [ 44.347440][ T66] kthread+0x28a/0x350 [ 44.347565][ T66] ? __pfx_kthread+0x10/0x10 [ 44.347729][ T66] ret_from_fork+0x31/0x70 [ 44.347894][ T66] ? __pfx_kthread+0x10/0x10 [ 44.348059][ T66] ret_from_fork_asm+0x1a/0x30 [ 44.348363][ T66] </TASK> [ 46.290841][ T649] br1: left promiscuous mode [ 46.759902][ T655] br1: port 4(veth2) entered disabled state [ 46.824994][ T656] veth2: left allmulticast mode [ 46.826227][ T656] veth2: left promiscuous mode [ 46.826773][ T656] br1: port 4(veth2) entered disabled state [ 46.946154][ T658] br1: port 3(veth1) entered disabled state [ 47.004053][ T659] veth1: left allmulticast mode [ 47.004311][ T659] veth1: left promiscuous mode [ 47.004654][ T659] br1: port 3(veth1) entered disabled state [ 47.143021][ T661] vx4001: left allmulticast mode [ 47.143251][ T661] vx4001: left promiscuous mode [ 47.143509][ T661] br1: port 5(vx4001) entered disabled state [ 47.432079][ T665] vx20: left allmulticast mode [ 47.432335][ T665] vx20: left promiscuous mode [ 47.432614][ T665] br1: port 2(vx20) entered disabled state [ 47.704953][ T669] vx10: left allmulticast mode [ 47.705249][ T669] vx10: left promiscuous mode [ 47.705538][ T669] br1: port 1(vx10) entered disabled state