[ 15.534953][ T326] br1: port 1(vx10) entered blocking state [ 15.535383][ T326] br1: port 1(vx10) entered disabled state [ 15.535771][ T326] vx10: entered allmulticast mode [ 15.537791][ T326] vx10: entered promiscuous mode [ 15.538927][ T326] br1: port 1(vx10) entered blocking state [ 15.539363][ T326] br1: port 1(vx10) entered forwarding state [ 15.905279][ T331] br1: port 2(vx20) entered blocking state [ 15.905648][ T331] br1: port 2(vx20) entered disabled state [ 15.905913][ T331] vx20: entered allmulticast mode [ 15.908510][ T331] vx20: entered promiscuous mode [ 15.909279][ T331] br1: port 2(vx20) entered blocking state [ 15.909521][ T331] br1: port 2(vx20) entered forwarding state [ 16.063817][ T333] br1: port 3(veth1) entered blocking state [ 16.064131][ T333] br1: port 3(veth1) entered disabled state [ 16.064433][ T333] veth1: entered allmulticast mode [ 16.066320][ T333] veth1: entered promiscuous mode [ 16.149725][ T59] br1: port 3(veth1) entered blocking state [ 16.150253][ T59] br1: port 3(veth1) entered forwarding state [ 16.307591][ T336] br1: port 4(veth2) entered blocking state [ 16.307908][ T336] br1: port 4(veth2) entered disabled state [ 16.308189][ T336] veth2: entered allmulticast mode [ 16.310063][ T336] veth2: entered promiscuous mode [ 16.415192][ T45] br1: port 4(veth2) entered blocking state [ 16.415471][ T45] br1: port 4(veth2) entered forwarding state [ 16.724228][ T342] br1: port 5(vx4001) entered blocking state [ 16.724528][ T342] br1: port 5(vx4001) entered disabled state [ 16.724822][ T342] vx4001: entered allmulticast mode [ 16.726716][ T342] vx4001: entered promiscuous mode [ 16.727268][ T342] br1: port 5(vx4001) entered blocking state [ 16.727522][ T342] br1: port 5(vx4001) entered forwarding state [ 17.444948][ T351] 8021q: 802.1Q VLAN Support v1.8 [ 17.737886][ T355] br1: entered promiscuous mode [ 17.740370][ T355] br1: left promiscuous mode [ 17.757440][ T355] br1: entered promiscuous mode [ 23.277182][ T437] br1: port 1(vx10) entered blocking state [ 23.277497][ T437] br1: port 1(vx10) entered disabled state [ 23.278721][ T437] vx10: entered allmulticast mode [ 23.280681][ T437] vx10: entered promiscuous mode [ 23.288887][ T437] br1: port 1(vx10) entered blocking state [ 23.289177][ T437] br1: port 1(vx10) entered forwarding state [ 23.600849][ T441] br1: port 2(vx20) entered blocking state [ 23.601121][ T441] br1: port 2(vx20) entered disabled state [ 23.601386][ T441] vx20: entered allmulticast mode [ 23.603975][ T441] vx20: entered promiscuous mode [ 23.604463][ T441] br1: port 2(vx20) entered blocking state [ 23.604753][ T441] br1: port 2(vx20) entered forwarding state [ 23.916067][ T445] br1: port 3(vx4001) entered blocking state [ 23.916336][ T445] br1: port 3(vx4001) entered disabled state [ 23.916940][ T445] vx4001: entered allmulticast mode [ 23.918809][ T445] vx4001: entered promiscuous mode [ 23.919328][ T445] br1: port 3(vx4001) entered blocking state [ 23.919581][ T445] br1: port 3(vx4001) entered forwarding state [ 24.080509][ T447] br1: port 4(w1) entered blocking state [ 24.080771][ T447] br1: port 4(w1) entered disabled state [ 24.081014][ T447] w1: entered allmulticast mode [ 24.082899][ T447] w1: entered promiscuous mode [ 24.160242][ T39] br1: port 4(w1) entered blocking state [ 24.160475][ T39] br1: port 4(w1) entered forwarding state [ 24.302686][ T450] br1: port 5(w3) entered blocking state [ 24.303001][ T450] br1: port 5(w3) entered disabled state [ 24.303226][ T450] w3: entered allmulticast mode [ 24.306154][ T450] w3: entered promiscuous mode [ 24.409371][ T39] br1: port 5(w3) entered blocking state [ 24.409622][ T39] br1: port 5(w3) entered forwarding state [ 25.276706][ T460] br1: entered promiscuous mode [ 25.278947][ T460] br1: left promiscuous mode [ 25.300842][ T460] br1: entered promiscuous mode [ 26.000166][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 26.001626][ C3] IPv6: vlan10-v: IPv6 duplicate address fe80::200:5eff:fe00:101 used by 00:00:5e:00:01:01 detected! [ 26.320048][ C3] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 26.321232][ C3] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 26.321785][ C3] IPv6: vlan20-v: IPv6 duplicate address fe80::200:5eff:fe00:101 used by 00:00:5e:00:01:01 detected! [ 43.229527][ T68] w3: left allmulticast mode [ 43.230044][ T68] w3: left promiscuous mode [ 43.230653][ T68] br1: port 5(w3) entered disabled state [ 43.235057][ T68] w1: left allmulticast mode [ 43.235373][ T68] w1: left promiscuous mode [ 43.235882][ T68] br1: port 4(w1) entered disabled state [ 43.239259][ T68] vx4001: left allmulticast mode [ 43.239819][ T68] vx4001: left promiscuous mode [ 43.240319][ T68] br1: port 3(vx4001) entered disabled state [ 43.242315][ T68] vx20: left allmulticast mode [ 43.242655][ T68] vx20: left promiscuous mode [ 43.243202][ T68] br1: port 2(vx20) entered disabled state [ 43.247034][ T68] vx10: left allmulticast mode [ 43.247350][ T68] vx10: left promiscuous mode [ 43.248769][ T68] br1: port 1(vx10) entered disabled state [ 43.274290][ T68] [ 43.274422][ T68] ============================================ [ 43.274620][ T68] WARNING: possible recursive locking detected [ 43.274812][ T68] 6.13.0-rc5-virtme #1 Not tainted [ 43.274975][ T68] -------------------------------------------- [ 43.275182][ T68] kworker/u16:1/68 is trying to acquire lock: [ 43.275367][ T68] ffffffff895d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 43.275667][ T68] [ 43.275667][ T68] but task is already holding lock: [ 43.275882][ T68] ffffffff895d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 43.276165][ T68] [ 43.276165][ T68] other info that might help us debug this: [ 43.276380][ T68] Possible unsafe locking scenario: [ 43.276380][ T68] [ 43.276591][ T68] CPU0 [ 43.276696][ T68] ---- [ 43.276826][ T68] lock((netdev_chain).rwsem); [ 43.276983][ T68] lock((netdev_chain).rwsem); [ 43.277141][ T68] [ 43.277141][ T68] *** DEADLOCK *** [ 43.277141][ T68] [ 43.277350][ T68] May be due to missing lock nesting notation [ 43.277350][ T68] [ 43.277558][ T68] 5 locks held by kworker/u16:1/68: [ 43.277700][ T68] #0: ffff8880010ad948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 43.278015][ T68] #1: ffffc90000497da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 43.278266][ T68] #2: ffffffff895cc090 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xa50 [ 43.278523][ T68] #3: ffffffff895e7a48 (rtnl_mutex){+.+.}-{4:4}, at: cleanup_net+0x45e/0xa50 [ 43.278793][ T68] #4: ffffffff895d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 43.279077][ T68] [ 43.279077][ T68] stack backtrace: [ 43.279265][ T68] CPU: 0 UID: 0 PID: 68 Comm: kworker/u16:1 Not tainted 6.13.0-rc5-virtme #1 [ 43.279512][ T68] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 43.279696][ T68] Workqueue: netns cleanup_net [ 43.279857][ T68] Call Trace: [ 43.279965][ T68] <TASK> [ 43.280039][ T68] dump_stack_lvl+0x82/0xd0 [ 43.280197][ T68] print_deadlock_bug+0x40a/0x650 [ 43.280340][ T68] validate_chain+0x5bf/0xae0 [ 43.280486][ T68] ? __pfx_validate_chain+0x10/0x10 [ 43.280630][ T68] ? hlock_class+0x4e/0x130 [ 43.280770][ T68] ? mark_lock+0x38/0x3e0 [ 43.280882][ T68] __lock_acquire+0xb9a/0x1680 [ 43.281025][ T68] ? spin_bug+0x1b1/0x1d0 [ 43.281137][ T68] ? debug_object_assert_init+0x2a9/0x370 [ 43.281280][ T68] lock_acquire.part.0+0xeb/0x330 [ 43.281448][ T68] ? blocking_notifier_call_chain+0x50/0x90 [ 43.281630][ T68] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 43.281778][ T68] ? trace_lock_acquire+0x14c/0x1f0 [ 43.281938][ T68] ? lock_acquire+0x32/0xc0 [ 43.282098][ T68] ? blocking_notifier_call_chain+0x50/0x90 [ 43.282298][ T68] down_read+0x9f/0x340 [ 43.282418][ T68] ? blocking_notifier_call_chain+0x50/0x90 [ 43.282619][ T68] ? __pfx_down_read+0x10/0x10 [ 43.282797][ T68] blocking_notifier_call_chain+0x50/0x90 [ 43.282959][ T68] __dev_close_many+0xdf/0x2d0 [ 43.283119][ T68] ? __pfx___dev_close_many+0x10/0x10 [ 43.283272][ T68] dev_close_many+0x202/0x650 [ 43.283419][ T68] ? __lock_release+0x103/0x460 [ 43.283562][ T68] ? __pfx_dev_close_many+0x10/0x10 [ 43.283714][ T68] ? __pfx___lock_release+0x10/0x10 [ 43.283864][ T68] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 43.284017][ T68] vlan_device_event+0x143b/0x2130 [8021q] [ 43.284210][ T68] ? net_generic+0xbb/0x1f0 [vxlan] [ 43.284371][ T68] ? __pfx_vlan_device_event+0x10/0x10 [8021q] [ 43.284550][ T68] ? __pfx_vxlan_netdevice_event+0x10/0x10 [vxlan] [ 43.284748][ T68] ? packet_notifier+0x3b0/0x810 [ 43.284900][ T68] notifier_call_chain+0xcd/0x150 [ 43.285050][ T68] blocking_notifier_call_chain+0x66/0x90 [ 43.285199][ T68] dev_close_many+0x2d8/0x650 [ 43.285345][ T68] ? __lock_release+0x103/0x460 [ 43.285490][ T68] ? __virt_addr_valid+0x22b/0x430 [ 43.285636][ T68] ? __pfx_dev_close_many+0x10/0x10 [ 43.285787][ T68] unregister_netdevice_many_notify+0x8e5/0x1580 [ 43.285972][ T68] ? mark_held_locks+0x9e/0xe0 [ 43.286115][ T68] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 43.286290][ T68] ? mutex_is_locked+0x1c/0x60 [ 43.286432][ T68] ? rtnl_is_locked+0x15/0x20 [ 43.286580][ T68] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 43.286756][ T68] ? mutex_is_locked+0x1c/0x60 [ 43.286905][ T68] ? nexthop_net_exit_batch_rtnl+0x83/0x210 [ 43.287084][ T68] cleanup_net+0x4cf/0xa50 [ 43.287226][ T68] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 43.287370][ T68] ? __pfx_cleanup_net+0x10/0x10 [ 43.287506][ T68] ? trace_lock_acquire+0x14c/0x1f0 [ 43.287648][ T68] ? lock_acquire+0x32/0xc0 [ 43.287787][ T68] ? process_one_work+0xe0b/0x16d0 [ 43.287938][ T68] process_one_work+0xe55/0x16d0 [ 43.288078][ T68] ? __pfx___lock_release+0x10/0x10 [ 43.288219][ T68] ? __pfx_process_one_work+0x10/0x10 [ 43.288359][ T68] ? assign_work+0x16c/0x240 [ 43.288501][ T68] worker_thread+0x58c/0xce0 [ 43.288638][ T68] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 43.288814][ T68] ? __pfx_worker_thread+0x10/0x10 [ 43.288958][ T68] ? __pfx_worker_thread+0x10/0x10 [ 43.289096][ T68] kthread+0x28a/0x350 [ 43.289204][ T68] ? __pfx_kthread+0x10/0x10 [ 43.289344][ T68] ret_from_fork+0x31/0x70 [ 43.289486][ T68] ? __pfx_kthread+0x10/0x10 [ 43.289627][ T68] ret_from_fork_asm+0x1a/0x30 [ 43.289775][ T68] </TASK> [ 45.046193][ T649] br1: left promiscuous mode [ 45.523674][ T655] br1: port 4(veth2) entered disabled state [ 45.582479][ T656] veth2: left allmulticast mode [ 45.582726][ T656] veth2: left promiscuous mode [ 45.583028][ T656] br1: port 4(veth2) entered disabled state [ 45.691496][ T658] br1: port 3(veth1) entered disabled state [ 45.750136][ T659] veth1: left allmulticast mode [ 45.750360][ T659] veth1: left promiscuous mode [ 45.751425][ T659] br1: port 3(veth1) entered disabled state [ 45.859343][ T661] vx4001: left allmulticast mode [ 45.859596][ T661] vx4001: left promiscuous mode [ 45.859890][ T661] br1: port 5(vx4001) entered disabled state [ 46.124887][ T665] vx20: left allmulticast mode [ 46.125141][ T665] vx20: left promiscuous mode [ 46.125427][ T665] br1: port 2(vx20) entered disabled state [ 46.369942][ T669] vx10: left allmulticast mode [ 46.370170][ T669] vx10: left promiscuous mode [ 46.370449][ T669] br1: port 1(vx10) entered disabled state