[ 11.131382][ T250] ip (250) used greatest stack depth: 23920 bytes left [ 15.950977][ T328] br1: port 1(vx10) entered blocking state [ 15.951515][ T328] br1: port 1(vx10) entered disabled state [ 15.951943][ T328] vx10: entered allmulticast mode [ 15.953950][ T328] vx10: entered promiscuous mode [ 15.955467][ T328] br1: port 1(vx10) entered blocking state [ 15.956046][ T328] br1: port 1(vx10) entered forwarding state [ 16.156679][ T330] ip (330) used greatest stack depth: 23648 bytes left [ 16.302388][ T333] br1: port 2(vx20) entered blocking state [ 16.302667][ T333] br1: port 2(vx20) entered disabled state [ 16.302939][ T333] vx20: entered allmulticast mode [ 16.305865][ T333] vx20: entered promiscuous mode [ 16.306709][ T333] br1: port 2(vx20) entered blocking state [ 16.306956][ T333] br1: port 2(vx20) entered forwarding state [ 16.474831][ T335] br1: port 3(veth1) entered blocking state [ 16.475202][ T335] br1: port 3(veth1) entered disabled state [ 16.475475][ T335] veth1: entered allmulticast mode [ 16.477415][ T335] veth1: entered promiscuous mode [ 16.548978][ T39] br1: port 3(veth1) entered blocking state [ 16.549423][ T39] br1: port 3(veth1) entered forwarding state [ 16.696049][ T338] br1: port 4(veth2) entered blocking state [ 16.696386][ T338] br1: port 4(veth2) entered disabled state [ 16.696678][ T338] veth2: entered allmulticast mode [ 16.698608][ T338] veth2: entered promiscuous mode [ 16.772090][ T68] br1: port 4(veth2) entered blocking state [ 16.772640][ T68] br1: port 4(veth2) entered forwarding state [ 17.512650][ T348] 8021q: 802.1Q VLAN Support v1.8 [ 17.829894][ T351] br1: entered promiscuous mode [ 17.832801][ T351] br1: left promiscuous mode [ 17.838988][ T351] br1: entered promiscuous mode [ 23.261497][ T429] br1: port 1(vx10) entered blocking state [ 23.261801][ T429] br1: port 1(vx10) entered disabled state [ 23.262114][ T429] vx10: entered allmulticast mode [ 23.264828][ T429] vx10: entered promiscuous mode [ 23.265960][ T429] br1: port 1(vx10) entered blocking state [ 23.266293][ T429] br1: port 1(vx10) entered forwarding state [ 23.664332][ T433] br1: port 2(vx20) entered blocking state [ 23.664743][ T433] br1: port 2(vx20) entered disabled state [ 23.665055][ T433] vx20: entered allmulticast mode [ 23.668229][ T433] vx20: entered promiscuous mode [ 23.668821][ T433] br1: port 2(vx20) entered blocking state [ 23.669140][ T433] br1: port 2(vx20) entered forwarding state [ 23.832816][ T435] br1: port 3(w1) entered blocking state [ 23.833129][ T435] br1: port 3(w1) entered disabled state [ 23.833395][ T435] w1: entered allmulticast mode [ 23.835362][ T435] w1: entered promiscuous mode [ 23.914246][ T45] br1: port 3(w1) entered blocking state [ 23.914580][ T45] br1: port 3(w1) entered forwarding state [ 24.071652][ T438] br1: port 4(w3) entered blocking state [ 24.071902][ T438] br1: port 4(w3) entered disabled state [ 24.072177][ T438] w3: entered allmulticast mode [ 24.074136][ T438] w3: entered promiscuous mode [ 24.186196][ T39] br1: port 4(w3) entered blocking state [ 24.186481][ T39] br1: port 4(w3) entered forwarding state [ 24.979256][ T448] br1: entered promiscuous mode [ 24.982308][ T448] br1: left promiscuous mode [ 25.005799][ T448] br1: entered promiscuous mode [ 25.814746][ C3] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 25.926619][ C1] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 25.928231][ C1] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 25.928706][ C1] IPv6: vlan20-v: IPv6 duplicate address fe80::200:5eff:fe00:101 used by 00:00:5e:00:01:01 detected! [ 26.247791][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 26.248730][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 26.823792][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 30.214953][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 38.854937][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 50.222899][ T672] GACT probability NOT on [ 55.430191][ T781] ip (781) used greatest stack depth: 23472 bytes left [ 55.503481][ T66] w3: left allmulticast mode [ 55.503786][ T66] w3: left promiscuous mode [ 55.504153][ T66] br1: port 4(w3) entered disabled state [ 55.514278][ T66] w1: left allmulticast mode [ 55.514575][ T66] w1: left promiscuous mode [ 55.514891][ T66] br1: port 3(w1) entered disabled state [ 55.517296][ T66] vx20: left allmulticast mode [ 55.517495][ T66] vx20: left promiscuous mode [ 55.517861][ T66] br1: port 2(vx20) entered disabled state [ 55.519206][ T66] vx10: left allmulticast mode [ 55.519384][ T66] vx10: left promiscuous mode [ 55.519683][ T66] br1: port 1(vx10) entered disabled state [ 55.539896][ T66] [ 55.540108][ T66] ============================================ [ 55.540291][ T66] WARNING: possible recursive locking detected [ 55.540469][ T66] 6.13.0-rc5-virtme #1 Not tainted [ 55.540615][ T66] -------------------------------------------- [ 55.540791][ T66] kworker/u16:1/66 is trying to acquire lock: [ 55.540974][ T66] ffffffff8d7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 55.541277][ T66] [ 55.541277][ T66] but task is already holding lock: [ 55.541487][ T66] ffffffff8d7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 55.541777][ T66] [ 55.541777][ T66] other info that might help us debug this: [ 55.542002][ T66] Possible unsafe locking scenario: [ 55.542002][ T66] [ 55.542218][ T66] CPU0 [ 55.542328][ T66] ---- [ 55.542439][ T66] lock((netdev_chain).rwsem); [ 55.542583][ T66] lock((netdev_chain).rwsem); [ 55.542730][ T66] [ 55.542730][ T66] *** DEADLOCK *** [ 55.542730][ T66] [ 55.542938][ T66] May be due to missing lock nesting notation [ 55.542938][ T66] [ 55.543144][ T66] 5 locks held by kworker/u16:1/66: [ 55.543296][ T66] #0: ffff8880010ad948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 55.543593][ T66] #1: ffffc90000477da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 55.543856][ T66] #2: ffffffff8d7cc090 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xa50 [ 55.544113][ T66] #3: ffffffff8d7e7a48 (rtnl_mutex){+.+.}-{4:4}, at: cleanup_net+0x45e/0xa50 [ 55.544377][ T66] #4: ffffffff8d7d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 55.544666][ T66] [ 55.544666][ T66] stack backtrace: [ 55.544851][ T66] CPU: 3 UID: 0 PID: 66 Comm: kworker/u16:1 Not tainted 6.13.0-rc5-virtme #1 [ 55.545104][ T66] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 55.545285][ T66] Workqueue: netns cleanup_net [ 55.545465][ T66] Call Trace: [ 55.545577][ T66] [ 55.545654][ T66] dump_stack_lvl+0x82/0xd0 [ 55.545808][ T66] print_deadlock_bug+0x40a/0x650 [ 55.545955][ T66] validate_chain+0x5bf/0xae0 [ 55.546103][ T66] ? __pfx_validate_chain+0x10/0x10 [ 55.546253][ T66] ? hlock_class+0x4e/0x130 [ 55.546397][ T66] ? mark_lock+0x38/0x3e0 [ 55.546513][ T66] __lock_acquire+0xb9a/0x1680 [ 55.546657][ T66] ? spin_bug+0x1b1/0x1d0 [ 55.546771][ T66] ? debug_object_assert_init+0x2a9/0x370 [ 55.546920][ T66] lock_acquire.part.0+0xeb/0x330 [ 55.547068][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 55.547250][ T66] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 55.547400][ T66] ? trace_lock_acquire+0x14c/0x1f0 [ 55.547547][ T66] ? lock_acquire+0x32/0xc0 [ 55.547693][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 55.547955][ T66] down_read+0x9f/0x340 [ 55.548067][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 55.548248][ T66] ? __pfx_down_read+0x10/0x10 [ 55.548395][ T66] blocking_notifier_call_chain+0x50/0x90 [ 55.548622][ T66] __dev_close_many+0xdf/0x2d0 [ 55.548771][ T66] ? __pfx___dev_close_many+0x10/0x10 [ 55.548921][ T66] dev_close_many+0x202/0x650 [ 55.549144][ T66] ? __lock_release+0x103/0x460 [ 55.549289][ T66] ? __pfx_dev_close_many+0x10/0x10 [ 55.549430][ T66] ? __pfx___lock_release+0x10/0x10 [ 55.549581][ T66] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 55.549802][ T66] vlan_device_event+0x143b/0x2130 [8021q] [ 55.549990][ T66] ? net_generic+0xbb/0x1f0 [vxlan] [ 55.550148][ T66] ? __pfx_vlan_device_event+0x10/0x10 [8021q] [ 55.550329][ T66] ? __pfx_vxlan_netdevice_event+0x10/0x10 [vxlan] [ 55.550518][ T66] ? packet_notifier+0x3b0/0x810 [ 55.550669][ T66] notifier_call_chain+0xcd/0x150 [ 55.550813][ T66] blocking_notifier_call_chain+0x66/0x90 [ 55.550958][ T66] dev_close_many+0x2d8/0x650 [ 55.551109][ T66] ? __lock_release+0x103/0x460 [ 55.551255][ T66] ? __virt_addr_valid+0x22b/0x430 [ 55.551401][ T66] ? __pfx_dev_close_many+0x10/0x10 [ 55.551622][ T66] unregister_netdevice_many_notify+0x8e5/0x1580 [ 55.551804][ T66] ? mark_held_locks+0x9e/0xe0 [ 55.551953][ T66] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 55.552300][ T66] ? mutex_is_locked+0x1c/0x60 [ 55.552457][ T66] ? rtnl_is_locked+0x15/0x20 [ 55.552603][ T66] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 55.552793][ T66] ? mutex_is_locked+0x1c/0x60 [ 55.552938][ T66] ? nexthop_net_exit_batch_rtnl+0x83/0x210 [ 55.553123][ T66] cleanup_net+0x4cf/0xa50 [ 55.553284][ T66] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 55.553436][ T66] ? __pfx_cleanup_net+0x10/0x10 [ 55.553671][ T66] ? trace_lock_acquire+0x14c/0x1f0 [ 55.553894][ T66] ? lock_acquire+0x32/0xc0 [ 55.554039][ T66] ? process_one_work+0xe0b/0x16d0 [ 55.554189][ T66] process_one_work+0xe55/0x16d0 [ 55.554353][ T66] ? __pfx___lock_release+0x10/0x10 [ 55.554500][ T66] ? __pfx_process_one_work+0x10/0x10 [ 55.554642][ T66] ? assign_work+0x16c/0x240 [ 55.554794][ T66] worker_thread+0x58c/0xce0 [ 55.554942][ T66] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 55.555121][ T66] ? __pfx_worker_thread+0x10/0x10 [ 55.555269][ T66] ? __pfx_worker_thread+0x10/0x10 [ 55.555428][ T66] kthread+0x28a/0x350 [ 55.555539][ T66] ? __pfx_kthread+0x10/0x10 [ 55.555683][ T66] ret_from_fork+0x31/0x70 [ 55.555837][ T66] ? __pfx_kthread+0x10/0x10 [ 55.555983][ T66] ret_from_fork_asm+0x1a/0x30 [ 55.556134][ T66] [ 57.146974][ T804] br1: left promiscuous mode [ 57.655409][ T810] br1: port 4(veth2) entered disabled state [ 57.714555][ T811] veth2: left allmulticast mode [ 57.714782][ T811] veth2: left promiscuous mode [ 57.715062][ T811] br1: port 4(veth2) entered disabled state [ 57.841986][ T813] br1: port 3(veth1) entered disabled state [ 57.905095][ T814] veth1: left allmulticast mode [ 57.905408][ T814] veth1: left promiscuous mode [ 57.905679][ T814] br1: port 3(veth1) entered disabled state [ 58.012182][ T816] vx20: left allmulticast mode [ 58.012424][ T816] vx20: left promiscuous mode [ 58.012713][ T816] br1: port 2(vx20) entered disabled state [ 58.278994][ T820] vx10: left allmulticast mode [ 58.279276][ T820] vx10: left promiscuous mode [ 58.279558][ T820] br1: port 1(vx10) entered disabled state