[ 10.220854][ T249] ip (249) used greatest stack depth: 24400 bytes left [ 14.777936][ T326] br1: port 1(vx10) entered blocking state [ 14.778366][ T326] br1: port 1(vx10) entered disabled state [ 14.778760][ T326] vx10: entered allmulticast mode [ 14.780682][ T326] vx10: entered promiscuous mode [ 14.781920][ T326] br1: port 1(vx10) entered blocking state [ 14.782254][ T326] br1: port 1(vx10) entered forwarding state [ 15.107869][ T331] br1: port 2(vx20) entered blocking state [ 15.108292][ T331] br1: port 2(vx20) entered disabled state [ 15.108626][ T331] vx20: entered allmulticast mode [ 15.110942][ T331] vx20: entered promiscuous mode [ 15.111860][ T331] br1: port 2(vx20) entered blocking state [ 15.112158][ T331] br1: port 2(vx20) entered forwarding state [ 15.281421][ T333] br1: port 3(veth1) entered blocking state [ 15.282104][ T333] br1: port 3(veth1) entered disabled state [ 15.282412][ T333] veth1: entered allmulticast mode [ 15.284396][ T333] veth1: entered promiscuous mode [ 15.389639][ T45] br1: port 3(veth1) entered blocking state [ 15.390152][ T45] br1: port 3(veth1) entered forwarding state [ 15.556154][ T336] br1: port 4(veth2) entered blocking state [ 15.556506][ T336] br1: port 4(veth2) entered disabled state [ 15.556907][ T336] veth2: entered allmulticast mode [ 15.558914][ T336] veth2: entered promiscuous mode [ 15.641389][ T39] br1: port 4(veth2) entered blocking state [ 15.641741][ T39] br1: port 4(veth2) entered forwarding state [ 15.973254][ T342] br1: port 5(vx4001) entered blocking state [ 15.973585][ T342] br1: port 5(vx4001) entered disabled state [ 15.973886][ T342] vx4001: entered allmulticast mode [ 15.975950][ T342] vx4001: entered promiscuous mode [ 15.976504][ T342] br1: port 5(vx4001) entered blocking state [ 15.976811][ T342] br1: port 5(vx4001) entered forwarding state [ 16.705955][ T351] 8021q: 802.1Q VLAN Support v1.8 [ 16.746948][ T350] ip (350) used greatest stack depth: 24208 bytes left [ 16.997115][ T354] br1: entered promiscuous mode [ 17.000625][ T354] br1: left promiscuous mode [ 17.011117][ T354] br1: entered promiscuous mode [ 22.832046][ T436] br1: port 1(vx10) entered blocking state [ 22.832417][ T436] br1: port 1(vx10) entered disabled state [ 22.832721][ T436] vx10: entered allmulticast mode [ 22.834663][ T436] vx10: entered promiscuous mode [ 22.835532][ T436] br1: port 1(vx10) entered blocking state [ 22.835789][ T436] br1: port 1(vx10) entered forwarding state [ 23.174174][ T440] br1: port 2(vx20) entered blocking state [ 23.175434][ T440] br1: port 2(vx20) entered disabled state [ 23.175747][ T440] vx20: entered allmulticast mode [ 23.177723][ T440] vx20: entered promiscuous mode [ 23.178270][ T440] br1: port 2(vx20) entered blocking state [ 23.178527][ T440] br1: port 2(vx20) entered forwarding state [ 23.491378][ T444] br1: port 3(vx4001) entered blocking state [ 23.492813][ T444] br1: port 3(vx4001) entered disabled state [ 23.501260][ T444] vx4001: entered allmulticast mode [ 23.503337][ T444] vx4001: entered promiscuous mode [ 23.503946][ T444] br1: port 3(vx4001) entered blocking state [ 23.504251][ T444] br1: port 3(vx4001) entered forwarding state [ 23.706633][ T446] br1: port 4(w1) entered blocking state [ 23.706893][ T446] br1: port 4(w1) entered disabled state [ 23.707148][ T446] w1: entered allmulticast mode [ 23.709426][ T446] w1: entered promiscuous mode [ 23.836683][ T251] br1: port 4(w1) entered blocking state [ 23.837011][ T251] br1: port 4(w1) entered forwarding state [ 24.016786][ T449] br1: port 5(w3) entered blocking state [ 24.017332][ T449] br1: port 5(w3) entered disabled state [ 24.017655][ T449] w3: entered allmulticast mode [ 24.020653][ T449] w3: entered promiscuous mode [ 24.104298][ T45] br1: port 5(w3) entered blocking state [ 24.104579][ T45] br1: port 5(w3) entered forwarding state [ 24.884926][ T459] br1: entered promiscuous mode [ 24.887386][ T459] br1: left promiscuous mode [ 24.902018][ T459] br1: entered promiscuous mode [ 25.653417][ C1] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 25.655591][ C1] IPv6: vlan20-v: IPv6 duplicate address fe80::200:5eff:fe00:101 used by 00:00:5e:00:01:01 detected! [ 25.932971][ C1] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 25.933994][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 26.062128][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 26.063078][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 26.132945][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 30.669668][ C2] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 30.690955][ T570] ip (570) used greatest stack depth: 23768 bytes left [ 39.373617][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 43.037969][ T11] w3: left allmulticast mode [ 43.038308][ T11] w3: left promiscuous mode [ 43.038777][ T11] br1: port 5(w3) entered disabled state [ 43.041664][ T11] w1: left allmulticast mode [ 43.041872][ T11] w1: left promiscuous mode [ 43.042210][ T11] br1: port 4(w1) entered disabled state [ 43.044233][ T11] vx4001: left allmulticast mode [ 43.044683][ T11] vx4001: left promiscuous mode [ 43.045248][ T11] br1: port 3(vx4001) entered disabled state [ 43.047138][ T11] vx20: left allmulticast mode [ 43.047448][ T11] vx20: left promiscuous mode [ 43.047802][ T11] br1: port 2(vx20) entered disabled state [ 43.050562][ T11] vx10: left allmulticast mode [ 43.050775][ T11] vx10: left promiscuous mode [ 43.051093][ T11] br1: port 1(vx10) entered disabled state [ 43.076004][ T11] [ 43.076205][ T11] ============================================ [ 43.076396][ T11] WARNING: possible recursive locking detected [ 43.076579][ T11] 6.13.0-rc5-virtme #1 Not tainted [ 43.076735][ T11] -------------------------------------------- [ 43.076928][ T11] kworker/u16:0/11 is trying to acquire lock: [ 43.077112][ T11] ffffffffae1d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 43.077401][ T11] [ 43.077401][ T11] but task is already holding lock: [ 43.077603][ T11] ffffffffae1d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 43.077888][ T11] [ 43.077888][ T11] other info that might help us debug this: [ 43.078094][ T11] Possible unsafe locking scenario: [ 43.078094][ T11] [ 43.078295][ T11] CPU0 [ 43.078400][ T11] ---- [ 43.078506][ T11] lock((netdev_chain).rwsem); [ 43.078662][ T11] lock((netdev_chain).rwsem); [ 43.078804][ T11] [ 43.078804][ T11] *** DEADLOCK *** [ 43.078804][ T11] [ 43.079011][ T11] May be due to missing lock nesting notation [ 43.079011][ T11] [ 43.079218][ T11] 5 locks held by kworker/u16:0/11: [ 43.079361][ T11] #0: ffff8880010ad948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 43.079647][ T11] #1: ffffc900000b7da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 43.079902][ T11] #2: ffffffffae1cc090 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xa50 [ 43.080150][ T11] #3: ffffffffae1e7a48 (rtnl_mutex){+.+.}-{4:4}, at: cleanup_net+0x45e/0xa50 [ 43.080397][ T11] #4: ffffffffae1d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 43.080680][ T11] [ 43.080680][ T11] stack backtrace: [ 43.080862][ T11] CPU: 1 UID: 0 PID: 11 Comm: kworker/u16:0 Not tainted 6.13.0-rc5-virtme #1 [ 43.081105][ T11] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 43.081283][ T11] Workqueue: netns cleanup_net [ 43.081436][ T11] Call Trace: [ 43.081546][ T11] [ 43.081623][ T11] dump_stack_lvl+0x82/0xd0 [ 43.081773][ T11] print_deadlock_bug+0x40a/0x650 [ 43.081917][ T11] validate_chain+0x5bf/0xae0 [ 43.082062][ T11] ? __pfx_validate_chain+0x10/0x10 [ 43.082205][ T11] ? hlock_class+0x4e/0x130 [ 43.082348][ T11] ? mark_lock+0x38/0x3e0 [ 43.082456][ T11] __lock_acquire+0xb9a/0x1680 [ 43.082597][ T11] ? spin_bug+0x1b1/0x1d0 [ 43.082706][ T11] ? debug_object_assert_init+0x2a9/0x370 [ 43.082871][ T11] lock_acquire.part.0+0xeb/0x330 [ 43.083021][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 43.083213][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 43.083352][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 43.083495][ T11] ? lock_acquire+0x32/0xc0 [ 43.083635][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 43.083818][ T11] down_read+0x9f/0x340 [ 43.083927][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 43.084109][ T11] ? __pfx_down_read+0x10/0x10 [ 43.084252][ T11] blocking_notifier_call_chain+0x50/0x90 [ 43.084404][ T11] __dev_close_many+0xdf/0x2d0 [ 43.084564][ T11] ? __pfx___dev_close_many+0x10/0x10 [ 43.084720][ T11] dev_close_many+0x202/0x650 [ 43.084873][ T11] ? __lock_release+0x103/0x460 [ 43.085023][ T11] ? __pfx_dev_close_many+0x10/0x10 [ 43.085185][ T11] ? __pfx___lock_release+0x10/0x10 [ 43.085341][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 43.085518][ T11] vlan_device_event+0x143b/0x2130 [8021q] [ 43.085708][ T11] ? net_generic+0xbb/0x1f0 [vxlan] [ 43.085870][ T11] ? __pfx_vlan_device_event+0x10/0x10 [8021q] [ 43.086047][ T11] ? __pfx_vxlan_netdevice_event+0x10/0x10 [vxlan] [ 43.086253][ T11] ? packet_notifier+0x3b0/0x810 [ 43.086407][ T11] notifier_call_chain+0xcd/0x150 [ 43.086550][ T11] blocking_notifier_call_chain+0x66/0x90 [ 43.086697][ T11] dev_close_many+0x2d8/0x650 [ 43.086847][ T11] ? __lock_release+0x103/0x460 [ 43.086994][ T11] ? __virt_addr_valid+0x22b/0x430 [ 43.087139][ T11] ? __pfx_dev_close_many+0x10/0x10 [ 43.087281][ T11] unregister_netdevice_many_notify+0x8e5/0x1580 [ 43.087462][ T11] ? mark_held_locks+0x9e/0xe0 [ 43.087616][ T11] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 43.087804][ T11] ? mutex_is_locked+0x1c/0x60 [ 43.087961][ T11] ? rtnl_is_locked+0x15/0x20 [ 43.088105][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 43.088305][ T11] ? mutex_is_locked+0x1c/0x60 [ 43.088454][ T11] ? nexthop_net_exit_batch_rtnl+0x83/0x210 [ 43.088645][ T11] cleanup_net+0x4cf/0xa50 [ 43.088798][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 43.088951][ T11] ? __pfx_cleanup_net+0x10/0x10 [ 43.089121][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 43.089272][ T11] ? lock_acquire+0x32/0xc0 [ 43.089422][ T11] ? process_one_work+0xe0b/0x16d0 [ 43.089577][ T11] process_one_work+0xe55/0x16d0 [ 43.089732][ T11] ? __pfx___lock_release+0x10/0x10 [ 43.089882][ T11] ? __pfx_process_one_work+0x10/0x10 [ 43.090033][ T11] ? assign_work+0x16c/0x240 [ 43.090197][ T11] worker_thread+0x58c/0xce0 [ 43.090354][ T11] ? __pfx_worker_thread+0x10/0x10 [ 43.090501][ T11] kthread+0x28a/0x350 [ 43.090619][ T11] ? __pfx_kthread+0x10/0x10 [ 43.090769][ T11] ret_from_fork+0x31/0x70 [ 43.090921][ T11] ? __pfx_kthread+0x10/0x10 [ 43.091069][ T11] ret_from_fork_asm+0x1a/0x30 [ 43.091231][ T11] [ 45.002466][ T648] br1: left promiscuous mode [ 45.485524][ T654] br1: port 4(veth2) entered disabled state [ 45.543299][ T655] veth2: left allmulticast mode [ 45.544481][ T655] veth2: left promiscuous mode [ 45.544967][ T655] br1: port 4(veth2) entered disabled state [ 45.668958][ T657] br1: port 3(veth1) entered disabled state [ 45.732686][ T658] veth1: left allmulticast mode [ 45.732916][ T658] veth1: left promiscuous mode [ 45.733218][ T658] br1: port 3(veth1) entered disabled state [ 45.850679][ T660] vx4001: left allmulticast mode [ 45.850896][ T660] vx4001: left promiscuous mode [ 45.851167][ T660] br1: port 5(vx4001) entered disabled state [ 46.123412][ T664] vx20: left allmulticast mode [ 46.123645][ T664] vx20: left promiscuous mode [ 46.123914][ T664] br1: port 2(vx20) entered disabled state [ 46.409183][ T668] vx10: left allmulticast mode [ 46.409421][ T668] vx10: left promiscuous mode [ 46.409734][ T668] br1: port 1(vx10) entered disabled state