[ 15.742901][ T327] br1: port 1(vx10) entered blocking state [ 15.743313][ T327] br1: port 1(vx10) entered disabled state [ 15.744120][ T327] vx10: entered allmulticast mode [ 15.746047][ T327] vx10: entered promiscuous mode [ 15.746953][ T327] br1: port 1(vx10) entered blocking state [ 15.747287][ T327] br1: port 1(vx10) entered forwarding state [ 16.091578][ T332] br1: port 2(vx20) entered blocking state [ 16.091913][ T332] br1: port 2(vx20) entered disabled state [ 16.092230][ T332] vx20: entered allmulticast mode [ 16.095274][ T332] vx20: entered promiscuous mode [ 16.096128][ T332] br1: port 2(vx20) entered blocking state [ 16.096427][ T332] br1: port 2(vx20) entered forwarding state [ 16.265177][ T334] br1: port 3(veth1) entered blocking state [ 16.265523][ T334] br1: port 3(veth1) entered disabled state [ 16.265823][ T334] veth1: entered allmulticast mode [ 16.267783][ T334] veth1: entered promiscuous mode [ 16.362447][ T37] br1: port 3(veth1) entered blocking state [ 16.362867][ T37] br1: port 3(veth1) entered forwarding state [ 16.436811][ T336] br1: port 4(veth2) entered blocking state [ 16.437201][ T336] br1: port 4(veth2) entered disabled state [ 16.437825][ T336] veth2: entered allmulticast mode [ 16.449090][ T336] veth2: entered promiscuous mode [ 16.543942][ T37] br1: port 4(veth2) entered blocking state [ 16.544232][ T37] br1: port 4(veth2) entered forwarding state [ 16.788185][ T341] br1: port 5(vx4001) entered blocking state [ 16.788523][ T341] br1: port 5(vx4001) entered disabled state [ 16.788812][ T341] vx4001: entered allmulticast mode [ 16.790799][ T341] vx4001: entered promiscuous mode [ 16.791462][ T341] br1: port 5(vx4001) entered blocking state [ 16.791763][ T341] br1: port 5(vx4001) entered forwarding state [ 17.527438][ T350] 8021q: 802.1Q VLAN Support v1.8 [ 17.558841][ T349] ip (349) used greatest stack depth: 23840 bytes left [ 17.787006][ T353] br1: entered promiscuous mode [ 17.790146][ T353] br1: left promiscuous mode [ 17.805094][ T353] br1: entered promiscuous mode [ 23.773818][ T431] br1: port 1(vx10) entered blocking state [ 23.774206][ T431] br1: port 1(vx10) entered disabled state [ 23.774518][ T431] vx10: entered allmulticast mode [ 23.776498][ T431] vx10: entered promiscuous mode [ 23.777407][ T431] br1: port 1(vx10) entered blocking state [ 23.777675][ T431] br1: port 1(vx10) entered forwarding state [ 24.151840][ T435] br1: port 2(vx20) entered blocking state [ 24.152197][ T435] br1: port 2(vx20) entered disabled state [ 24.152510][ T435] vx20: entered allmulticast mode [ 24.154952][ T435] vx20: entered promiscuous mode [ 24.162298][ T435] br1: port 2(vx20) entered blocking state [ 24.162649][ T435] br1: port 2(vx20) entered forwarding state [ 24.515663][ T439] br1: port 3(vx4001) entered blocking state [ 24.516059][ T439] br1: port 3(vx4001) entered disabled state [ 24.517052][ T439] vx4001: entered allmulticast mode [ 24.519278][ T439] vx4001: entered promiscuous mode [ 24.519890][ T439] br1: port 3(vx4001) entered blocking state [ 24.520234][ T439] br1: port 3(vx4001) entered forwarding state [ 24.725655][ T441] br1: port 4(w1) entered blocking state [ 24.725907][ T441] br1: port 4(w1) entered disabled state [ 24.726157][ T441] w1: entered allmulticast mode [ 24.728164][ T441] w1: entered promiscuous mode [ 24.807596][ T39] br1: port 4(w1) entered blocking state [ 24.807859][ T39] br1: port 4(w1) entered forwarding state [ 25.014661][ T444] br1: port 5(w3) entered blocking state [ 25.014905][ T444] br1: port 5(w3) entered disabled state [ 25.015143][ T444] w3: entered allmulticast mode [ 25.017073][ T444] w3: entered promiscuous mode [ 25.103895][ T39] br1: port 5(w3) entered blocking state [ 25.104154][ T39] br1: port 5(w3) entered forwarding state [ 25.929123][ T454] br1: entered promiscuous mode [ 25.938760][ T454] br1: left promiscuous mode [ 25.957155][ T454] br1: entered promiscuous mode [ 26.815356][ C2] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 26.899019][ C2] IPv6: vlan20-v: IPv6 duplicate address 2001:db8:2::3 used by 00:00:5e:00:01:01 detected! [ 27.023568][ C2] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 27.025059][ C2] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 27.408065][ C2] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 27.409177][ C2] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 27.534951][ C2] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 27.615159][ C1] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 27.741080][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 27.741926][ C3] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 44.885775][ T65] w3: left allmulticast mode [ 44.886274][ T65] w3: left promiscuous mode [ 44.886859][ T65] br1: port 5(w3) entered disabled state [ 44.901640][ T65] w1: left allmulticast mode [ 44.901975][ T65] w1: left promiscuous mode [ 44.902454][ T65] br1: port 4(w1) entered disabled state [ 44.906108][ T65] vx4001: left allmulticast mode [ 44.906473][ T65] vx4001: left promiscuous mode [ 44.906897][ T65] br1: port 3(vx4001) entered disabled state [ 44.908689][ T65] vx20: left allmulticast mode [ 44.908905][ T65] vx20: left promiscuous mode [ 44.909226][ T65] br1: port 2(vx20) entered disabled state [ 44.911111][ T65] vx10: left allmulticast mode [ 44.911400][ T65] vx10: left promiscuous mode [ 44.911719][ T65] br1: port 1(vx10) entered disabled state [ 44.937246][ T65] [ 44.937357][ T65] ============================================ [ 44.937538][ T65] WARNING: possible recursive locking detected [ 44.937722][ T65] 6.13.0-rc5-virtme #1 Not tainted [ 44.937873][ T65] -------------------------------------------- [ 44.938061][ T65] kworker/u16:1/65 is trying to acquire lock: [ 44.938247][ T65] ffffffff905d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 44.938556][ T65] [ 44.938556][ T65] but task is already holding lock: [ 44.938773][ T65] ffffffff905d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 44.939071][ T65] [ 44.939071][ T65] other info that might help us debug this: [ 44.939287][ T65] Possible unsafe locking scenario: [ 44.939287][ T65] [ 44.939500][ T65] CPU0 [ 44.939601][ T65] ---- [ 44.939707][ T65] lock((netdev_chain).rwsem); [ 44.939845][ T65] lock((netdev_chain).rwsem); [ 44.940008][ T65] [ 44.940008][ T65] *** DEADLOCK *** [ 44.940008][ T65] [ 44.940231][ T65] May be due to missing lock nesting notation [ 44.940231][ T65] [ 44.940452][ T65] 5 locks held by kworker/u16:1/65: [ 44.940604][ T65] #0: ffff8880010ad948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 44.940909][ T65] #1: ffffc90000467da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 44.941164][ T65] #2: ffffffff905cc090 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xa50 [ 44.941422][ T65] #3: ffffffff905e7a48 (rtnl_mutex){+.+.}-{4:4}, at: cleanup_net+0x45e/0xa50 [ 44.941673][ T65] #4: ffffffff905d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 44.941953][ T65] [ 44.941953][ T65] stack backtrace: [ 44.942131][ T65] CPU: 0 UID: 0 PID: 65 Comm: kworker/u16:1 Not tainted 6.13.0-rc5-virtme #1 [ 44.942375][ T65] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 44.942555][ T65] Workqueue: netns cleanup_net [ 44.942700][ T65] Call Trace: [ 44.942821][ T65] [ 44.942891][ T65] dump_stack_lvl+0x82/0xd0 [ 44.943053][ T65] print_deadlock_bug+0x40a/0x650 [ 44.943215][ T65] validate_chain+0x5bf/0xae0 [ 44.943369][ T65] ? __pfx_validate_chain+0x10/0x10 [ 44.943522][ T65] ? hlock_class+0x4e/0x130 [ 44.943673][ T65] ? mark_lock+0x38/0x3e0 [ 44.943781][ T65] __lock_acquire+0xb9a/0x1680 [ 44.943935][ T65] ? spin_bug+0x1b1/0x1d0 [ 44.944045][ T65] ? debug_object_assert_init+0x2a9/0x370 [ 44.944196][ T65] lock_acquire.part.0+0xeb/0x330 [ 44.944344][ T65] ? blocking_notifier_call_chain+0x50/0x90 [ 44.944521][ T65] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 44.944666][ T65] ? trace_lock_acquire+0x14c/0x1f0 [ 44.944808][ T65] ? lock_acquire+0x32/0xc0 [ 44.944950][ T65] ? blocking_notifier_call_chain+0x50/0x90 [ 44.945130][ T65] down_read+0x9f/0x340 [ 44.945241][ T65] ? blocking_notifier_call_chain+0x50/0x90 [ 44.945421][ T65] ? __pfx_down_read+0x10/0x10 [ 44.945573][ T65] blocking_notifier_call_chain+0x50/0x90 [ 44.945712][ T65] __dev_close_many+0xdf/0x2d0 [ 44.945853][ T65] ? __pfx___dev_close_many+0x10/0x10 [ 44.945999][ T65] dev_close_many+0x202/0x650 [ 44.946151][ T65] ? __lock_release+0x103/0x460 [ 44.946307][ T65] ? __pfx_dev_close_many+0x10/0x10 [ 44.946472][ T65] ? __pfx___lock_release+0x10/0x10 [ 44.946612][ T65] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 44.946772][ T65] vlan_device_event+0x143b/0x2130 [8021q] [ 44.946954][ T65] ? net_generic+0xbb/0x1f0 [vxlan] [ 44.947107][ T65] ? __pfx_vlan_device_event+0x10/0x10 [8021q] [ 44.947300][ T65] ? __pfx_vxlan_netdevice_event+0x10/0x10 [vxlan] [ 44.947487][ T65] ? packet_notifier+0x3b0/0x810 [ 44.947655][ T65] notifier_call_chain+0xcd/0x150 [ 44.947805][ T65] blocking_notifier_call_chain+0x66/0x90 [ 44.947960][ T65] dev_close_many+0x2d8/0x650 [ 44.948105][ T65] ? __lock_release+0x103/0x460 [ 44.948244][ T65] ? __virt_addr_valid+0x22b/0x430 [ 44.948393][ T65] ? __pfx_dev_close_many+0x10/0x10 [ 44.948615][ T65] unregister_netdevice_many_notify+0x8e5/0x1580 [ 44.948870][ T65] ? mark_held_locks+0x9e/0xe0 [ 44.949014][ T65] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 44.949193][ T65] ? mutex_is_locked+0x1c/0x60 [ 44.949336][ T65] ? rtnl_is_locked+0x15/0x20 [ 44.949485][ T65] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 44.949664][ T65] ? mutex_is_locked+0x1c/0x60 [ 44.949814][ T65] ? nexthop_net_exit_batch_rtnl+0x83/0x210 [ 44.949987][ T65] cleanup_net+0x4cf/0xa50 [ 44.950207][ T65] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 44.950348][ T65] ? __pfx_cleanup_net+0x10/0x10 [ 44.950490][ T65] ? trace_lock_acquire+0x14c/0x1f0 [ 44.950630][ T65] ? lock_acquire+0x32/0xc0 [ 44.950772][ T65] ? process_one_work+0xe0b/0x16d0 [ 44.951002][ T65] process_one_work+0xe55/0x16d0 [ 44.951146][ T65] ? __pfx___lock_release+0x10/0x10 [ 44.951286][ T65] ? __pfx_process_one_work+0x10/0x10 [ 44.951429][ T65] ? assign_work+0x16c/0x240 [ 44.951650][ T65] worker_thread+0x58c/0xce0 [ 44.951787][ T65] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 44.951978][ T65] ? __pfx_worker_thread+0x10/0x10 [ 44.952115][ T65] ? __pfx_worker_thread+0x10/0x10 [ 44.952337][ T65] kthread+0x28a/0x350 [ 44.952443][ T65] ? __pfx_kthread+0x10/0x10 [ 44.952581][ T65] ret_from_fork+0x31/0x70 [ 44.952720][ T65] ? __pfx_kthread+0x10/0x10 [ 44.952937][ T65] ret_from_fork_asm+0x1a/0x30 [ 44.953083][ T65] [ 46.706725][ T652] br1: left promiscuous mode [ 47.167194][ T658] br1: port 4(veth2) entered disabled state [ 47.220479][ T659] veth2: left allmulticast mode [ 47.220709][ T659] veth2: left promiscuous mode [ 47.220998][ T659] br1: port 4(veth2) entered disabled state [ 47.349564][ T661] br1: port 3(veth1) entered disabled state [ 47.410507][ T662] veth1: left allmulticast mode [ 47.410714][ T662] veth1: left promiscuous mode [ 47.410982][ T662] br1: port 3(veth1) entered disabled state [ 47.529392][ T664] vx4001: left allmulticast mode [ 47.529626][ T664] vx4001: left promiscuous mode [ 47.529924][ T664] br1: port 5(vx4001) entered disabled state [ 47.800207][ T668] vx20: left allmulticast mode [ 47.800469][ T668] vx20: left promiscuous mode [ 47.800761][ T668] br1: port 2(vx20) entered disabled state [ 48.068689][ T672] vx10: left allmulticast mode [ 48.068922][ T672] vx10: left promiscuous mode [ 48.069200][ T672] br1: port 1(vx10) entered disabled state