[ 196.230127][ T1615] br1: port 1(vx10) entered blocking state [ 196.230431][ T1615] br1: port 1(vx10) entered disabled state [ 196.230709][ T1615] vx10: entered allmulticast mode [ 196.240073][ T1615] vx10: entered promiscuous mode [ 196.241945][ T1615] br1: port 1(vx10) entered blocking state [ 196.242308][ T1615] br1: port 1(vx10) entered forwarding state [ 196.596811][ T1620] br1: port 2(vx20) entered blocking state [ 196.597089][ T1620] br1: port 2(vx20) entered disabled state [ 196.597371][ T1620] vx20: entered allmulticast mode [ 196.599282][ T1620] vx20: entered promiscuous mode [ 196.599822][ T1620] br1: port 2(vx20) entered blocking state [ 196.600076][ T1620] br1: port 2(vx20) entered forwarding state [ 196.758816][ T1622] br1: port 3(veth1) entered blocking state [ 196.759093][ T1622] br1: port 3(veth1) entered disabled state [ 196.759360][ T1622] veth1: entered allmulticast mode [ 196.761619][ T1622] veth1: entered promiscuous mode [ 196.839410][ T57] br1: port 3(veth1) entered blocking state [ 196.839755][ T57] br1: port 3(veth1) entered forwarding state [ 196.999679][ T1625] br1: port 4(veth2) entered blocking state [ 197.000026][ T1625] br1: port 4(veth2) entered disabled state [ 197.000303][ T1625] veth2: entered allmulticast mode [ 197.002293][ T1625] veth2: entered promiscuous mode [ 197.080144][ T45] br1: port 4(veth2) entered blocking state [ 197.080458][ T45] br1: port 4(veth2) entered forwarding state [ 197.395615][ T1630] br1: port 5(vx4001) entered blocking state [ 197.396138][ T1630] br1: port 5(vx4001) entered disabled state [ 197.396405][ T1630] vx4001: entered allmulticast mode [ 197.398339][ T1630] vx4001: entered promiscuous mode [ 197.398845][ T1630] br1: port 5(vx4001) entered blocking state [ 197.399086][ T1630] br1: port 5(vx4001) entered forwarding state [ 198.129379][ T1640] 8021q: 802.1Q VLAN Support v1.8 [ 198.416844][ T1643] br1: entered promiscuous mode [ 198.420473][ T1643] br1: left promiscuous mode [ 198.429585][ T1643] br1: entered promiscuous mode [ 204.370418][ T1731] br1: port 1(vx10) entered blocking state [ 204.371036][ T1731] br1: port 1(vx10) entered disabled state [ 204.371305][ T1731] vx10: entered allmulticast mode [ 204.373271][ T1731] vx10: entered promiscuous mode [ 204.374103][ T1731] br1: port 1(vx10) entered blocking state [ 204.374348][ T1731] br1: port 1(vx10) entered forwarding state [ 204.739960][ T1735] br1: port 2(vx20) entered blocking state [ 204.740243][ T1735] br1: port 2(vx20) entered disabled state [ 204.740520][ T1735] vx20: entered allmulticast mode [ 204.742979][ T1735] vx20: entered promiscuous mode [ 204.743488][ T1735] br1: port 2(vx20) entered blocking state [ 204.743744][ T1735] br1: port 2(vx20) entered forwarding state [ 205.156782][ T1739] br1: port 3(vx4001) entered blocking state [ 205.157168][ T1739] br1: port 3(vx4001) entered disabled state [ 205.157493][ T1739] vx4001: entered allmulticast mode [ 205.160708][ T1739] vx4001: entered promiscuous mode [ 205.161237][ T1739] br1: port 3(vx4001) entered blocking state [ 205.161525][ T1739] br1: port 3(vx4001) entered forwarding state [ 205.323211][ T1741] br1: port 4(w1) entered blocking state [ 205.323443][ T1741] br1: port 4(w1) entered disabled state [ 205.323709][ T1741] w1: entered allmulticast mode [ 205.333253][ T1741] w1: entered promiscuous mode [ 205.405592][ T45] br1: port 4(w1) entered blocking state [ 205.405916][ T45] br1: port 4(w1) entered forwarding state [ 205.570569][ T1744] br1: port 5(w3) entered blocking state [ 205.570894][ T1744] br1: port 5(w3) entered disabled state [ 205.571165][ T1744] w3: entered allmulticast mode [ 205.573172][ T1744] w3: entered promiscuous mode [ 205.677521][ T151] br1: port 5(w3) entered blocking state [ 205.677897][ T151] br1: port 5(w3) entered forwarding state [ 206.489533][ T1754] br1: entered promiscuous mode [ 206.492868][ T1754] br1: left promiscuous mode [ 206.503431][ T1754] br1: entered promiscuous mode [ 207.505319][ C0] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 207.633429][ C2] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 207.634379][ C2] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 207.953271][ C0] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 207.954142][ C0] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 208.010871][ C2] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 208.373402][ C0] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 212.433329][ C2] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 212.433745][ C1] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 221.138221][ C0] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 221.649143][ C2] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 224.686976][ T11] w3: left allmulticast mode [ 224.687288][ T11] w3: left promiscuous mode [ 224.688400][ T11] br1: port 5(w3) entered disabled state [ 224.690583][ T11] w1: left allmulticast mode [ 224.690791][ T11] w1: left promiscuous mode [ 224.691091][ T11] br1: port 4(w1) entered disabled state [ 224.693084][ T11] vx4001: left allmulticast mode [ 224.693268][ T11] vx4001: left promiscuous mode [ 224.693576][ T11] br1: port 3(vx4001) entered disabled state [ 224.695422][ T11] vx20: left allmulticast mode [ 224.695605][ T11] vx20: left promiscuous mode [ 224.697176][ T11] br1: port 2(vx20) entered disabled state [ 224.698915][ T11] vx10: left allmulticast mode [ 224.699100][ T11] vx10: left promiscuous mode [ 224.699396][ T11] br1: port 1(vx10) entered disabled state [ 224.725961][ T11] [ 224.726074][ T11] ============================================ [ 224.726252][ T11] WARNING: possible recursive locking detected [ 224.726426][ T11] 6.13.0-rc5-virtme #1 Not tainted [ 224.726571][ T11] -------------------------------------------- [ 224.726747][ T11] kworker/u16:0/11 is trying to acquire lock: [ 224.726924][ T11] ffffffffbcbd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 224.727219][ T11] [ 224.727219][ T11] but task is already holding lock: [ 224.727431][ T11] ffffffffbcbd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 224.727711][ T11] [ 224.727711][ T11] other info that might help us debug this: [ 224.727917][ T11] Possible unsafe locking scenario: [ 224.727917][ T11] [ 224.728126][ T11] CPU0 [ 224.728232][ T11] ---- [ 224.728340][ T11] lock((netdev_chain).rwsem); [ 224.728488][ T11] lock((netdev_chain).rwsem); [ 224.728627][ T11] [ 224.728627][ T11] *** DEADLOCK *** [ 224.728627][ T11] [ 224.728836][ T11] May be due to missing lock nesting notation [ 224.728836][ T11] [ 224.729044][ T11] 5 locks held by kworker/u16:0/11: [ 224.729183][ T11] #0: ffff8880010ad948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 224.729472][ T11] #1: ffffc900000b7da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 224.729722][ T11] #2: ffffffffbcbcc090 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xa50 [ 224.729973][ T11] #3: ffffffffbcbe7a48 (rtnl_mutex){+.+.}-{4:4}, at: cleanup_net+0x45e/0xa50 [ 224.730242][ T11] #4: ffffffffbcbd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 224.730528][ T11] [ 224.730528][ T11] stack backtrace: [ 224.730699][ T11] CPU: 0 UID: 0 PID: 11 Comm: kworker/u16:0 Not tainted 6.13.0-rc5-virtme #1 [ 224.730941][ T11] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 224.731121][ T11] Workqueue: netns cleanup_net [ 224.731273][ T11] Call Trace: [ 224.731386][ T11] [ 224.731462][ T11] dump_stack_lvl+0x82/0xd0 [ 224.731611][ T11] print_deadlock_bug+0x40a/0x650 [ 224.731759][ T11] validate_chain+0x5bf/0xae0 [ 224.731905][ T11] ? __pfx_validate_chain+0x10/0x10 [ 224.732051][ T11] ? hlock_class+0x4e/0x130 [ 224.732192][ T11] ? mark_lock+0x38/0x3e0 [ 224.732308][ T11] __lock_acquire+0xb9a/0x1680 [ 224.732453][ T11] ? spin_bug+0x1b1/0x1d0 [ 224.732561][ T11] ? debug_object_assert_init+0x2a9/0x370 [ 224.732705][ T11] lock_acquire.part.0+0xeb/0x330 [ 224.732848][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 224.733018][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 224.733162][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 224.733305][ T11] ? lock_acquire+0x32/0xc0 [ 224.733445][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 224.733620][ T11] down_read+0x9f/0x340 [ 224.733727][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 224.733902][ T11] ? __pfx_down_read+0x10/0x10 [ 224.734045][ T11] blocking_notifier_call_chain+0x50/0x90 [ 224.734185][ T11] __dev_close_many+0xdf/0x2d0 [ 224.734330][ T11] ? __pfx___dev_close_many+0x10/0x10 [ 224.734475][ T11] dev_close_many+0x202/0x650 [ 224.734617][ T11] ? __lock_release+0x103/0x460 [ 224.734756][ T11] ? __pfx_dev_close_many+0x10/0x10 [ 224.734901][ T11] ? __pfx___lock_release+0x10/0x10 [ 224.735042][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 224.735184][ T11] vlan_device_event+0x143b/0x2130 [8021q] [ 224.735367][ T11] ? net_generic+0xbb/0x1f0 [vxlan] [ 224.735524][ T11] ? __pfx_vlan_device_event+0x10/0x10 [8021q] [ 224.735700][ T11] ? __pfx_vxlan_netdevice_event+0x10/0x10 [vxlan] [ 224.735884][ T11] ? packet_notifier+0x3b0/0x810 [ 224.736028][ T11] notifier_call_chain+0xcd/0x150 [ 224.736168][ T11] blocking_notifier_call_chain+0x66/0x90 [ 224.736311][ T11] dev_close_many+0x2d8/0x650 [ 224.736449][ T11] ? __lock_release+0x103/0x460 [ 224.736603][ T11] ? __virt_addr_valid+0x22b/0x430 [ 224.736746][ T11] ? __pfx_dev_close_many+0x10/0x10 [ 224.736893][ T11] unregister_netdevice_many_notify+0x8e5/0x1580 [ 224.737071][ T11] ? mark_held_locks+0x9e/0xe0 [ 224.737212][ T11] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 224.737394][ T11] ? mutex_is_locked+0x1c/0x60 [ 224.737532][ T11] ? rtnl_is_locked+0x15/0x20 [ 224.737673][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 224.737846][ T11] ? mutex_is_locked+0x1c/0x60 [ 224.737988][ T11] ? nexthop_net_exit_batch_rtnl+0x83/0x210 [ 224.738171][ T11] cleanup_net+0x4cf/0xa50 [ 224.738310][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 224.738461][ T11] ? __pfx_cleanup_net+0x10/0x10 [ 224.738604][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 224.738748][ T11] ? lock_acquire+0x32/0xc0 [ 224.738887][ T11] ? process_one_work+0xe0b/0x16d0 [ 224.739029][ T11] process_one_work+0xe55/0x16d0 [ 224.739172][ T11] ? __pfx___lock_release+0x10/0x10 [ 224.739316][ T11] ? __pfx_process_one_work+0x10/0x10 [ 224.739464][ T11] ? assign_work+0x16c/0x240 [ 224.739611][ T11] worker_thread+0x58c/0xce0 [ 224.739755][ T11] ? __pfx_worker_thread+0x10/0x10 [ 224.739950][ T11] kthread+0x28a/0x350 [ 224.740070][ T11] ? __pfx_kthread+0x10/0x10 [ 224.740245][ T11] ret_from_fork+0x31/0x70 [ 224.740405][ T11] ? __pfx_kthread+0x10/0x10 [ 224.740551][ T11] ret_from_fork_asm+0x1a/0x30 [ 224.740718][ T11] [ 226.581169][ T1943] br1: left promiscuous mode [ 227.057495][ T1949] br1: port 4(veth2) entered disabled state [ 227.113600][ T1950] veth2: left allmulticast mode [ 227.113835][ T1950] veth2: left promiscuous mode [ 227.114110][ T1950] br1: port 4(veth2) entered disabled state [ 227.238590][ T1952] br1: port 3(veth1) entered disabled state [ 227.296214][ T1953] veth1: left allmulticast mode [ 227.296419][ T1953] veth1: left promiscuous mode [ 227.297179][ T1953] br1: port 3(veth1) entered disabled state [ 227.421479][ T1955] vx4001: left allmulticast mode [ 227.421718][ T1955] vx4001: left promiscuous mode [ 227.422019][ T1955] br1: port 5(vx4001) entered disabled state [ 227.692542][ T1959] vx20: left allmulticast mode [ 227.692762][ T1959] vx20: left promiscuous mode [ 227.693029][ T1959] br1: port 2(vx20) entered disabled state [ 227.981670][ T1963] vx10: left allmulticast mode [ 227.981901][ T1963] vx10: left promiscuous mode [ 227.982199][ T1963] br1: port 1(vx10) entered disabled state