[ 11.233578][ T261] ip (261) used greatest stack depth: 23504 bytes left [ 15.516414][ T327] br1: port 1(vx10) entered blocking state [ 15.516896][ T327] br1: port 1(vx10) entered disabled state [ 15.517308][ T327] vx10: entered allmulticast mode [ 15.519334][ T327] vx10: entered promiscuous mode [ 15.529342][ T327] br1: port 1(vx10) entered blocking state [ 15.529800][ T327] br1: port 1(vx10) entered forwarding state [ 15.867801][ T332] br1: port 2(vx20) entered blocking state [ 15.868087][ T332] br1: port 2(vx20) entered disabled state [ 15.868390][ T332] vx20: entered allmulticast mode [ 15.885069][ T332] vx20: entered promiscuous mode [ 15.885982][ T332] br1: port 2(vx20) entered blocking state [ 15.886232][ T332] br1: port 2(vx20) entered forwarding state [ 16.029149][ T334] br1: port 3(veth1) entered blocking state [ 16.029511][ T334] br1: port 3(veth1) entered disabled state [ 16.029791][ T334] veth1: entered allmulticast mode [ 16.031759][ T334] veth1: entered promiscuous mode [ 16.122284][ T39] br1: port 3(veth1) entered blocking state [ 16.122769][ T39] br1: port 3(veth1) entered forwarding state [ 16.276320][ T337] br1: port 4(veth2) entered blocking state [ 16.276664][ T337] br1: port 4(veth2) entered disabled state [ 16.276983][ T337] veth2: entered allmulticast mode [ 16.279122][ T337] veth2: entered promiscuous mode [ 16.351941][ T39] br1: port 4(veth2) entered blocking state [ 16.352291][ T39] br1: port 4(veth2) entered forwarding state [ 17.109974][ T347] 8021q: 802.1Q VLAN Support v1.8 [ 17.432554][ T351] br1: entered promiscuous mode [ 17.435795][ T351] br1: left promiscuous mode [ 17.447147][ T351] br1: entered promiscuous mode [ 23.027975][ T429] br1: port 1(vx10) entered blocking state [ 23.028439][ T429] br1: port 1(vx10) entered disabled state [ 23.028894][ T429] vx10: entered allmulticast mode [ 23.032058][ T429] vx10: entered promiscuous mode [ 23.033890][ T429] br1: port 1(vx10) entered blocking state [ 23.034325][ T429] br1: port 1(vx10) entered forwarding state [ 23.407397][ T433] br1: port 2(vx20) entered blocking state [ 23.407697][ T433] br1: port 2(vx20) entered disabled state [ 23.407989][ T433] vx20: entered allmulticast mode [ 23.409940][ T433] vx20: entered promiscuous mode [ 23.410890][ T433] br1: port 2(vx20) entered blocking state [ 23.411136][ T433] br1: port 2(vx20) entered forwarding state [ 23.602948][ T435] br1: port 3(w1) entered blocking state [ 23.603352][ T435] br1: port 3(w1) entered disabled state [ 23.603722][ T435] w1: entered allmulticast mode [ 23.607536][ T435] w1: entered promiscuous mode [ 23.692336][ T39] br1: port 3(w1) entered blocking state [ 23.692573][ T39] br1: port 3(w1) entered forwarding state [ 23.855647][ T438] br1: port 4(w3) entered blocking state [ 23.855942][ T438] br1: port 4(w3) entered disabled state [ 23.856199][ T438] w3: entered allmulticast mode [ 23.858187][ T438] w3: entered promiscuous mode [ 23.928425][ T56] br1: port 4(w3) entered blocking state [ 23.928674][ T56] br1: port 4(w3) entered forwarding state [ 24.814227][ T448] br1: entered promiscuous mode [ 24.816554][ T448] br1: left promiscuous mode [ 24.835947][ T448] br1: entered promiscuous mode [ 25.472186][ C2] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 25.698590][ C2] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 26.305323][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 26.306296][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 26.307584][ C3] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 26.308391][ C3] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 26.481348][ C1] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 27.201145][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 30.336401][ C3] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 30.656457][ C3] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 38.336697][ C0] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 39.360923][ C3] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 50.072764][ T672] GACT probability NOT on [ 54.208146][ C2] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 55.164927][ T11] w3: left allmulticast mode [ 55.165286][ T11] w3: left promiscuous mode [ 55.165699][ T11] br1: port 4(w3) entered disabled state [ 55.168339][ T11] w1: left allmulticast mode [ 55.168556][ T11] w1: left promiscuous mode [ 55.168870][ T11] br1: port 3(w1) entered disabled state [ 55.170681][ T11] vx20: left allmulticast mode [ 55.170913][ T11] vx20: left promiscuous mode [ 55.171241][ T11] br1: port 2(vx20) entered disabled state [ 55.174005][ T11] vx10: left allmulticast mode [ 55.174232][ T11] vx10: left promiscuous mode [ 55.175772][ T11] br1: port 1(vx10) entered disabled state [ 55.197874][ T11] [ 55.198028][ T11] ============================================ [ 55.198322][ T11] WARNING: possible recursive locking detected [ 55.198614][ T11] 6.13.0-rc5-virtme #1 Not tainted [ 55.198854][ T11] -------------------------------------------- [ 55.199150][ T11] kworker/u16:0/11 is trying to acquire lock: [ 55.199443][ T11] ffffffff87dd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 55.199934][ T11] [ 55.199934][ T11] but task is already holding lock: [ 55.200276][ T11] ffffffff87dd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 55.200772][ T11] [ 55.200772][ T11] other info that might help us debug this: [ 55.201118][ T11] Possible unsafe locking scenario: [ 55.201118][ T11] [ 55.201466][ T11] CPU0 [ 55.201641][ T11] ---- [ 55.201822][ T11] lock((netdev_chain).rwsem); [ 55.202051][ T11] lock((netdev_chain).rwsem); [ 55.202275][ T11] [ 55.202275][ T11] *** DEADLOCK *** [ 55.202275][ T11] [ 55.202594][ T11] May be due to missing lock nesting notation [ 55.202594][ T11] [ 55.202924][ T11] 5 locks held by kworker/u16:0/11: [ 55.203150][ T11] #0: ffff8880010ad948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 55.203605][ T11] #1: ffffc900000b7da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 55.204006][ T11] #2: ffffffff87dcc090 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xa50 [ 55.204412][ T11] #3: ffffffff87de7a48 (rtnl_mutex){+.+.}-{4:4}, at: cleanup_net+0x45e/0xa50 [ 55.204805][ T11] #4: ffffffff87dd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 55.205255][ T11] [ 55.205255][ T11] stack backtrace: [ 55.205536][ T11] CPU: 1 UID: 0 PID: 11 Comm: kworker/u16:0 Not tainted 6.13.0-rc5-virtme #1 [ 55.205930][ T11] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 55.206208][ T11] Workqueue: netns cleanup_net [ 55.206450][ T11] Call Trace: [ 55.206620][ T11] [ 55.206745][ T11] dump_stack_lvl+0x82/0xd0 [ 55.206981][ T11] print_deadlock_bug+0x40a/0x650 [ 55.207211][ T11] validate_chain+0x5bf/0xae0 [ 55.207437][ T11] ? __pfx_validate_chain+0x10/0x10 [ 55.207674][ T11] ? hlock_class+0x4e/0x130 [ 55.207903][ T11] ? mark_lock+0x38/0x3e0 [ 55.208081][ T11] __lock_acquire+0xb9a/0x1680 [ 55.208307][ T11] ? spin_bug+0x1b1/0x1d0 [ 55.208482][ T11] ? debug_object_assert_init+0x2a9/0x370 [ 55.208712][ T11] lock_acquire.part.0+0xeb/0x330 [ 55.208950][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 55.209245][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 55.209496][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 55.209734][ T11] ? lock_acquire+0x32/0xc0 [ 55.209959][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 55.210236][ T11] down_read+0x9f/0x340 [ 55.210406][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 55.210698][ T11] ? __pfx_down_read+0x10/0x10 [ 55.210928][ T11] blocking_notifier_call_chain+0x50/0x90 [ 55.211162][ T11] __dev_close_many+0xdf/0x2d0 [ 55.211383][ T11] ? __pfx___dev_close_many+0x10/0x10 [ 55.211614][ T11] dev_close_many+0x202/0x650 [ 55.211841][ T11] ? __lock_release+0x103/0x460 [ 55.212063][ T11] ? __pfx_dev_close_many+0x10/0x10 [ 55.212285][ T11] ? __pfx___lock_release+0x10/0x10 [ 55.212514][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 55.212762][ T11] vlan_device_event+0x143b/0x2130 [8021q] [ 55.213050][ T11] ? net_generic+0xbb/0x1f0 [vxlan] [ 55.213296][ T11] ? __pfx_vlan_device_event+0x10/0x10 [8021q] [ 55.213582][ T11] ? __pfx_vxlan_netdevice_event+0x10/0x10 [vxlan] [ 55.213885][ T11] ? packet_notifier+0x3b0/0x810 [ 55.214116][ T11] notifier_call_chain+0xcd/0x150 [ 55.214348][ T11] blocking_notifier_call_chain+0x66/0x90 [ 55.214582][ T11] dev_close_many+0x2d8/0x650 [ 55.214814][ T11] ? __lock_release+0x103/0x460 [ 55.215038][ T11] ? __virt_addr_valid+0x22b/0x430 [ 55.215263][ T11] ? __pfx_dev_close_many+0x10/0x10 [ 55.215492][ T11] unregister_netdevice_many_notify+0x8e5/0x1580 [ 55.215777][ T11] ? mark_held_locks+0x9e/0xe0 [ 55.216015][ T11] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 55.216292][ T11] ? mutex_is_locked+0x1c/0x60 [ 55.216524][ T11] ? rtnl_is_locked+0x15/0x20 [ 55.216751][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 55.217035][ T11] ? mutex_is_locked+0x1c/0x60 [ 55.217257][ T11] ? nexthop_net_exit_batch_rtnl+0x83/0x210 [ 55.217537][ T11] cleanup_net+0x4cf/0xa50 [ 55.217774][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 55.217998][ T11] ? __pfx_cleanup_net+0x10/0x10 [ 55.218220][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 55.218443][ T11] ? lock_acquire+0x32/0xc0 [ 55.218668][ T11] ? process_one_work+0xe0b/0x16d0 [ 55.218897][ T11] process_one_work+0xe55/0x16d0 [ 55.219128][ T11] ? __pfx___lock_release+0x10/0x10 [ 55.219359][ T11] ? __pfx_process_one_work+0x10/0x10 [ 55.219589][ T11] ? assign_work+0x16c/0x240 [ 55.219824][ T11] worker_thread+0x58c/0xce0 [ 55.220054][ T11] ? __pfx_worker_thread+0x10/0x10 [ 55.220278][ T11] kthread+0x28a/0x350 [ 55.220446][ T11] ? __pfx_kthread+0x10/0x10 [ 55.220686][ T11] ret_from_fork+0x31/0x70 [ 55.220930][ T11] ? __pfx_kthread+0x10/0x10 [ 55.221163][ T11] ret_from_fork_asm+0x1a/0x30 [ 55.221397][ T11] [ 56.683077][ T803] br1: left promiscuous mode [ 57.118369][ T809] br1: port 4(veth2) entered disabled state [ 57.181446][ T810] veth2: left allmulticast mode [ 57.181643][ T810] veth2: left promiscuous mode [ 57.181904][ T810] br1: port 4(veth2) entered disabled state [ 57.290575][ T812] br1: port 3(veth1) entered disabled state [ 57.344174][ T813] veth1: left allmulticast mode [ 57.344940][ T813] veth1: left promiscuous mode [ 57.345312][ T813] br1: port 3(veth1) entered disabled state [ 57.456074][ T815] vx20: left allmulticast mode [ 57.456286][ T815] vx20: left promiscuous mode [ 57.456545][ T815] br1: port 2(vx20) entered disabled state [ 57.726789][ T819] vx10: left allmulticast mode [ 57.726986][ T819] vx10: left promiscuous mode [ 57.727240][ T819] br1: port 1(vx10) entered disabled state