[ 11.052298][ T274] ip (274) used greatest stack depth: 24008 bytes left [ 11.225919][ T280] veth0: renamed from veth-hv-1 [ 12.055781][ T295] br0: port 1(vxlan0) entered blocking state [ 12.057131][ T295] br0: port 1(vxlan0) entered disabled state [ 12.057438][ T295] vxlan0: entered allmulticast mode [ 12.058782][ T295] vxlan0: entered promiscuous mode [ 12.134887][ T296] br0: port 1(vxlan0) entered blocking state [ 12.135326][ T296] br0: port 1(vxlan0) entered forwarding state [ 12.304040][ T298] veth0: renamed from veth-hv-2 [ 12.953321][ T306] br0: port 1(vxlan0) entered blocking state [ 12.953708][ T306] br0: port 1(vxlan0) entered disabled state [ 12.953990][ T306] vxlan0: entered allmulticast mode [ 12.955222][ T306] vxlan0: entered promiscuous mode [ 13.029394][ T307] br0: port 1(vxlan0) entered blocking state [ 13.029657][ T307] br0: port 1(vxlan0) entered forwarding state [ 13.478317][ T313] br0: port 2(veth-tap) entered blocking state [ 13.478619][ T313] br0: port 2(veth-tap) entered disabled state [ 13.478905][ T313] veth-tap: entered allmulticast mode [ 13.481909][ T313] veth-tap: entered promiscuous mode [ 13.912029][ T39] br0: port 2(veth-tap) entered blocking state [ 13.912543][ T39] br0: port 2(veth-tap) entered forwarding state [ 14.207697][ T324] br0: port 2(veth-tap) entered blocking state [ 14.207956][ T324] br0: port 2(veth-tap) entered disabled state [ 14.208207][ T324] veth-tap: entered allmulticast mode [ 14.209835][ T324] veth-tap: entered promiscuous mode [ 14.631097][ T139] br0: port 2(veth-tap) entered blocking state [ 14.631366][ T139] br0: port 2(veth-tap) entered forwarding state [ 15.112997][ T334] br0: port 1(vxlan0) entered disabled state [ 15.189913][ T335] br0: port 1(vxlan0) entered blocking state [ 15.190280][ T335] br0: port 1(vxlan0) entered forwarding state [ 15.382060][ T337] br0: port 1(vxlan0) entered disabled state [ 15.466474][ T338] br0: port 1(vxlan0) entered blocking state [ 15.466830][ T338] br0: port 1(vxlan0) entered forwarding state [ 16.189556][ T11] veth-tap: left allmulticast mode [ 16.189845][ T11] veth-tap: left promiscuous mode [ 16.190165][ T11] br0: port 2(veth-tap) entered disabled state [ 16.192698][ T11] vxlan0: left allmulticast mode [ 16.192876][ T11] vxlan0: left promiscuous mode [ 16.193160][ T11] br0: port 1(vxlan0) entered disabled state [ 16.510681][ T11] [ 16.510798][ T11] ============================================ [ 16.510982][ T11] WARNING: possible recursive locking detected [ 16.511164][ T11] 6.13.0-rc5-virtme #1 Not tainted [ 16.511312][ T11] -------------------------------------------- [ 16.511490][ T11] kworker/u16:0/11 is trying to acquire lock: [ 16.511667][ T11] ffffffff9f3f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 16.511979][ T11] [ 16.511979][ T11] but task is already holding lock: [ 16.512191][ T11] ffffffff9f3f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 16.512485][ T11] [ 16.512485][ T11] other info that might help us debug this: [ 16.512694][ T11] Possible unsafe locking scenario: [ 16.512694][ T11] [ 16.512911][ T11] CPU0 [ 16.513022][ T11] ---- [ 16.513131][ T11] lock((netdev_chain).rwsem); [ 16.513278][ T11] lock((netdev_chain).rwsem); [ 16.513423][ T11] [ 16.513423][ T11] *** DEADLOCK *** [ 16.513423][ T11] [ 16.513634][ T11] May be due to missing lock nesting notation [ 16.513634][ T11] [ 16.513852][ T11] 5 locks held by kworker/u16:0/11: [ 16.513998][ T11] #0: ffff8880010b5948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 16.514304][ T11] #1: ffffc900000b7da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 16.514566][ T11] #2: ffffffff9f3ec4d0 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xba0 [ 16.514828][ T11] #3: ffffffff9f407e88 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x81/0x2e0 [ 16.515122][ T11] #4: ffffffff9f3f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 16.515420][ T11] [ 16.515420][ T11] stack backtrace: [ 16.515601][ T11] CPU: 1 UID: 0 PID: 11 Comm: kworker/u16:0 Not tainted 6.13.0-rc5-virtme #1 [ 16.515854][ T11] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 16.516035][ T11] Workqueue: netns cleanup_net [ 16.516184][ T11] Call Trace: [ 16.516296][ T11] [ 16.516372][ T11] dump_stack_lvl+0x82/0xd0 [ 16.516526][ T11] print_deadlock_bug+0x40a/0x650 [ 16.516673][ T11] validate_chain+0x5bf/0xae0 [ 16.516820][ T11] ? __pfx_validate_chain+0x10/0x10 [ 16.516966][ T11] ? hlock_class+0x4e/0x130 [ 16.517109][ T11] ? mark_lock+0x38/0x3e0 [ 16.517218][ T11] __lock_acquire+0xb9a/0x1680 [ 16.517364][ T11] lock_acquire.part.0+0xeb/0x330 [ 16.517506][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 16.517690][ T11] ? __lock_acquire+0xb9a/0x1680 [ 16.517842][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 16.517984][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 16.518134][ T11] ? lock_acquire+0x32/0xc0 [ 16.518277][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 16.518457][ T11] down_read+0x9f/0x340 [ 16.518570][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 16.518757][ T11] ? __pfx_down_read+0x10/0x10 [ 16.518902][ T11] ? __lock_release+0x103/0x460 [ 16.519047][ T11] blocking_notifier_call_chain+0x50/0x90 [ 16.519193][ T11] __netdev_upper_dev_unlink+0xd9/0x220 [ 16.519338][ T11] ? mark_held_locks+0x9e/0xe0 [ 16.519485][ T11] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 16.519666][ T11] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 16.519848][ T11] ? __try_to_del_timer_sync+0xe7/0x140 [ 16.519997][ T11] ? __pfx___try_to_del_timer_sync+0x10/0x10 [ 16.520175][ T11] ? mark_held_locks+0x9e/0xe0 [ 16.520319][ T11] netdev_upper_dev_unlink+0x71/0xa0 [ 16.520465][ T11] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 16.520644][ T11] ? mutex_is_locked+0x1c/0x60 [ 16.520789][ T11] ? rtnl_is_locked+0x15/0x20 [ 16.520938][ T11] ? netdev_master_upper_dev_get+0x13/0x120 [ 16.521119][ T11] vrf_device_event+0x78/0xe0 [ 16.521265][ T11] notifier_call_chain+0xcd/0x150 [ 16.521412][ T11] blocking_notifier_call_chain+0x66/0x90 [ 16.521557][ T11] unregister_netdevice_many_notify+0xa83/0x1580 [ 16.521738][ T11] ? unregister_netdevice_queue+0x70/0x410 [ 16.521918][ T11] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 16.522100][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 16.522280][ T11] ? rtnl_is_locked+0x15/0x20 [ 16.522425][ T11] ? unregister_netdevice_queue+0x70/0x410 [ 16.522604][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 16.522783][ T11] ? vrf_dellink+0x100/0x150 [ 16.522928][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 16.523115][ T11] default_device_exit_batch+0x241/0x2e0 [ 16.523259][ T11] ? __pfx_default_device_exit_batch+0x10/0x10 [ 16.523441][ T11] ? ops_exit_list+0xb4/0x170 [ 16.523593][ T11] cleanup_net+0x4ef/0xba0 [ 16.523736][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 16.523882][ T11] ? __pfx_cleanup_net+0x10/0x10 [ 16.524028][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 16.524177][ T11] ? lock_acquire+0x32/0xc0 [ 16.524323][ T11] ? process_one_work+0xe0b/0x16d0 [ 16.524468][ T11] process_one_work+0xe55/0x16d0 [ 16.524615][ T11] ? __pfx___lock_release+0x10/0x10 [ 16.524761][ T11] ? __pfx_process_one_work+0x10/0x10 [ 16.524908][ T11] ? assign_work+0x16c/0x240 [ 16.525056][ T11] worker_thread+0x58c/0xce0 [ 16.525203][ T11] ? __pfx_worker_thread+0x10/0x10 [ 16.525353][ T11] kthread+0x28a/0x350 [ 16.525467][ T11] ? __pfx_kthread+0x10/0x10 [ 16.525611][ T11] ret_from_fork+0x31/0x70 [ 16.525762][ T11] ? __pfx_kthread+0x10/0x10 [ 16.525905][ T11] ret_from_fork_asm+0x1a/0x30 [ 16.526057][ T11] [ 16.546610][ T11] br0: port 1(vxlan0) entered disabled state [ 16.569996][ T11] vxlan0 (unregistering): left allmulticast mode [ 16.570204][ T11] vxlan0 (unregistering): left promiscuous mode [ 16.570416][ T11] br0: port 1(vxlan0) entered disabled state [ 16.622117][ T11] veth-tap: left allmulticast mode [ 16.622384][ T11] veth-tap: left promiscuous mode [ 16.622637][ T11] br0: port 2(veth-tap) entered disabled state