[ 9.919098][ T255] sctp: Hash tables configured (bind 32/56) [ 11.221193][ T272] ip (272) used greatest stack depth: 23376 bytes left [ 45.308660][ T66] [ 45.308780][ T66] ============================================ [ 45.308955][ T66] WARNING: possible recursive locking detected [ 45.309126][ T66] 6.13.0-rc5-virtme #1 Not tainted [ 45.309264][ T66] -------------------------------------------- [ 45.309432][ T66] kworker/u16:1/66 is trying to acquire lock: [ 45.309602][ T66] ffffffffbcbf6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 45.309887][ T66] [ 45.309887][ T66] but task is already holding lock: [ 45.310090][ T66] ffffffffbcbf6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 45.310366][ T66] [ 45.310366][ T66] other info that might help us debug this: [ 45.310568][ T66] Possible unsafe locking scenario: [ 45.310568][ T66] [ 45.310770][ T66] CPU0 [ 45.310876][ T66] ---- [ 45.310978][ T66] lock((netdev_chain).rwsem); [ 45.311114][ T66] lock((netdev_chain).rwsem); [ 45.311251][ T66] [ 45.311251][ T66] *** DEADLOCK *** [ 45.311251][ T66] [ 45.311453][ T66] May be due to missing lock nesting notation [ 45.311453][ T66] [ 45.311656][ T66] 5 locks held by kworker/u16:1/66: [ 45.311812][ T66] #0: ffff8880010b5948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 45.312123][ T66] #1: ffffc90000477da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 45.312388][ T66] #2: ffffffffbcbec4d0 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xba0 [ 45.312657][ T66] #3: ffffffffbcc07e88 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x81/0x2e0 [ 45.312962][ T66] #4: ffffffffbcbf6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 45.313263][ T66] [ 45.313263][ T66] stack backtrace: [ 45.313444][ T66] CPU: 0 UID: 0 PID: 66 Comm: kworker/u16:1 Not tainted 6.13.0-rc5-virtme #1 [ 45.313683][ T66] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 45.313858][ T66] Workqueue: netns cleanup_net [ 45.314012][ T66] Call Trace: [ 45.314117][ T66] [ 45.314190][ T66] dump_stack_lvl+0x82/0xd0 [ 45.314336][ T66] print_deadlock_bug+0x40a/0x650 [ 45.314479][ T66] validate_chain+0x5bf/0xae0 [ 45.314627][ T66] ? __pfx_validate_chain+0x10/0x10 [ 45.314769][ T66] ? hlock_class+0x4e/0x130 [ 45.314911][ T66] ? mark_lock+0x38/0x3e0 [ 45.315021][ T66] __lock_acquire+0xb9a/0x1680 [ 45.315166][ T66] lock_acquire.part.0+0xeb/0x330 [ 45.315303][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 45.315478][ T66] ? __lock_acquire+0xb9a/0x1680 [ 45.315620][ T66] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 45.315759][ T66] ? trace_lock_acquire+0x14c/0x1f0 [ 45.315898][ T66] ? lock_acquire+0x32/0xc0 [ 45.316040][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 45.316217][ T66] down_read+0x9f/0x340 [ 45.316324][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 45.316497][ T66] ? __pfx_down_read+0x10/0x10 [ 45.316636][ T66] ? __lock_release+0x103/0x460 [ 45.316785][ T66] blocking_notifier_call_chain+0x50/0x90 [ 45.316921][ T66] __netdev_upper_dev_unlink+0xd9/0x220 [ 45.317057][ T66] ? mark_held_locks+0x9e/0xe0 [ 45.317198][ T66] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 45.317370][ T66] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 45.317554][ T66] ? __try_to_del_timer_sync+0xe7/0x140 [ 45.317703][ T66] ? __pfx___try_to_del_timer_sync+0x10/0x10 [ 45.317881][ T66] ? mark_held_locks+0x9e/0xe0 [ 45.318019][ T66] netdev_upper_dev_unlink+0x71/0xa0 [ 45.318180][ T66] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 45.318355][ T66] ? mutex_is_locked+0x1c/0x60 [ 45.318492][ T66] ? rtnl_is_locked+0x15/0x20 [ 45.318633][ T66] ? netdev_master_upper_dev_get+0x13/0x120 [ 45.318804][ T66] vrf_device_event+0x78/0xe0 [ 45.318944][ T66] notifier_call_chain+0xcd/0x150 [ 45.319087][ T66] blocking_notifier_call_chain+0x66/0x90 [ 45.319226][ T66] unregister_netdevice_many_notify+0xa83/0x1580 [ 45.319403][ T66] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 45.319573][ T66] ? default_device_exit_batch+0x81/0x2e0 [ 45.319711][ T66] ? rtnl_is_locked+0x15/0x20 [ 45.319846][ T66] ? unregister_netdevice_queue+0x70/0x410 [ 45.320017][ T66] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 45.320188][ T66] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 45.320377][ T66] default_device_exit_batch+0x241/0x2e0 [ 45.320518][ T66] ? __pfx_default_device_exit_batch+0x10/0x10 [ 45.320688][ T66] ? ops_exit_list+0xb4/0x170 [ 45.320829][ T66] cleanup_net+0x4ef/0xba0 [ 45.320967][ T66] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 45.321117][ T66] ? __pfx_cleanup_net+0x10/0x10 [ 45.321256][ T66] ? trace_lock_acquire+0x14c/0x1f0 [ 45.321396][ T66] ? lock_acquire+0x32/0xc0 [ 45.321535][ T66] ? process_one_work+0xe0b/0x16d0 [ 45.321766][ T66] process_one_work+0xe55/0x16d0 [ 45.321904][ T66] ? __pfx___lock_release+0x10/0x10 [ 45.322043][ T66] ? __pfx_process_one_work+0x10/0x10 [ 45.322181][ T66] ? assign_work+0x16c/0x240 [ 45.322337][ T66] worker_thread+0x58c/0xce0 [ 45.322485][ T66] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 45.322658][ T66] ? __pfx_worker_thread+0x10/0x10 [ 45.322804][ T66] ? __pfx_worker_thread+0x10/0x10 [ 45.322942][ T66] kthread+0x28a/0x350 [ 45.323050][ T66] ? __pfx_kthread+0x10/0x10 [ 45.323274][ T66] ret_from_fork+0x31/0x70 [ 45.323412][ T66] ? __pfx_kthread+0x10/0x10 [ 45.323558][ T66] ret_from_fork_asm+0x1a/0x30 [ 45.323710][ T66]