[ 316.421464][ T2125] netem: version 1.3 [ 391.057932][ C1] [ 391.058108][ C1] ====================================================== [ 391.058399][ C1] WARNING: possible circular locking dependency detected [ 391.058695][ C1] 6.9.0-rc2-virtme #1 Not tainted [ 391.058915][ C1] ------------------------------------------------------ [ 391.059195][ C1] swapper/1/0 is trying to acquire lock: [ 391.059417][ C1] ffff888003e03918 (&hashinfo->ehash_locks[i]){+.-.}-{2:2}, at: tw_timer_handler+0xe9/0x130 [ 391.059905][ C1] [ 391.059905][ C1] but task is already holding lock: [ 391.060225][ C1] ffffc900001d8d68 ((&tw->tw_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 391.060647][ C1] [ 391.060647][ C1] which lock already depends on the new lock. [ 391.060647][ C1] [ 391.061082][ C1] [ 391.061082][ C1] the existing dependency chain (in reverse order) is: [ 391.061460][ C1] [ 391.061460][ C1] -> #1 ((&tw->tw_timer)){+.-.}-{0:0}: [ 391.061779][ C1] __lock_acquire+0xaf0/0x1570 [ 391.062021][ C1] lock_acquire.part.0+0xeb/0x330 [ 391.062242][ C1] __timer_delete_sync+0xe1/0x110 [ 391.062478][ C1] inet_twsk_deschedule_put+0xec/0x150 [ 391.062741][ C1] inet_twsk_purge+0x4c8/0x660 [ 391.062985][ C1] tcp_twsk_purge+0x112/0x160 [ 391.063199][ C1] tcp_sk_exit_batch+0x17/0x120 [ 391.063428][ C1] cleanup_net+0x4f3/0xa20 [ 391.063659][ C1] process_one_work+0xe2c/0x1730 [ 391.063889][ C1] worker_thread+0x587/0xd30 [ 391.064100][ C1] kthread+0x28a/0x350 [ 391.064322][ C1] ret_from_fork+0x31/0x70 [ 391.064542][ C1] ret_from_fork_asm+0x1a/0x30 [ 391.064766][ C1] [ 391.064766][ C1] -> #0 (&hashinfo->ehash_locks[i]){+.-.}-{2:2}: [ 391.065115][ C1] check_prev_add+0x182/0xce0 [ 391.065341][ C1] validate_chain+0x71d/0x9b0 [ 391.065580][ C1] __lock_acquire+0xaf0/0x1570 [ 391.065813][ C1] lock_acquire.part.0+0xeb/0x330 [ 391.066038][ C1] _raw_spin_lock+0x30/0x40 [ 391.066263][ C1] tw_timer_handler+0xe9/0x130 [ 391.066494][ C1] call_timer_fn+0x13b/0x230 [ 391.066709][ C1] __run_timers+0x545/0x810 [ 391.066925][ C1] run_timer_softirq+0x7a/0x1b0 [ 391.067143][ C1] __do_softirq+0x1f8/0x5df [ 391.067366][ C1] irq_exit_rcu+0x97/0xc0 [ 391.067582][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 391.067846][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 391.068110][ C1] default_idle+0xf/0x20 [ 391.068337][ C1] default_idle_call+0x6d/0xb0 [ 391.068553][ C1] cpuidle_idle_call+0x1f4/0x280 [ 391.068782][ C1] do_idle+0xf9/0x160 [ 391.069011][ C1] cpu_startup_entry+0x54/0x60 [ 391.069233][ C1] start_secondary+0x21c/0x2b0 [ 391.069464][ C1] common_startup_64+0x12c/0x138 [ 391.069693][ C1] [ 391.069693][ C1] other info that might help us debug this: [ 391.069693][ C1] [ 391.070103][ C1] Possible unsafe locking scenario: [ 391.070103][ C1] [ 391.070434][ C1] CPU0 CPU1 [ 391.070645][ C1] ---- ---- [ 391.070862][ C1] lock((&tw->tw_timer)); [ 391.071086][ C1] lock(&hashinfo->ehash_locks[i]); [ 391.071413][ C1] lock((&tw->tw_timer)); [ 391.071674][ C1] lock(&hashinfo->ehash_locks[i]); [ 391.071924][ C1] [ 391.071924][ C1] *** DEADLOCK *** [ 391.071924][ C1] [ 391.072248][ C1] 1 lock held by swapper/1/0: [ 391.072468][ C1] #0: ffffc900001d8d68 ((&tw->tw_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 391.072862][ C1] [ 391.072862][ C1] stack backtrace: [ 391.073131][ C1] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 6.9.0-rc2-virtme #1 [ 391.073455][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 391.073908][ C1] Call Trace: [ 391.074078][ C1] [ 391.074195][ C1] dump_stack_lvl+0x82/0xd0 [ 391.074419][ C1] check_noncircular+0x2f9/0x3e0 [ 391.074633][ C1] ? get_stack_info+0x35/0xc0 [ 391.074862][ C1] ? __pfx_check_noncircular+0x10/0x10 [ 391.075082][ C1] ? common_startup_64+0x12c/0x138 [ 391.075305][ C1] ? alloc_chain_hlocks+0x4e0/0x720 [ 391.075531][ C1] check_prev_add+0x182/0xce0 [ 391.075748][ C1] validate_chain+0x71d/0x9b0 [ 391.075971][ C1] ? __pfx_validate_chain+0x10/0x10 [ 391.076192][ C1] ? hlock_class+0x4e/0x130 [ 391.076412][ C1] ? mark_lock+0x38/0x3e0 [ 391.076576][ C1] __lock_acquire+0xaf0/0x1570 [ 391.076803][ C1] ? __pfx_tw_timer_handler+0x10/0x10 [ 391.077021][ C1] lock_acquire.part.0+0xeb/0x330 [ 391.077235][ C1] ? tw_timer_handler+0xe9/0x130 [ 391.077452][ C1] ? __pfx_tw_timer_handler+0x10/0x10 [ 391.077663][ C1] ? lock_acquire.part.0+0xeb/0x330 [ 391.077884][ C1] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 391.078106][ C1] ? trace_lock_acquire+0x135/0x1c0 [ 391.078321][ C1] ? tw_timer_handler+0xe9/0x130 [ 391.078531][ C1] ? lock_acquire+0x32/0xc0 [ 391.078759][ C1] ? tw_timer_handler+0xe9/0x130 [ 391.078976][ C1] _raw_spin_lock+0x30/0x40 [ 391.079196][ C1] ? tw_timer_handler+0xe9/0x130 [ 391.079418][ C1] tw_timer_handler+0xe9/0x130 [ 391.079686][ C1] call_timer_fn+0x13b/0x230 [ 391.080061][ C1] ? call_timer_fn+0xe8/0x230 [ 391.080281][ C1] ? call_timer_fn+0xe8/0x230 [ 391.080507][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 391.080743][ C1] ? mark_lock+0x38/0x3e0 [ 391.080931][ C1] __run_timers+0x545/0x810 [ 391.081163][ C1] ? __pfx_tw_timer_handler+0x10/0x10 [ 391.081399][ C1] ? __pfx___run_timers+0x10/0x10 [ 391.081770][ C1] ? do_raw_spin_lock+0x131/0x270 [ 391.082011][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 391.082238][ C1] ? lock_acquire+0x32/0xc0 [ 391.082462][ C1] ? run_timer_softirq+0x72/0x1b0 [ 391.082808][ C1] run_timer_softirq+0x7a/0x1b0 [ 391.083014][ C1] __do_softirq+0x1f8/0x5df [ 391.083216][ C1] irq_exit_rcu+0x97/0xc0 [ 391.083364][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 391.083701][ C1] [ 391.083816][ C1] [ 391.083917][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 391.084160][ C1] RIP: 0010:default_idle+0xf/0x20 [ 391.084389][ C1] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 13 63 2b 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 391.085298][ C1] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000242 [ 391.085569][ C1] RAX: 00000000008136d3 RBX: 1ffff92000029fc1 RCX: ffffffffa2dab865 [ 391.086142][ C1] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffffa06aa3b4 [ 391.086473][ C1] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1005ed709c [ 391.086842][ C1] R10: ffff88802f6b84e3 R11: ffff88802f6ad9b0 R12: 0000000000000000 [ 391.087139][ C1] R13: ffff888001b82300 R14: dffffc0000000000 R15: 0000000000000000 [ 391.087459][ C1] ? ct_kernel_exit.constprop.0+0xc5/0xf0 [ 391.087675][ C1] ? cpuidle_idle_call+0x1f4/0x280 [ 391.087885][ C1] default_idle_call+0x6d/0xb0 [ 391.088094][ C1] cpuidle_idle_call+0x1f4/0x280 [ 391.088294][ C1] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 391.088494][ C1] ? tsc_verify_tsc_adjust+0x5e/0x2b0 [ 391.088824][ C1] do_idle+0xf9/0x160 [ 391.088979][ C1] cpu_startup_entry+0x54/0x60 [ 391.089318][ C1] start_secondary+0x21c/0x2b0 [ 391.089515][ C1] ? __pfx_start_secondary+0x10/0x10 [ 391.089735][ C1] common_startup_64+0x12c/0x138 [ 391.090076][ C1]