[ 15.453606][ T226] TCP: tun0: Driver has suspect GRO implementation, TCP performance may be compromised. [ 15.833420][ T226] packetdrill (226) used greatest stack depth: 24240 bytes left [ 15.846604][ C3] [ 15.846791][ C3] ================================ [ 15.846973][ C3] WARNING: inconsistent lock state [ 15.847155][ C3] 6.15.0-rc5-virtme #1 Not tainted [ 15.847334][ C3] -------------------------------- [ 15.847513][ C3] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 15.847738][ C3] swapper/3/0 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 15.847964][ C3] ffffffff957bf978 (pin_fs_lock){+.?.}-{3:3}, at: simple_pin_fs+0x24/0x150 [ 15.848289][ C3] {SOFTIRQ-ON-W} state was registered at: [ 15.848470][ C3] __lock_acquire+0x3eb/0x9d0 [ 15.848655][ C3] lock_acquire.part.0+0xb6/0x240 [ 15.848836][ C3] _raw_spin_lock+0x33/0x40 [ 15.849019][ C3] simple_pin_fs+0x24/0x150 [ 15.849200][ C3] start_creating.part.0+0x3f/0x2f0 [ 15.849379][ C3] debugfs_create_dir+0x6a/0x540 [ 15.849558][ C3] component_debug_init+0x17/0x30 [ 15.849738][ C3] do_one_initcall+0x8c/0x1e0 [ 15.849917][ C3] do_initcalls+0x176/0x280 [ 15.850095][ C3] kernel_init_freeable+0x22d/0x300 [ 15.850274][ C3] kernel_init+0x20/0x200 [ 15.850451][ C3] ret_from_fork+0x31/0x70 [ 15.850631][ C3] ret_from_fork_asm+0x1a/0x30 [ 15.850806][ C3] irq event stamp: 287738 [ 15.850940][ C3] hardirqs last enabled at (287738): [] _raw_spin_unlock_irqrestore+0x5d/0x80 [ 15.851292][ C3] hardirqs last disabled at (287737): [] _raw_spin_lock_irqsave+0x5b/0x60 [ 15.851645][ C3] softirqs last enabled at (286756): [] handle_softirqs+0x358/0x620 [ 15.851953][ C3] softirqs last disabled at (286763): [] __irq_exit_rcu+0xfa/0x160 [ 15.852263][ C3] [ 15.852263][ C3] other info that might help us debug this: [ 15.852522][ C3] Possible unsafe locking scenario: [ 15.852522][ C3] [ 15.852827][ C3] CPU0 [ 15.852963][ C3] ---- [ 15.853095][ C3] lock(pin_fs_lock); [ 15.853231][ C3] [ 15.853363][ C3] lock(pin_fs_lock); [ 15.853499][ C3] [ 15.853499][ C3] *** DEADLOCK *** [ 15.853499][ C3] [ 15.853759][ C3] 1 lock held by swapper/3/0: [ 15.853937][ C3] #0: ffffffff95574480 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x2e4/0xf20 [ 15.854258][ C3] [ 15.854258][ C3] stack backtrace: [ 15.854478][ C3] CPU: 3 UID: 0 PID: 0 Comm: swapper/3 Not tainted 6.15.0-rc5-virtme #1 PREEMPT(full) [ 15.854483][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 15.854485][ C3] Call Trace: [ 15.854487][ C3] [ 15.854489][ C3] dump_stack_lvl+0x82/0xd0 [ 15.854495][ C3] print_usage_bug.part.0+0x25f/0x360 [ 15.854500][ C3] mark_lock_irq+0x343/0x400 [ 15.854505][ C3] ? __pfx_unwind_next_frame+0x10/0x10 [ 15.854510][ C3] ? save_trace+0x52/0x170 [ 15.854514][ C3] mark_lock+0x174/0x2f0 [ 15.854518][ C3] mark_usage+0x46/0x150 [ 15.854522][ C3] __lock_acquire+0x3eb/0x9d0 [ 15.854527][ C3] lock_acquire.part.0+0xb6/0x240 [ 15.854531][ C3] ? simple_pin_fs+0x24/0x150 [ 15.854535][ C3] ? rcu_is_watching+0x12/0xc0 [ 15.854540][ C3] ? lock_acquire+0x10c/0x170 [ 15.854543][ C3] ? simple_pin_fs+0x24/0x150 [ 15.854548][ C3] _raw_spin_lock+0x33/0x40 [ 15.854551][ C3] ? simple_pin_fs+0x24/0x150 [ 15.854554][ C3] simple_pin_fs+0x24/0x150 [ 15.854558][ C3] debugfs_remove+0x35/0x70 [ 15.854561][ C3] ref_tracker_dir_exit+0xcf/0x740 [ 15.854565][ C3] ? __pfx_ref_tracker_free+0x10/0x10 [ 15.854568][ C3] ? __sk_destruct+0x383/0x780 [ 15.854574][ C3] ? rcu_do_batch+0x34c/0xf20 [ 15.854577][ C3] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 15.854580][ C3] ? irq_exit_rcu+0xe/0x30 [ 15.854582][ C3] ? sysvec_apic_timer_interrupt+0xa8/0xc0 [ 15.854586][ C3] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 15.854590][ C3] ? pv_native_safe_halt+0xf/0x20 [ 15.854593][ C3] ? default_idle+0x9/0x10 [ 15.854595][ C3] ? default_idle_call+0x6d/0xb0 [ 15.854597][ C3] ? cpuidle_idle_call+0x26f/0x3a0 [ 15.854602][ C3] ? do_idle+0xf6/0x160 [ 15.854605][ C3] ? cpu_startup_entry+0x54/0x60 [ 15.854608][ C3] ? start_secondary+0x213/0x2a0 [ 15.854613][ C3] ? common_startup_64+0x13e/0x148 [ 15.854619][ C3] __put_net+0x19/0x60 [ 15.854622][ C3] __sk_destruct+0x58a/0x780 [ 15.854626][ C3] ? rcu_do_batch+0x34a/0xf20 [ 15.854629][ C3] rcu_do_batch+0x34c/0xf20 [ 15.854633][ C3] ? find_held_lock+0x2b/0x80 [ 15.854636][ C3] ? __pfx_rcu_do_batch+0x10/0x10 [ 15.854640][ C3] ? _raw_spin_unlock_irqrestore+0x5d/0x80 [ 15.854643][ C3] ? lockdep_hardirqs_on+0x7c/0x110 [ 15.854647][ C3] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 15.854651][ C3] rcu_core+0x2bb/0x500 [ 15.854655][ C3] handle_softirqs+0x218/0x620 [ 15.854659][ C3] __irq_exit_rcu+0xfa/0x160 [ 15.854662][ C3] irq_exit_rcu+0xe/0x30 [ 15.854664][ C3] sysvec_apic_timer_interrupt+0xa8/0xc0 [ 15.854667][ C3] [ 15.854668][ C3] [ 15.854670][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 15.854672][ C3] RIP: 0010:pv_native_safe_halt+0xf/0x20 [ 15.854676][ C3] Code: b0 b8 00 c3 cc cc cc cc 0f 1f 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d a3 d0 13 00 fb f4 cc cc cc cc 66 2e 0f 1f 84 00 00 00 00 00 66 90 90 90 90 90 90 [ 15.854679][ C3] RSP: 0018:ffffc90000157de8 EFLAGS: 00000242 [ 15.854683][ C3] RAX: 0000000000046029 RBX: 1ffff9200002afc1 RCX: ffffffff94555a19 [ 15.854685][ C3] RDX: 0000000000000000 RSI: ffffffff95085f31 RDI: ffffffff94850ce0 [ 15.854687][ C3] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1006c3667a [ 15.854688][ C3] R10: ffff8880361b33d3 R11: 0000000000000000 R12: 0000000000000000 [ 15.854690][ C3] R13: ffff888001bb4640 R14: dffffc0000000000 R15: 0000000000000000 [ 15.854694][ C3] ? ct_kernel_exit.constprop.0+0x109/0x160 [ 15.854699][ C3] default_idle+0x9/0x10 [ 15.854701][ C3] default_idle_call+0x6d/0xb0 [ 15.854703][ C3] cpuidle_idle_call+0x26f/0x3a0 [ 15.854707][ C3] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 15.854711][ C3] ? tsc_verify_tsc_adjust+0x98/0x300 [ 15.854716][ C3] do_idle+0xf6/0x160 [ 15.854720][ C3] cpu_startup_entry+0x54/0x60 [ 15.854723][ C3] start_secondary+0x213/0x2a0 [ 15.854726][ C3] ? __pfx_start_secondary+0x10/0x10 [ 15.854731][ C3] common_startup_64+0x13e/0x148 [ 15.854737][ C3] [ 15.869154][ C3] BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1576 [ 15.869443][ C3] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 0, name: swapper/3 [ 15.869840][ C3] preempt_count: 101, expected: 0 [ 15.870006][ C3] RCU nest depth: 0, expected: 0 [ 15.870171][ C3] INFO: lockdep is turned off. [ 15.870333][ C3] Preemption disabled at: [ 15.870335][ C3] [<0000000000000000>] 0x0 [ 15.870731][ C3] CPU: 3 UID: 0 PID: 0 Comm: swapper/3 Not tainted 6.15.0-rc5-virtme #1 PREEMPT(full) [ 15.870735][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 15.870737][ C3] Call Trace: [ 15.870738][ C3] [ 15.870740][ C3] dump_stack_lvl+0xb0/0xd0 [ 15.870747][ C3] __might_resched+0x360/0x5a0 [ 15.870752][ C3] down_write+0x72/0x210 [ 15.870756][ C3] ? __pfx_down_write+0x10/0x10 [ 15.870758][ C3] ? simple_recursive_removal+0x3a/0x860 [ 15.870762][ C3] ? rcu_is_watching+0x12/0xc0 [ 15.870768][ C3] ? do_raw_spin_unlock+0x58/0x220 [ 15.870772][ C3] simple_recursive_removal+0x166/0x860 [ 15.870775][ C3] ? __pfx_remove_one+0x10/0x10 [ 15.870778][ C3] ? do_raw_spin_unlock+0x58/0x220 [ 15.870782][ C3] debugfs_remove+0x44/0x70 [ 15.870785][ C3] ref_tracker_dir_exit+0xcf/0x740 [ 15.870789][ C3] ? __pfx_ref_tracker_free+0x10/0x10 [ 15.870792][ C3] ? __sk_destruct+0x383/0x780 [ 15.870797][ C3] ? rcu_do_batch+0x34c/0xf20 [ 15.870800][ C3] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 15.870803][ C3] ? irq_exit_rcu+0xe/0x30 [ 15.870807][ C3] ? sysvec_apic_timer_interrupt+0xa8/0xc0 [ 15.870811][ C3] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 15.870815][ C3] ? pv_native_safe_halt+0xf/0x20 [ 15.870818][ C3] ? default_idle+0x9/0x10 [ 15.870820][ C3] ? default_idle_call+0x6d/0xb0 [ 15.870822][ C3] ? cpuidle_idle_call+0x26f/0x3a0 [ 15.870827][ C3] ? do_idle+0xf6/0x160 [ 15.870830][ C3] ? cpu_startup_entry+0x54/0x60 [ 15.870833][ C3] ? start_secondary+0x213/0x2a0 [ 15.870837][ C3] ? common_startup_64+0x13e/0x148 [ 15.870842][ C3] __put_net+0x19/0x60 [ 15.870845][ C3] __sk_destruct+0x58a/0x780 [ 15.870849][ C3] ? rcu_do_batch+0x34a/0xf20 [ 15.870852][ C3] rcu_do_batch+0x34c/0xf20 [ 15.870856][ C3] ? find_held_lock+0x2b/0x80 [ 15.870860][ C3] ? __pfx_rcu_do_batch+0x10/0x10 [ 15.870864][ C3] ? _raw_spin_unlock_irqrestore+0x5d/0x80 [ 15.870867][ C3] ? lockdep_hardirqs_on+0x7c/0x110 [ 15.870871][ C3] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 15.870875][ C3] rcu_core+0x2bb/0x500 [ 15.870879][ C3] handle_softirqs+0x218/0x620 [ 15.870883][ C3] __irq_exit_rcu+0xfa/0x160 [ 15.870886][ C3] irq_exit_rcu+0xe/0x30 [ 15.870888][ C3] sysvec_apic_timer_interrupt+0xa8/0xc0 [ 15.870891][ C3] [ 15.870892][ C3] [ 15.870894][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 15.870896][ C3] RIP: 0010:pv_native_safe_halt+0xf/0x20 [ 15.870900][ C3] Code: b0 b8 00 c3 cc cc cc cc 0f 1f 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d a3 d0 13 00 fb f4 cc cc cc cc 66 2e 0f 1f 84 00 00 00 00 00 66 90 90 90 90 90 90 [ 15.870902][ C3] RSP: 0018:ffffc90000157de8 EFLAGS: 00000242 [ 15.870906][ C3] RAX: 0000000000046029 RBX: 1ffff9200002afc1 RCX: ffffffff94555a19 [ 15.870908][ C3] RDX: 0000000000000000 RSI: ffffffff95085f31 RDI: ffffffff94850ce0 [ 15.870909][ C3] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1006c3667a [ 15.870911][ C3] R10: ffff8880361b33d3 R11: 0000000000000000 R12: 0000000000000000 [ 15.870912][ C3] R13: ffff888001bb4640 R14: dffffc0000000000 R15: 0000000000000000 [ 15.870916][ C3] ? ct_kernel_exit.constprop.0+0x109/0x160 [ 15.870921][ C3] default_idle+0x9/0x10 [ 15.870924][ C3] default_idle_call+0x6d/0xb0 [ 15.870926][ C3] cpuidle_idle_call+0x26f/0x3a0 [ 15.870930][ C3] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 15.870934][ C3] ? tsc_verify_tsc_adjust+0x98/0x300 [ 15.870938][ C3] do_idle+0xf6/0x160 [ 15.870942][ C3] cpu_startup_entry+0x54/0x60 [ 15.870946][ C3] start_secondary+0x213/0x2a0 [ 15.870949][ C3] ? __pfx_start_secondary+0x10/0x10 [ 15.870954][ C3] common_startup_64+0x13e/0x148 [ 15.870960][ C3] [ 18.025007][ C2] BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1576 [ 18.025374][ C2] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 0, name: swapper/2 [ 18.025689][ C2] preempt_count: 101, expected: 0 [ 18.025893][ C2] RCU nest depth: 0, expected: 0 [ 18.026073][ C2] INFO: lockdep is turned off. [ 18.026276][ C2] Preemption disabled at: [ 18.026278][ C2] [<0000000000000000>] 0x0 [ 18.026603][ C2] CPU: 2 UID: 0 PID: 0 Comm: swapper/2 Tainted: G W 6.15.0-rc5-virtme #1 PREEMPT(full) [ 18.026608][ C2] Tainted: [W]=WARN [ 18.026610][ C2] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 18.026612][ C2] Call Trace: [ 18.026613][ C2] [ 18.026615][ C2] dump_stack_lvl+0xb0/0xd0 [ 18.026625][ C2] __might_resched+0x360/0x5a0 [ 18.026634][ C2] down_write+0x72/0x210 [ 18.026641][ C2] ? __pfx_down_write+0x10/0x10 [ 18.026646][ C2] ? simple_recursive_removal+0x3a/0x860 [ 18.026653][ C2] ? rcu_is_watching+0x12/0xc0 [ 18.026661][ C2] ? do_raw_spin_unlock+0x58/0x220 [ 18.026665][ C2] simple_recursive_removal+0x166/0x860 [ 18.026668][ C2] ? __pfx_remove_one+0x10/0x10 [ 18.026672][ C2] ? do_raw_spin_unlock+0x58/0x220 [ 18.026676][ C2] debugfs_remove+0x44/0x70 [ 18.026679][ C2] ref_tracker_dir_exit+0xcf/0x740 [ 18.026684][ C2] ? __pfx_ref_tracker_free+0x10/0x10 [ 18.026687][ C2] ? __sk_destruct+0x383/0x780 [ 18.026693][ C2] ? rcu_do_batch+0x34c/0xf20 [ 18.026697][ C2] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 18.026700][ C2] ? irq_exit_rcu+0xe/0x30 [ 18.026703][ C2] ? sysvec_apic_timer_interrupt+0xa8/0xc0 [ 18.026708][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 18.026716][ C2] ? pv_native_safe_halt+0xf/0x20 [ 18.026719][ C2] ? default_idle+0x9/0x10 [ 18.026721][ C2] ? default_idle_call+0x6d/0xb0 [ 18.026723][ C2] ? cpuidle_idle_call+0x26f/0x3a0 [ 18.026728][ C2] ? do_idle+0xf6/0x160 [ 18.026731][ C2] ? cpu_startup_entry+0x54/0x60 [ 18.026734][ C2] ? start_secondary+0x213/0x2a0 [ 18.026739][ C2] ? common_startup_64+0x13e/0x148 [ 18.026743][ C2] ? bpf_sk_storage_free+0x9f/0x1c0 [ 18.026747][ C2] ? rcu_is_watching+0x12/0xc0 [ 18.026752][ C2] __put_net+0x19/0x60 [ 18.026755][ C2] __sk_destruct+0x58a/0x780 [ 18.026759][ C2] ? rcu_do_batch+0x34a/0xf20 [ 18.026762][ C2] rcu_do_batch+0x34c/0xf20 [ 18.026767][ C2] ? __pfx_rcu_do_batch+0x10/0x10 [ 18.026770][ C2] ? trace_irq_enable.constprop.0+0xd4/0x130 [ 18.026775][ C2] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 18.026780][ C2] rcu_core+0x2bb/0x500 [ 18.026784][ C2] handle_softirqs+0x218/0x620 [ 18.026788][ C2] __irq_exit_rcu+0xfa/0x160 [ 18.026791][ C2] irq_exit_rcu+0xe/0x30 [ 18.026793][ C2] sysvec_apic_timer_interrupt+0xa8/0xc0 [ 18.026796][ C2] [ 18.026797][ C2] [ 18.026799][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 18.026802][ C2] RIP: 0010:pv_native_safe_halt+0xf/0x20 [ 18.026805][ C2] Code: b0 b8 00 c3 cc cc cc cc 0f 1f 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d a3 d0 13 00 fb f4 cc cc cc cc 66 2e 0f 1f 84 00 00 00 00 00 66 90 90 90 90 90 90 [ 18.026808][ C2] RSP: 0018:ffffc90000147de8 EFLAGS: 00000246 [ 18.026812][ C2] RAX: 0000000000000002 RBX: 1ffff92000028fc1 RCX: ffffffff94555a19 [ 18.026814][ C2] RDX: ffffed1006c2667b RSI: ffffffff94850c60 RDI: ffffffff91d84d8f [ 18.026816][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006c2667a [ 18.026818][ C2] R10: ffff8880361333d3 R11: ffffffff97e4fd38 R12: 0000000000000000 [ 18.026820][ C2] R13: ffff888001bb2340 R14: dffffc0000000000 R15: 0000000000000000 [ 18.026824][ C2] ? ct_kernel_exit.constprop.0+0x109/0x160 [ 18.026828][ C2] ? cpuidle_idle_call+0x26f/0x3a0 [ 18.026832][ C2] default_idle+0x9/0x10 [ 18.026835][ C2] default_idle_call+0x6d/0xb0 [ 18.026837][ C2] cpuidle_idle_call+0x26f/0x3a0 [ 18.026840][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 18.026845][ C2] ? tsc_verify_tsc_adjust+0x98/0x300 [ 18.026850][ C2] do_idle+0xf6/0x160 [ 18.026853][ C2] cpu_startup_entry+0x54/0x60 [ 18.026857][ C2] start_secondary+0x213/0x2a0 [ 18.026860][ C2] ? __pfx_start_secondary+0x10/0x10 [ 18.026865][ C2] common_startup_64+0x13e/0x148 [ 18.026871][ C2]