[ 14.598050][ T225] TCP: tun0: Driver has suspect GRO implementation, TCP performance may be compromised. [ 14.700033][ C3] [ 14.700189][ C3] ================================ [ 14.700438][ C3] WARNING: inconsistent lock state [ 14.700663][ C3] 6.15.0-virtme #1 Not tainted [ 14.700847][ C3] -------------------------------- [ 14.701028][ C3] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 14.701256][ C3] ksoftirqd/3/32 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 14.701479][ C3] ffffffffa5bc5af8 (pin_fs_lock){+.?.}-{3:3}, at: simple_pin_fs+0x24/0x150 [ 14.701798][ C3] {SOFTIRQ-ON-W} state was registered at: [ 14.701977][ C3] __lock_acquire+0x20b/0x7e0 [ 14.702160][ C3] lock_acquire.part.0+0xb6/0x240 [ 14.702339][ C3] _raw_spin_lock+0x33/0x40 [ 14.702522][ C3] simple_pin_fs+0x24/0x150 [ 14.702698][ C3] start_creating.part.0+0x52/0x310 [ 14.702877][ C3] debugfs_create_dir+0x6a/0x540 [ 14.703060][ C3] component_debug_init+0x17/0x30 [ 14.703246][ C3] do_one_initcall+0x8f/0x1e0 [ 14.703431][ C3] do_initcalls+0x176/0x280 [ 14.703618][ C3] kernel_init_freeable+0x22d/0x300 [ 14.703805][ C3] kernel_init+0x20/0x200 [ 14.704001][ C3] ret_from_fork+0x240/0x320 [ 14.704182][ C3] ret_from_fork_asm+0x1a/0x30 [ 14.704363][ C3] irq event stamp: 183100 [ 14.704501][ C3] hardirqs last enabled at (183100): [] _raw_spin_unlock_irqrestore+0x5d/0x80 [ 14.704858][ C3] hardirqs last disabled at (183099): [] _raw_spin_lock_irqsave+0x5b/0x60 [ 14.705213][ C3] softirqs last enabled at (182830): [] handle_softirqs+0x358/0x620 [ 14.705558][ C3] softirqs last disabled at (182839): [] run_ksoftirqd+0x3f/0x70 [ 14.705881][ C3] [ 14.705881][ C3] other info that might help us debug this: [ 14.706148][ C3] Possible unsafe locking scenario: [ 14.706148][ C3] [ 14.706418][ C3] CPU0 [ 14.706556][ C3] ---- [ 14.706695][ C3] lock(pin_fs_lock); [ 14.706833][ C3] [ 14.706966][ C3] lock(pin_fs_lock); [ 14.707102][ C3] [ 14.707102][ C3] *** DEADLOCK *** [ 14.707102][ C3] [ 14.707364][ C3] 1 lock held by ksoftirqd/3/32: [ 14.707549][ C3] #0: ffffffffa59774c0 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x2e4/0xf20 [ 14.707868][ C3] [ 14.707868][ C3] stack backtrace: [ 14.708090][ C3] CPU: 3 UID: 0 PID: 32 Comm: ksoftirqd/3 Not tainted 6.15.0-virtme #1 PREEMPT(full) [ 14.708094][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 14.708097][ C3] Call Trace: [ 14.708099][ C3] [ 14.708101][ C3] dump_stack_lvl+0x82/0xd0 [ 14.708109][ C3] print_usage_bug.part.0+0x25f/0x360 [ 14.708113][ C3] mark_lock_irq+0x343/0x400 [ 14.708118][ C3] ? __pfx_unwind_next_frame+0x10/0x10 [ 14.708123][ C3] ? save_trace+0x52/0x170 [ 14.708130][ C3] mark_lock+0x174/0x2f0 [ 14.708134][ C3] mark_usage+0x46/0x150 [ 14.708137][ C3] __lock_acquire+0x20b/0x7e0 [ 14.708140][ C3] ? __lock_acquire+0x44d/0x7e0 [ 14.708144][ C3] lock_acquire.part.0+0xb6/0x240 [ 14.708147][ C3] ? simple_pin_fs+0x24/0x150 [ 14.708151][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.708156][ C3] ? lock_acquire+0x10c/0x170 [ 14.708159][ C3] ? simple_pin_fs+0x24/0x150 [ 14.708163][ C3] _raw_spin_lock+0x33/0x40 [ 14.708167][ C3] ? simple_pin_fs+0x24/0x150 [ 14.708170][ C3] simple_pin_fs+0x24/0x150 [ 14.708174][ C3] debugfs_remove+0x35/0x70 [ 14.708177][ C3] ref_tracker_dir_exit+0xcf/0x740 [ 14.708185][ C3] ? __pfx_ref_tracker_free+0x10/0x10 [ 14.708188][ C3] ? __sk_destruct+0x383/0x780 [ 14.708195][ C3] ? rcu_do_batch+0x34c/0xf20 [ 14.708198][ C3] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 14.708201][ C3] ? smpboot_thread_fn+0x30a/0x960 [ 14.708207][ C3] ? kthread+0x37e/0x600 [ 14.708210][ C3] ? ret_from_fork+0x240/0x320 [ 14.708213][ C3] ? ret_from_fork_asm+0x1a/0x30 [ 14.708216][ C3] ? migrate_enable+0x1f2/0x270 [ 14.708221][ C3] ? __pfx_migrate_enable+0x10/0x10 [ 14.708226][ C3] __put_net+0x19/0x60 [ 14.708230][ C3] __sk_destruct+0x58a/0x780 [ 14.708235][ C3] ? rcu_do_batch+0x34a/0xf20 [ 14.708237][ C3] rcu_do_batch+0x34c/0xf20 [ 14.708242][ C3] ? __pfx_rcu_do_batch+0x10/0x10 [ 14.708245][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.708248][ C3] ? note_gp_changes+0x182/0x1e0 [ 14.708251][ C3] ? lockdep_hardirqs_on+0x7c/0x110 [ 14.708255][ C3] rcu_core+0x2bb/0x500 [ 14.708260][ C3] handle_softirqs+0x218/0x620 [ 14.708264][ C3] ? __pfx_run_ksoftirqd+0x10/0x10 [ 14.708268][ C3] run_ksoftirqd+0x3f/0x70 [ 14.708270][ C3] smpboot_thread_fn+0x30a/0x960 [ 14.708274][ C3] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 14.708278][ C3] kthread+0x37e/0x600 [ 14.708281][ C3] ? __pfx_kthread+0x10/0x10 [ 14.708283][ C3] ? ret_from_fork+0x1b/0x320 [ 14.708285][ C3] ? __lock_release+0x5d/0x170 [ 14.708288][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.708291][ C3] ? __pfx_kthread+0x10/0x10 [ 14.708294][ C3] ret_from_fork+0x240/0x320 [ 14.708297][ C3] ? __pfx_kthread+0x10/0x10 [ 14.708299][ C3] ret_from_fork_asm+0x1a/0x30 [ 14.708306][ C3] [ 14.718735][ C3] BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1576 [ 14.719042][ C3] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 32, name: ksoftirqd/3 [ 14.719339][ C3] preempt_count: 100, expected: 0 [ 14.719512][ C3] RCU nest depth: 0, expected: 0 [ 14.719683][ C3] INFO: lockdep is turned off. [ 14.719850][ C3] Preemption disabled at: [ 14.719851][ C3] [] handle_softirqs+0xe5/0x620 [ 14.720202][ C3] CPU: 3 UID: 0 PID: 32 Comm: ksoftirqd/3 Not tainted 6.15.0-virtme #1 PREEMPT(full) [ 14.720205][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 14.720207][ C3] Call Trace: [ 14.720208][ C3] [ 14.720210][ C3] dump_stack_lvl+0xb0/0xd0 [ 14.720216][ C3] __might_resched+0x360/0x5a0 [ 14.720223][ C3] down_write+0x72/0x210 [ 14.720227][ C3] ? __pfx_down_write+0x10/0x10 [ 14.720230][ C3] ? simple_recursive_removal+0x33/0x610 [ 14.720233][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.720238][ C3] ? do_raw_spin_unlock+0x58/0x220 [ 14.720243][ C3] simple_recursive_removal+0x6a/0x610 [ 14.720246][ C3] ? do_raw_spin_unlock+0x58/0x220 [ 14.720250][ C3] ? __pfx_remove_one+0x10/0x10 [ 14.720255][ C3] debugfs_remove+0x44/0x70 [ 14.720258][ C3] ref_tracker_dir_exit+0xcf/0x740 [ 14.720263][ C3] ? __pfx_ref_tracker_free+0x10/0x10 [ 14.720266][ C3] ? __sk_destruct+0x383/0x780 [ 14.720270][ C3] ? rcu_do_batch+0x34c/0xf20 [ 14.720273][ C3] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 14.720277][ C3] ? smpboot_thread_fn+0x30a/0x960 [ 14.720280][ C3] ? kthread+0x37e/0x600 [ 14.720283][ C3] ? ret_from_fork+0x240/0x320 [ 14.720286][ C3] ? ret_from_fork_asm+0x1a/0x30 [ 14.720290][ C3] ? migrate_enable+0x1f2/0x270 [ 14.720294][ C3] ? __pfx_migrate_enable+0x10/0x10 [ 14.720299][ C3] __put_net+0x19/0x60 [ 14.720302][ C3] __sk_destruct+0x58a/0x780 [ 14.720306][ C3] ? rcu_do_batch+0x34a/0xf20 [ 14.720308][ C3] rcu_do_batch+0x34c/0xf20 [ 14.720313][ C3] ? __pfx_rcu_do_batch+0x10/0x10 [ 14.720317][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.720319][ C3] ? note_gp_changes+0x182/0x1e0 [ 14.720322][ C3] ? lockdep_hardirqs_on+0x7c/0x110 [ 14.720326][ C3] rcu_core+0x2bb/0x500 [ 14.720330][ C3] handle_softirqs+0x218/0x620 [ 14.720334][ C3] ? __pfx_run_ksoftirqd+0x10/0x10 [ 14.720337][ C3] run_ksoftirqd+0x3f/0x70 [ 14.720340][ C3] smpboot_thread_fn+0x30a/0x960 [ 14.720344][ C3] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 14.720348][ C3] kthread+0x37e/0x600 [ 14.720350][ C3] ? __pfx_kthread+0x10/0x10 [ 14.720352][ C3] ? ret_from_fork+0x1b/0x320 [ 14.720355][ C3] ? __lock_release+0x5d/0x170 [ 14.720358][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.720361][ C3] ? __pfx_kthread+0x10/0x10 [ 14.720364][ C3] ret_from_fork+0x240/0x320 [ 14.720367][ C3] ? __pfx_kthread+0x10/0x10 [ 14.720369][ C3] ret_from_fork_asm+0x1a/0x30 [ 14.720376][ C3] [ 16.333123][ C0] BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1576 [ 16.333550][ C0] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 0, name: swapper/0 [ 16.333894][ C0] preempt_count: 101, expected: 0 [ 16.334101][ C0] RCU nest depth: 0, expected: 0 [ 16.334298][ C0] INFO: lockdep is turned off. [ 16.334496][ C0] Preemption disabled at: [ 16.334498][ C0] [] schedule_preempt_disabled+0x22/0x30 [ 16.334942][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 6.15.0-virtme #1 PREEMPT(full) [ 16.334947][ C0] Tainted: [W]=WARN [ 16.334949][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 16.334951][ C0] Call Trace: [ 16.334953][ C0] [ 16.334955][ C0] dump_stack_lvl+0xb0/0xd0 [ 16.334963][ C0] __might_resched+0x360/0x5a0 [ 16.334974][ C0] down_write+0x72/0x210 [ 16.334979][ C0] ? __pfx_down_write+0x10/0x10 [ 16.334982][ C0] ? simple_recursive_removal+0x33/0x610 [ 16.334988][ C0] ? rcu_is_watching+0x12/0xc0 [ 16.334995][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 16.335003][ C0] simple_recursive_removal+0x6a/0x610 [ 16.335006][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 16.335009][ C0] ? __pfx_remove_one+0x10/0x10 [ 16.335016][ C0] debugfs_remove+0x44/0x70 [ 16.335019][ C0] ref_tracker_dir_exit+0xcf/0x740 [ 16.335028][ C0] ? __pfx_ref_tracker_free+0x10/0x10 [ 16.335031][ C0] ? __sk_destruct+0x383/0x780 [ 16.335040][ C0] ? rcu_do_batch+0x34c/0xf20 [ 16.335044][ C0] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 16.335047][ C0] ? irq_exit_rcu+0xe/0x30 [ 16.335054][ C0] ? sysvec_apic_timer_interrupt+0xa8/0xc0 [ 16.335059][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 16.335063][ C0] ? pv_native_safe_halt+0xf/0x20 [ 16.335066][ C0] ? default_idle+0x9/0x10 [ 16.335069][ C0] ? default_idle_call+0x6d/0xb0 [ 16.335072][ C0] ? cpuidle_idle_call+0x26f/0x3a0 [ 16.335075][ C0] ? do_idle+0xf6/0x160 [ 16.335078][ C0] ? cpu_startup_entry+0x54/0x60 [ 16.335080][ C0] ? rest_init+0x14b/0x260 [ 16.335084][ C0] ? start_kernel+0x350/0x410 [ 16.335091][ C0] ? bpf_sk_storage_free+0x9f/0x1c0 [ 16.335095][ C0] ? rcu_is_watching+0x12/0xc0 [ 16.335099][ C0] __put_net+0x19/0x60 [ 16.335105][ C0] __sk_destruct+0x58a/0x780 [ 16.335109][ C0] ? rcu_do_batch+0x34a/0xf20 [ 16.335111][ C0] rcu_do_batch+0x34c/0xf20 [ 16.335116][ C0] ? __pfx_rcu_do_batch+0x10/0x10 [ 16.335119][ C0] ? trace_irq_enable.constprop.0+0xd4/0x130 [ 16.335125][ C0] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 16.335133][ C0] rcu_core+0x2bb/0x500 [ 16.335139][ C0] handle_softirqs+0x218/0x620 [ 16.335144][ C0] __irq_exit_rcu+0xfa/0x160 [ 16.335147][ C0] irq_exit_rcu+0xe/0x30 [ 16.335150][ C0] sysvec_apic_timer_interrupt+0xa8/0xc0 [ 16.335154][ C0] [ 16.335155][ C0] [ 16.335156][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 16.335159][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x20 [ 16.335163][ C0] Code: 92 b5 00 c3 cc cc cc cc 0f 1f 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 83 37 10 00 fb f4 fc 54 02 00 66 2e 0f 1f 84 00 00 00 00 00 66 90 90 90 90 90 90 [ 16.335166][ C0] RSP: 0018:ffffffffa5607df8 EFLAGS: 00000246 [ 16.335169][ C0] RAX: 0000000000000000 RBX: 1ffffffff4ac0fc3 RCX: ffffffffa49905d9 [ 16.335171][ C0] RDX: ffffed1005e866fb RSI: ffffffffa4c53b60 RDI: ffffffffa218d18f [ 16.335173][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1005e866fa [ 16.335175][ C0] R10: ffff88802f4337d3 R11: ffff888001bda818 R12: 0000000000000000 [ 16.335176][ C0] R13: ffffffffa561f240 R14: dffffc0000000000 R15: 0000000000014770 [ 16.335181][ C0] ? ct_kernel_exit.constprop.0+0x109/0x160 [ 16.335184][ C0] ? cpuidle_idle_call+0x26f/0x3a0 [ 16.335188][ C0] default_idle+0x9/0x10 [ 16.335190][ C0] default_idle_call+0x6d/0xb0 [ 16.335193][ C0] cpuidle_idle_call+0x26f/0x3a0 [ 16.335196][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 16.335200][ C0] ? tsc_verify_tsc_adjust+0x98/0x310 [ 16.335205][ C0] do_idle+0xf6/0x160 [ 16.335209][ C0] cpu_startup_entry+0x54/0x60 [ 16.335212][ C0] rest_init+0x14b/0x260 [ 16.335215][ C0] start_kernel+0x350/0x410 [ 16.335219][ C0] x86_64_start_reservations+0x18/0x30 [ 16.335224][ C0] x86_64_start_kernel+0xf8/0x150 [ 16.335227][ C0] common_startup_64+0x13e/0x148 [ 16.335237][ C0]