[ 13.956951][ T225] TCP: tun0: Driver has suspect GRO implementation, TCP performance may be compromised. [ 14.045961][ C0] [ 14.046095][ C0] ================================ [ 14.046294][ C0] WARNING: inconsistent lock state [ 14.046487][ C0] 6.15.0-rc5-virtme #1 Not tainted [ 14.046681][ C0] -------------------------------- [ 14.046874][ C0] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 14.047115][ C0] swapper/0/0 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 14.047358][ C0] ffffffffa11bf978 (pin_fs_lock){+.?.}-{3:3}, at: simple_pin_fs+0x24/0x150 [ 14.047714][ C0] {SOFTIRQ-ON-W} state was registered at: [ 14.047910][ C0] __lock_acquire+0x3eb/0x9d0 [ 14.048117][ C0] lock_acquire.part.0+0xb6/0x240 [ 14.048311][ C0] _raw_spin_lock+0x33/0x40 [ 14.048512][ C0] simple_pin_fs+0x24/0x150 [ 14.048705][ C0] start_creating.part.0+0x3f/0x2f0 [ 14.048902][ C0] debugfs_create_dir+0x6a/0x540 [ 14.049098][ C0] component_debug_init+0x17/0x30 [ 14.049296][ C0] do_one_initcall+0x8c/0x1e0 [ 14.049492][ C0] do_initcalls+0x176/0x280 [ 14.049697][ C0] kernel_init_freeable+0x22d/0x300 [ 14.049890][ C0] kernel_init+0x20/0x200 [ 14.050085][ C0] ret_from_fork+0x31/0x70 [ 14.050281][ C0] ret_from_fork_asm+0x1a/0x30 [ 14.050479][ C0] irq event stamp: 457920 [ 14.050627][ C0] hardirqs last enabled at (457920): [] _raw_spin_unlock_irqrestore+0x5d/0x80 [ 14.051019][ C0] hardirqs last disabled at (457919): [] _raw_spin_lock_irqsave+0x5b/0x60 [ 14.051406][ C0] softirqs last enabled at (455998): [] handle_softirqs+0x358/0x620 [ 14.051753][ C0] softirqs last disabled at (456035): [] __irq_exit_rcu+0xfa/0x160 [ 14.052090][ C0] [ 14.052090][ C0] other info that might help us debug this: [ 14.052382][ C0] Possible unsafe locking scenario: [ 14.052382][ C0] [ 14.052672][ C0] CPU0 [ 14.052819][ C0] ---- [ 14.052964][ C0] lock(pin_fs_lock); [ 14.053113][ C0] [ 14.053258][ C0] lock(pin_fs_lock); [ 14.053406][ C0] [ 14.053406][ C0] *** DEADLOCK *** [ 14.053406][ C0] [ 14.053690][ C0] 1 lock held by swapper/0/0: [ 14.053887][ C0] #0: ffffffffa0f74480 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x2e4/0xf20 [ 14.054230][ C0] [ 14.054230][ C0] stack backtrace: [ 14.054470][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Not tainted 6.15.0-rc5-virtme #1 PREEMPT(full) [ 14.054474][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 14.054477][ C0] Call Trace: [ 14.054478][ C0] [ 14.054480][ C0] dump_stack_lvl+0x82/0xd0 [ 14.054485][ C0] print_usage_bug.part.0+0x25f/0x360 [ 14.054490][ C0] mark_lock_irq+0x343/0x400 [ 14.054494][ C0] ? is_bpf_text_address+0x67/0x120 [ 14.054499][ C0] ? __lock_release+0x5d/0x170 [ 14.054504][ C0] ? save_trace+0x52/0x170 [ 14.054508][ C0] mark_lock+0x174/0x2f0 [ 14.054512][ C0] mark_usage+0x46/0x150 [ 14.054516][ C0] __lock_acquire+0x3eb/0x9d0 [ 14.054521][ C0] lock_acquire.part.0+0xb6/0x240 [ 14.054524][ C0] ? simple_pin_fs+0x24/0x150 [ 14.054529][ C0] ? rcu_is_watching+0x12/0xc0 [ 14.054534][ C0] ? lock_acquire+0x10c/0x170 [ 14.054537][ C0] ? simple_pin_fs+0x24/0x150 [ 14.054541][ C0] _raw_spin_lock+0x33/0x40 [ 14.054544][ C0] ? simple_pin_fs+0x24/0x150 [ 14.054547][ C0] simple_pin_fs+0x24/0x150 [ 14.054551][ C0] debugfs_remove+0x35/0x70 [ 14.054554][ C0] ref_tracker_dir_exit+0xcf/0x740 [ 14.054559][ C0] ? __pfx_ref_tracker_free+0x10/0x10 [ 14.054562][ C0] ? __sk_destruct+0x383/0x780 [ 14.054567][ C0] ? rcu_do_batch+0x34c/0xf20 [ 14.054570][ C0] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 14.054573][ C0] ? irq_exit_rcu+0xe/0x30 [ 14.054576][ C0] ? sysvec_apic_timer_interrupt+0xa8/0xc0 [ 14.054580][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 14.054583][ C0] ? pv_native_safe_halt+0xf/0x20 [ 14.054586][ C0] ? default_idle+0x9/0x10 [ 14.054588][ C0] ? default_idle_call+0x6d/0xb0 [ 14.054590][ C0] ? cpuidle_idle_call+0x26f/0x3a0 [ 14.054595][ C0] ? do_idle+0xf6/0x160 [ 14.054598][ C0] ? cpu_startup_entry+0x54/0x60 [ 14.054601][ C0] ? rest_init+0x14b/0x260 [ 14.054603][ C0] ? start_kernel+0x350/0x410 [ 14.054608][ C0] __put_net+0x19/0x60 [ 14.054612][ C0] __sk_destruct+0x58a/0x780 [ 14.054615][ C0] ? rcu_do_batch+0x34a/0xf20 [ 14.054618][ C0] rcu_do_batch+0x34c/0xf20 [ 14.054622][ C0] ? find_held_lock+0x2b/0x80 [ 14.054626][ C0] ? __pfx_rcu_do_batch+0x10/0x10 [ 14.054630][ C0] ? _raw_spin_unlock_irqrestore+0x5d/0x80 [ 14.054633][ C0] ? lockdep_hardirqs_on+0x7c/0x110 [ 14.054636][ C0] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 14.054641][ C0] rcu_core+0x2bb/0x500 [ 14.054644][ C0] handle_softirqs+0x218/0x620 [ 14.054648][ C0] __irq_exit_rcu+0xfa/0x160 [ 14.054651][ C0] irq_exit_rcu+0xe/0x30 [ 14.054653][ C0] sysvec_apic_timer_interrupt+0xa8/0xc0 [ 14.054656][ C0] [ 14.054657][ C0] [ 14.054659][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 14.054662][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x20 [ 14.054666][ C0] Code: b0 b8 00 c3 cc cc cc cc 0f 1f 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d a3 d0 13 00 fb f4 cc cc cc cc 66 2e 0f 1f 84 00 00 00 00 00 66 90 90 90 90 90 90 [ 14.054669][ C0] RSP: 0018:ffffffffa0c07df8 EFLAGS: 00000242 [ 14.054672][ C0] RAX: 000000000006f561 RBX: 1ffffffff4180fc3 RCX: ffffffff9ff55a19 [ 14.054674][ C0] RDX: 0000000000000000 RSI: ffffffffa0a85f31 RDI: ffffffffa0250ce0 [ 14.054676][ C0] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1006c0667a [ 14.054677][ C0] R10: ffff8880360333d3 R11: 0000000000000000 R12: 0000000000000000 [ 14.054679][ C0] R13: ffffffffa0c1f240 R14: dffffc0000000000 R15: 0000000000014770 [ 14.054683][ C0] ? ct_kernel_exit.constprop.0+0x109/0x160 [ 14.054688][ C0] default_idle+0x9/0x10 [ 14.054690][ C0] default_idle_call+0x6d/0xb0 [ 14.054693][ C0] cpuidle_idle_call+0x26f/0x3a0 [ 14.054696][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 14.054701][ C0] ? tsc_verify_tsc_adjust+0x98/0x300 [ 14.054707][ C0] do_idle+0xf6/0x160 [ 14.054711][ C0] cpu_startup_entry+0x54/0x60 [ 14.054714][ C0] rest_init+0x14b/0x260 [ 14.054717][ C0] start_kernel+0x350/0x410 [ 14.054721][ C0] x86_64_start_reservations+0x18/0x30 [ 14.054725][ C0] x86_64_start_kernel+0xba/0x110 [ 14.054728][ C0] common_startup_64+0x13e/0x148 [ 14.054736][ C0] [ 14.070862][ C0] BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1576 [ 14.071181][ C0] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 0, name: swapper/0 [ 14.071614][ C0] preempt_count: 101, expected: 0 [ 14.071806][ C0] RCU nest depth: 0, expected: 0 [ 14.071989][ C0] INFO: lockdep is turned off. [ 14.072285][ C0] Preemption disabled at: [ 14.072287][ C0] [] schedule_preempt_disabled+0x22/0x30 [ 14.072697][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Not tainted 6.15.0-rc5-virtme #1 PREEMPT(full) [ 14.072701][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 14.072702][ C0] Call Trace: [ 14.072704][ C0] [ 14.072705][ C0] dump_stack_lvl+0xb0/0xd0 [ 14.072713][ C0] __might_resched+0x360/0x5a0 [ 14.072719][ C0] down_write+0x72/0x210 [ 14.072722][ C0] ? __pfx_down_write+0x10/0x10 [ 14.072725][ C0] ? simple_recursive_removal+0x3a/0x860 [ 14.072729][ C0] ? rcu_is_watching+0x12/0xc0 [ 14.072734][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 14.072739][ C0] simple_recursive_removal+0x166/0x860 [ 14.072742][ C0] ? __pfx_remove_one+0x10/0x10 [ 14.072745][ C0] ? do_raw_spin_unlock+0x58/0x220 [ 14.072749][ C0] debugfs_remove+0x44/0x70 [ 14.072752][ C0] ref_tracker_dir_exit+0xcf/0x740 [ 14.072757][ C0] ? __pfx_ref_tracker_free+0x10/0x10 [ 14.072760][ C0] ? __sk_destruct+0x383/0x780 [ 14.072764][ C0] ? rcu_do_batch+0x34c/0xf20 [ 14.072768][ C0] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 14.072771][ C0] ? irq_exit_rcu+0xe/0x30 [ 14.072774][ C0] ? sysvec_apic_timer_interrupt+0xa8/0xc0 [ 14.072778][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 14.072782][ C0] ? pv_native_safe_halt+0xf/0x20 [ 14.072785][ C0] ? default_idle+0x9/0x10 [ 14.072787][ C0] ? default_idle_call+0x6d/0xb0 [ 14.072789][ C0] ? cpuidle_idle_call+0x26f/0x3a0 [ 14.072793][ C0] ? do_idle+0xf6/0x160 [ 14.072796][ C0] ? cpu_startup_entry+0x54/0x60 [ 14.072799][ C0] ? rest_init+0x14b/0x260 [ 14.072801][ C0] ? start_kernel+0x350/0x410 [ 14.072808][ C0] __put_net+0x19/0x60 [ 14.072810][ C0] __sk_destruct+0x58a/0x780 [ 14.072814][ C0] ? rcu_do_batch+0x34a/0xf20 [ 14.072817][ C0] rcu_do_batch+0x34c/0xf20 [ 14.072821][ C0] ? find_held_lock+0x2b/0x80 [ 14.072825][ C0] ? __pfx_rcu_do_batch+0x10/0x10 [ 14.072829][ C0] ? _raw_spin_unlock_irqrestore+0x5d/0x80 [ 14.072833][ C0] ? lockdep_hardirqs_on+0x7c/0x110 [ 14.072837][ C0] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 14.072841][ C0] rcu_core+0x2bb/0x500 [ 14.072844][ C0] handle_softirqs+0x218/0x620 [ 14.072849][ C0] __irq_exit_rcu+0xfa/0x160 [ 14.072851][ C0] irq_exit_rcu+0xe/0x30 [ 14.072853][ C0] sysvec_apic_timer_interrupt+0xa8/0xc0 [ 14.072857][ C0] [ 14.072858][ C0] [ 14.072859][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 14.072862][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x20 [ 14.072865][ C0] Code: b0 b8 00 c3 cc cc cc cc 0f 1f 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d a3 d0 13 00 fb f4 cc cc cc cc 66 2e 0f 1f 84 00 00 00 00 00 66 90 90 90 90 90 90 [ 14.072868][ C0] RSP: 0018:ffffffffa0c07df8 EFLAGS: 00000242 [ 14.072871][ C0] RAX: 000000000006f561 RBX: 1ffffffff4180fc3 RCX: ffffffff9ff55a19 [ 14.072873][ C0] RDX: 0000000000000000 RSI: ffffffffa0a85f31 RDI: ffffffffa0250ce0 [ 14.072875][ C0] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1006c0667a [ 14.072876][ C0] R10: ffff8880360333d3 R11: 0000000000000000 R12: 0000000000000000 [ 14.072878][ C0] R13: ffffffffa0c1f240 R14: dffffc0000000000 R15: 0000000000014770 [ 14.072882][ C0] ? ct_kernel_exit.constprop.0+0x109/0x160 [ 14.072887][ C0] default_idle+0x9/0x10 [ 14.072889][ C0] default_idle_call+0x6d/0xb0 [ 14.072892][ C0] cpuidle_idle_call+0x26f/0x3a0 [ 14.072895][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 14.072899][ C0] ? tsc_verify_tsc_adjust+0x98/0x300 [ 14.072905][ C0] do_idle+0xf6/0x160 [ 14.072909][ C0] cpu_startup_entry+0x54/0x60 [ 14.072913][ C0] rest_init+0x14b/0x260 [ 14.072916][ C0] start_kernel+0x350/0x410 [ 14.072920][ C0] x86_64_start_reservations+0x18/0x30 [ 14.072924][ C0] x86_64_start_kernel+0xba/0x110 [ 14.072927][ C0] common_startup_64+0x13e/0x148 [ 14.072935][ C0] [ 15.624687][ C1] BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1576 [ 15.625063][ C1] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 0, name: swapper/1 [ 15.625349][ C1] preempt_count: 101, expected: 0 [ 15.625511][ C1] RCU nest depth: 0, expected: 0 [ 15.625675][ C1] INFO: lockdep is turned off. [ 15.625850][ C1] Preemption disabled at: [ 15.625852][ C1] [<0000000000000000>] 0x0 [ 15.626144][ C1] CPU: 1 UID: 0 PID: 0 Comm: swapper/1 Tainted: G W 6.15.0-rc5-virtme #1 PREEMPT(full) [ 15.626150][ C1] Tainted: [W]=WARN [ 15.626151][ C1] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 15.626153][ C1] Call Trace: [ 15.626155][ C1] [ 15.626157][ C1] dump_stack_lvl+0xb0/0xd0 [ 15.626165][ C1] __might_resched+0x360/0x5a0 [ 15.626171][ C1] down_write+0x72/0x210 [ 15.626175][ C1] ? __pfx_down_write+0x10/0x10 [ 15.626178][ C1] ? simple_recursive_removal+0x3a/0x860 [ 15.626182][ C1] ? rcu_is_watching+0x12/0xc0 [ 15.626188][ C1] ? do_raw_spin_unlock+0x58/0x220 [ 15.626192][ C1] simple_recursive_removal+0x166/0x860 [ 15.626195][ C1] ? __pfx_remove_one+0x10/0x10 [ 15.626199][ C1] ? do_raw_spin_unlock+0x58/0x220 [ 15.626204][ C1] debugfs_remove+0x44/0x70 [ 15.626207][ C1] ref_tracker_dir_exit+0xcf/0x740 [ 15.626212][ C1] ? __pfx_ref_tracker_free+0x10/0x10 [ 15.626215][ C1] ? __sk_destruct+0x383/0x780 [ 15.626221][ C1] ? rcu_do_batch+0x34c/0xf20 [ 15.626225][ C1] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 15.626228][ C1] ? irq_exit_rcu+0xe/0x30 [ 15.626232][ C1] ? sysvec_apic_timer_interrupt+0xa8/0xc0 [ 15.626236][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 15.626240][ C1] ? pv_native_safe_halt+0xf/0x20 [ 15.626243][ C1] ? default_idle+0x9/0x10 [ 15.626246][ C1] ? default_idle_call+0x6d/0xb0 [ 15.626248][ C1] ? cpuidle_idle_call+0x26f/0x3a0 [ 15.626253][ C1] ? do_idle+0xf6/0x160 [ 15.626256][ C1] ? cpu_startup_entry+0x54/0x60 [ 15.626259][ C1] ? start_secondary+0x213/0x2a0 [ 15.626264][ C1] ? common_startup_64+0x13e/0x148 [ 15.626268][ C1] ? bpf_sk_storage_free+0x9f/0x1c0 [ 15.626272][ C1] ? rcu_is_watching+0x12/0xc0 [ 15.626277][ C1] __put_net+0x19/0x60 [ 15.626280][ C1] __sk_destruct+0x58a/0x780 [ 15.626283][ C1] ? rcu_do_batch+0x34a/0xf20 [ 15.626287][ C1] rcu_do_batch+0x34c/0xf20 [ 15.626292][ C1] ? __pfx_rcu_do_batch+0x10/0x10 [ 15.626295][ C1] ? trace_irq_enable.constprop.0+0xd4/0x130 [ 15.626300][ C1] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 15.626305][ C1] rcu_core+0x2bb/0x500 [ 15.626309][ C1] handle_softirqs+0x218/0x620 [ 15.626314][ C1] __irq_exit_rcu+0xfa/0x160 [ 15.626316][ C1] irq_exit_rcu+0xe/0x30 [ 15.626318][ C1] sysvec_apic_timer_interrupt+0xa8/0xc0 [ 15.626322][ C1] [ 15.626323][ C1] [ 15.626324][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 15.626327][ C1] RIP: 0010:pv_native_safe_halt+0xf/0x20 [ 15.626331][ C1] Code: b0 b8 00 c3 cc cc cc cc 0f 1f 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d a3 d0 13 00 fb f4 cc cc cc cc 66 2e 0f 1f 84 00 00 00 00 00 66 90 90 90 90 90 90 [ 15.626333][ C1] RSP: 0018:ffffc90000137de8 EFLAGS: 00000246 [ 15.626337][ C1] RAX: 0000000000000001 RBX: 1ffff92000026fc1 RCX: ffffffff9ff55a19 [ 15.626339][ C1] RDX: ffffed1006c1667b RSI: ffffffffa0250c60 RDI: ffffffff9d784d8f [ 15.626341][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006c1667a [ 15.626343][ C1] R10: ffff8880360b33d3 R11: ffff8880057d8558 R12: 0000000000000000 [ 15.626345][ C1] R13: ffff888001bb0040 R14: dffffc0000000000 R15: 0000000000000000 [ 15.626349][ C1] ? ct_kernel_exit.constprop.0+0x109/0x160 [ 15.626353][ C1] ? cpuidle_idle_call+0x26f/0x3a0 [ 15.626357][ C1] default_idle+0x9/0x10 [ 15.626359][ C1] default_idle_call+0x6d/0xb0 [ 15.626362][ C1] cpuidle_idle_call+0x26f/0x3a0 [ 15.626365][ C1] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 15.626369][ C1] ? tsc_verify_tsc_adjust+0x98/0x300 [ 15.626374][ C1] do_idle+0xf6/0x160 [ 15.626378][ C1] cpu_startup_entry+0x54/0x60 [ 15.626381][ C1] start_secondary+0x213/0x2a0 [ 15.626385][ C1] ? __pfx_start_secondary+0x10/0x10 [ 15.626390][ C1] common_startup_64+0x13e/0x148 [ 15.626396][ C1]