[ 14.238803][ T225] TCP: tun0: Driver has suspect GRO implementation, TCP performance may be compromised. [ 14.327349][ C3] [ 14.327460][ C3] ================================ [ 14.327658][ C3] WARNING: inconsistent lock state [ 14.327828][ C3] 6.15.0-virtme #1 Not tainted [ 14.328000][ C3] -------------------------------- [ 14.328174][ C3] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 14.328388][ C3] ksoftirqd/3/32 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 14.328631][ C3] ffffffff913c5af8 (pin_fs_lock){+.?.}-{3:3}, at: simple_pin_fs+0x24/0x150 [ 14.328942][ C3] {SOFTIRQ-ON-W} state was registered at: [ 14.329112][ C3] __lock_acquire+0x20b/0x7e0 [ 14.329289][ C3] lock_acquire.part.0+0xb6/0x240 [ 14.329462][ C3] _raw_spin_lock+0x33/0x40 [ 14.329636][ C3] simple_pin_fs+0x24/0x150 [ 14.329807][ C3] start_creating.part.0+0x52/0x310 [ 14.329982][ C3] debugfs_create_dir+0x6a/0x540 [ 14.330155][ C3] component_debug_init+0x17/0x30 [ 14.330332][ C3] do_one_initcall+0x8f/0x1e0 [ 14.330504][ C3] do_initcalls+0x176/0x280 [ 14.330675][ C3] kernel_init_freeable+0x22d/0x300 [ 14.330847][ C3] kernel_init+0x20/0x200 [ 14.331018][ C3] ret_from_fork+0x240/0x320 [ 14.331188][ C3] ret_from_fork_asm+0x1a/0x30 [ 14.331362][ C3] irq event stamp: 170104 [ 14.331489][ C3] hardirqs last enabled at (170104): [] _raw_spin_unlock_irqrestore+0x5d/0x80 [ 14.331829][ C3] hardirqs last disabled at (170103): [] _raw_spin_lock_irqsave+0x5b/0x60 [ 14.332165][ C3] softirqs last enabled at (169334): [] handle_softirqs+0x358/0x620 [ 14.332467][ C3] softirqs last disabled at (169345): [] run_ksoftirqd+0x3f/0x70 [ 14.332760][ C3] [ 14.332760][ C3] other info that might help us debug this: [ 14.333012][ C3] Possible unsafe locking scenario: [ 14.333012][ C3] [ 14.333261][ C3] CPU0 [ 14.333393][ C3] ---- [ 14.333521][ C3] lock(pin_fs_lock); [ 14.333652][ C3] [ 14.333780][ C3] lock(pin_fs_lock); [ 14.333911][ C3] [ 14.333911][ C3] *** DEADLOCK *** [ 14.333911][ C3] [ 14.334167][ C3] 1 lock held by ksoftirqd/3/32: [ 14.334341][ C3] #0: ffffffff911774c0 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x2e4/0xf20 [ 14.334647][ C3] [ 14.334647][ C3] stack backtrace: [ 14.334860][ C3] CPU: 3 UID: 0 PID: 32 Comm: ksoftirqd/3 Not tainted 6.15.0-virtme #1 PREEMPT(full) [ 14.334864][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 14.334867][ C3] Call Trace: [ 14.334869][ C3] [ 14.334871][ C3] dump_stack_lvl+0x82/0xd0 [ 14.334877][ C3] print_usage_bug.part.0+0x25f/0x360 [ 14.334881][ C3] mark_lock_irq+0x343/0x400 [ 14.334886][ C3] ? __pfx_unwind_next_frame+0x10/0x10 [ 14.334890][ C3] ? save_trace+0x52/0x170 [ 14.334897][ C3] mark_lock+0x174/0x2f0 [ 14.334901][ C3] mark_usage+0x46/0x150 [ 14.334904][ C3] __lock_acquire+0x20b/0x7e0 [ 14.334907][ C3] ? __lock_acquire+0x44d/0x7e0 [ 14.334911][ C3] lock_acquire.part.0+0xb6/0x240 [ 14.334914][ C3] ? simple_pin_fs+0x24/0x150 [ 14.334918][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.334922][ C3] ? lock_acquire+0x10c/0x170 [ 14.334925][ C3] ? simple_pin_fs+0x24/0x150 [ 14.334929][ C3] _raw_spin_lock+0x33/0x40 [ 14.334933][ C3] ? simple_pin_fs+0x24/0x150 [ 14.334936][ C3] simple_pin_fs+0x24/0x150 [ 14.334940][ C3] debugfs_remove+0x35/0x70 [ 14.334943][ C3] ref_tracker_dir_exit+0xcf/0x740 [ 14.334949][ C3] ? __pfx_ref_tracker_free+0x10/0x10 [ 14.334953][ C3] ? __sk_destruct+0x383/0x780 [ 14.334958][ C3] ? rcu_do_batch+0x34c/0xf20 [ 14.334961][ C3] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 14.334964][ C3] ? smpboot_thread_fn+0x30a/0x960 [ 14.334969][ C3] ? kthread+0x37e/0x600 [ 14.334972][ C3] ? ret_from_fork+0x240/0x320 [ 14.334974][ C3] ? ret_from_fork_asm+0x1a/0x30 [ 14.334978][ C3] ? migrate_enable+0x1f2/0x270 [ 14.334981][ C3] ? __pfx_migrate_enable+0x10/0x10 [ 14.334987][ C3] __put_net+0x19/0x60 [ 14.334991][ C3] __sk_destruct+0x58a/0x780 [ 14.334995][ C3] ? rcu_do_batch+0x34a/0xf20 [ 14.334998][ C3] rcu_do_batch+0x34c/0xf20 [ 14.335002][ C3] ? __pfx_rcu_do_batch+0x10/0x10 [ 14.335006][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.335008][ C3] ? note_gp_changes+0x182/0x1e0 [ 14.335011][ C3] ? lockdep_hardirqs_on+0x7c/0x110 [ 14.335016][ C3] rcu_core+0x2bb/0x500 [ 14.335020][ C3] handle_softirqs+0x218/0x620 [ 14.335024][ C3] ? __pfx_run_ksoftirqd+0x10/0x10 [ 14.335027][ C3] run_ksoftirqd+0x3f/0x70 [ 14.335030][ C3] smpboot_thread_fn+0x30a/0x960 [ 14.335034][ C3] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 14.335038][ C3] kthread+0x37e/0x600 [ 14.335041][ C3] ? __pfx_kthread+0x10/0x10 [ 14.335043][ C3] ? ret_from_fork+0x1b/0x320 [ 14.335045][ C3] ? __lock_release+0x5d/0x170 [ 14.335048][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.335051][ C3] ? __pfx_kthread+0x10/0x10 [ 14.335054][ C3] ret_from_fork+0x240/0x320 [ 14.335057][ C3] ? __pfx_kthread+0x10/0x10 [ 14.335059][ C3] ret_from_fork_asm+0x1a/0x30 [ 14.335067][ C3] [ 14.344652][ C3] BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1576 [ 14.344929][ C3] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 32, name: ksoftirqd/3 [ 14.345203][ C3] preempt_count: 100, expected: 0 [ 14.345358][ C3] RCU nest depth: 0, expected: 0 [ 14.345513][ C3] INFO: lockdep is turned off. [ 14.345668][ C3] Preemption disabled at: [ 14.345670][ C3] [] handle_softirqs+0xe5/0x620 [ 14.345989][ C3] CPU: 3 UID: 0 PID: 32 Comm: ksoftirqd/3 Not tainted 6.15.0-virtme #1 PREEMPT(full) [ 14.345993][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 14.345995][ C3] Call Trace: [ 14.345996][ C3] [ 14.345998][ C3] dump_stack_lvl+0xb0/0xd0 [ 14.346004][ C3] __might_resched+0x360/0x5a0 [ 14.346011][ C3] down_write+0x72/0x210 [ 14.346015][ C3] ? __pfx_down_write+0x10/0x10 [ 14.346017][ C3] ? simple_recursive_removal+0x33/0x610 [ 14.346021][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.346024][ C3] ? do_raw_spin_unlock+0x58/0x220 [ 14.346030][ C3] simple_recursive_removal+0x6a/0x610 [ 14.346032][ C3] ? do_raw_spin_unlock+0x58/0x220 [ 14.346036][ C3] ? __pfx_remove_one+0x10/0x10 [ 14.346041][ C3] debugfs_remove+0x44/0x70 [ 14.346044][ C3] ref_tracker_dir_exit+0xcf/0x740 [ 14.346049][ C3] ? __pfx_ref_tracker_free+0x10/0x10 [ 14.346052][ C3] ? __sk_destruct+0x383/0x780 [ 14.346056][ C3] ? rcu_do_batch+0x34c/0xf20 [ 14.346059][ C3] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 14.346062][ C3] ? smpboot_thread_fn+0x30a/0x960 [ 14.346065][ C3] ? kthread+0x37e/0x600 [ 14.346068][ C3] ? ret_from_fork+0x240/0x320 [ 14.346071][ C3] ? ret_from_fork_asm+0x1a/0x30 [ 14.346074][ C3] ? migrate_enable+0x1f2/0x270 [ 14.346078][ C3] ? __pfx_migrate_enable+0x10/0x10 [ 14.346084][ C3] __put_net+0x19/0x60 [ 14.346087][ C3] __sk_destruct+0x58a/0x780 [ 14.346091][ C3] ? rcu_do_batch+0x34a/0xf20 [ 14.346093][ C3] rcu_do_batch+0x34c/0xf20 [ 14.346098][ C3] ? __pfx_rcu_do_batch+0x10/0x10 [ 14.346101][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.346104][ C3] ? note_gp_changes+0x182/0x1e0 [ 14.346107][ C3] ? lockdep_hardirqs_on+0x7c/0x110 [ 14.346111][ C3] rcu_core+0x2bb/0x500 [ 14.346115][ C3] handle_softirqs+0x218/0x620 [ 14.346119][ C3] ? __pfx_run_ksoftirqd+0x10/0x10 [ 14.346122][ C3] run_ksoftirqd+0x3f/0x70 [ 14.346125][ C3] smpboot_thread_fn+0x30a/0x960 [ 14.346129][ C3] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 14.346133][ C3] kthread+0x37e/0x600 [ 14.346135][ C3] ? __pfx_kthread+0x10/0x10 [ 14.346138][ C3] ? ret_from_fork+0x1b/0x320 [ 14.346140][ C3] ? __lock_release+0x5d/0x170 [ 14.346144][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.346147][ C3] ? __pfx_kthread+0x10/0x10 [ 14.346149][ C3] ret_from_fork+0x240/0x320 [ 14.346152][ C3] ? __pfx_kthread+0x10/0x10 [ 14.346155][ C3] ret_from_fork_asm+0x1a/0x30 [ 14.346162][ C3] [ 15.926579][ C2] BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1576 [ 15.926956][ C2] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 0, name: swapper/2 [ 15.927272][ C2] preempt_count: 101, expected: 0 [ 15.927460][ C2] RCU nest depth: 0, expected: 0 [ 15.927659][ C2] INFO: lockdep is turned off. [ 15.927846][ C2] Preemption disabled at: [ 15.927848][ C2] [<0000000000000000>] 0x0 [ 15.928192][ C2] CPU: 2 UID: 0 PID: 0 Comm: swapper/2 Tainted: G W 6.15.0-virtme #1 PREEMPT(full) [ 15.928199][ C2] Tainted: [W]=WARN [ 15.928200][ C2] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 15.928202][ C2] Call Trace: [ 15.928204][ C2] [ 15.928206][ C2] dump_stack_lvl+0xb0/0xd0 [ 15.928214][ C2] __might_resched+0x360/0x5a0 [ 15.928221][ C2] down_write+0x72/0x210 [ 15.928226][ C2] ? __pfx_down_write+0x10/0x10 [ 15.928229][ C2] ? simple_recursive_removal+0x33/0x610 [ 15.928233][ C2] ? rcu_is_watching+0x12/0xc0 [ 15.928239][ C2] ? do_raw_spin_unlock+0x58/0x220 [ 15.928245][ C2] simple_recursive_removal+0x6a/0x610 [ 15.928248][ C2] ? do_raw_spin_unlock+0x58/0x220 [ 15.928251][ C2] ? __pfx_remove_one+0x10/0x10 [ 15.928256][ C2] debugfs_remove+0x44/0x70 [ 15.928259][ C2] ref_tracker_dir_exit+0xcf/0x740 [ 15.928265][ C2] ? __pfx_ref_tracker_free+0x10/0x10 [ 15.928268][ C2] ? __sk_destruct+0x383/0x780 [ 15.928274][ C2] ? rcu_do_batch+0x34c/0xf20 [ 15.928277][ C2] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 15.928280][ C2] ? irq_exit_rcu+0xe/0x30 [ 15.928285][ C2] ? sysvec_apic_timer_interrupt+0xa8/0xc0 [ 15.928290][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 15.928293][ C2] ? pv_native_safe_halt+0xf/0x20 [ 15.928297][ C2] ? default_idle+0x9/0x10 [ 15.928300][ C2] ? default_idle_call+0x6d/0xb0 [ 15.928302][ C2] ? cpuidle_idle_call+0x26f/0x3a0 [ 15.928306][ C2] ? do_idle+0xf6/0x160 [ 15.928308][ C2] ? cpu_startup_entry+0x54/0x60 [ 15.928311][ C2] ? start_secondary+0x213/0x2a0 [ 15.928315][ C2] ? common_startup_64+0x13e/0x148 [ 15.928320][ C2] ? bpf_sk_storage_free+0x9f/0x1c0 [ 15.928324][ C2] ? rcu_is_watching+0x12/0xc0 [ 15.928328][ C2] __put_net+0x19/0x60 [ 15.928333][ C2] __sk_destruct+0x58a/0x780 [ 15.928337][ C2] ? rcu_do_batch+0x34a/0xf20 [ 15.928339][ C2] rcu_do_batch+0x34c/0xf20 [ 15.928344][ C2] ? __pfx_rcu_do_batch+0x10/0x10 [ 15.928348][ C2] ? trace_irq_enable.constprop.0+0xd4/0x130 [ 15.928353][ C2] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 15.928359][ C2] rcu_core+0x2bb/0x500 [ 15.928365][ C2] handle_softirqs+0x218/0x620 [ 15.928370][ C2] __irq_exit_rcu+0xfa/0x160 [ 15.928373][ C2] irq_exit_rcu+0xe/0x30 [ 15.928376][ C2] sysvec_apic_timer_interrupt+0xa8/0xc0 [ 15.928380][ C2] [ 15.928381][ C2] [ 15.928382][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 15.928385][ C2] RIP: 0010:pv_native_safe_halt+0xf/0x20 [ 15.928390][ C2] Code: a2 b5 00 c3 cc cc cc cc 0f 1f 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 83 47 10 00 fb f4 fc 54 02 00 66 2e 0f 1f 84 00 00 00 00 00 66 90 90 90 90 90 90 [ 15.928392][ C2] RSP: 0000:ffffc90000147de8 EFLAGS: 00000246 [ 15.928397][ C2] RAX: 0000000000000002 RBX: 1ffff92000028fc1 RCX: ffffffff9018f5d9 [ 15.928399][ C2] RDX: ffffed1006c266fb RSI: ffffffff90453b60 RDI: ffffffff8d98d18f [ 15.928400][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006c266fa [ 15.928402][ C2] R10: ffff8880361337d3 R11: ffff888001ee2818 R12: 0000000000000000 [ 15.928404][ C2] R13: ffff888001bf2300 R14: dffffc0000000000 R15: 0000000000000000 [ 15.928408][ C2] ? ct_kernel_exit.constprop.0+0x109/0x160 [ 15.928411][ C2] ? cpuidle_idle_call+0x26f/0x3a0 [ 15.928415][ C2] default_idle+0x9/0x10 [ 15.928417][ C2] default_idle_call+0x6d/0xb0 [ 15.928420][ C2] cpuidle_idle_call+0x26f/0x3a0 [ 15.928423][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 15.928427][ C2] ? tsc_verify_tsc_adjust+0x98/0x310 [ 15.928431][ C2] do_idle+0xf6/0x160 [ 15.928435][ C2] cpu_startup_entry+0x54/0x60 [ 15.928438][ C2] start_secondary+0x213/0x2a0 [ 15.928440][ C2] ? __pfx_start_secondary+0x10/0x10 [ 15.928445][ C2] common_startup_64+0x13e/0x148 [ 15.928452][ C2]