[ 14.629804][ T226] TCP: tun0: Driver has suspect GRO implementation, TCP performance may be compromised. [ 14.718466][ C3] [ 14.718644][ C3] ================================ [ 14.718815][ C3] WARNING: inconsistent lock state [ 14.718979][ C3] 6.15.0-virtme #1 Not tainted [ 14.719146][ C3] -------------------------------- [ 14.719311][ C3] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 14.719512][ C3] ksoftirqd/3/32 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 14.719717][ C3] ffffffffbb7c5af8 (pin_fs_lock){+.?.}-{3:3}, at: simple_pin_fs+0x24/0x150 [ 14.720012][ C3] {SOFTIRQ-ON-W} state was registered at: [ 14.720174][ C3] __lock_acquire+0x20b/0x7e0 [ 14.720341][ C3] lock_acquire.part.0+0xb6/0x240 [ 14.720504][ C3] _raw_spin_lock+0x33/0x40 [ 14.720671][ C3] simple_pin_fs+0x24/0x150 [ 14.720839][ C3] start_creating.part.0+0x52/0x310 [ 14.721004][ C3] debugfs_create_dir+0x6a/0x540 [ 14.721168][ C3] component_debug_init+0x17/0x30 [ 14.721337][ C3] do_one_initcall+0x8f/0x1e0 [ 14.721503][ C3] do_initcalls+0x176/0x280 [ 14.721668][ C3] kernel_init_freeable+0x22d/0x300 [ 14.721831][ C3] kernel_init+0x20/0x200 [ 14.721995][ C3] ret_from_fork+0x240/0x320 [ 14.722160][ C3] ret_from_fork_asm+0x1a/0x30 [ 14.722325][ C3] irq event stamp: 171330 [ 14.722451][ C3] hardirqs last enabled at (171330): [] _raw_spin_unlock_irqrestore+0x5d/0x80 [ 14.722777][ C3] hardirqs last disabled at (171329): [] _raw_spin_lock_irqsave+0x5b/0x60 [ 14.723105][ C3] softirqs last enabled at (170536): [] handle_softirqs+0x358/0x620 [ 14.723392][ C3] softirqs last disabled at (170539): [] run_ksoftirqd+0x3f/0x70 [ 14.723677][ C3] [ 14.723677][ C3] other info that might help us debug this: [ 14.723918][ C3] Possible unsafe locking scenario: [ 14.723918][ C3] [ 14.724158][ C3] CPU0 [ 14.724281][ C3] ---- [ 14.724402][ C3] lock(pin_fs_lock); [ 14.724529][ C3] [ 14.724651][ C3] lock(pin_fs_lock); [ 14.724778][ C3] [ 14.724778][ C3] *** DEADLOCK *** [ 14.724778][ C3] [ 14.725018][ C3] 1 lock held by ksoftirqd/3/32: [ 14.725184][ C3] #0: ffffffffbb5774c0 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x2e4/0xf20 [ 14.725476][ C3] [ 14.725476][ C3] stack backtrace: [ 14.725678][ C3] CPU: 3 UID: 0 PID: 32 Comm: ksoftirqd/3 Not tainted 6.15.0-virtme #1 PREEMPT(full) [ 14.725682][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 14.725684][ C3] Call Trace: [ 14.725686][ C3] [ 14.725688][ C3] dump_stack_lvl+0x82/0xd0 [ 14.725694][ C3] print_usage_bug.part.0+0x25f/0x360 [ 14.725698][ C3] mark_lock_irq+0x343/0x400 [ 14.725703][ C3] ? __pfx_unwind_next_frame+0x10/0x10 [ 14.725707][ C3] ? save_trace+0x52/0x170 [ 14.725713][ C3] mark_lock+0x174/0x2f0 [ 14.725716][ C3] mark_usage+0x46/0x150 [ 14.725719][ C3] __lock_acquire+0x20b/0x7e0 [ 14.725722][ C3] ? __lock_acquire+0x44d/0x7e0 [ 14.725726][ C3] lock_acquire.part.0+0xb6/0x240 [ 14.725729][ C3] ? simple_pin_fs+0x24/0x150 [ 14.725733][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.725738][ C3] ? lock_acquire+0x10c/0x170 [ 14.725740][ C3] ? simple_pin_fs+0x24/0x150 [ 14.725744][ C3] _raw_spin_lock+0x33/0x40 [ 14.725748][ C3] ? simple_pin_fs+0x24/0x150 [ 14.725751][ C3] simple_pin_fs+0x24/0x150 [ 14.725755][ C3] debugfs_remove+0x35/0x70 [ 14.725758][ C3] ref_tracker_dir_exit+0xcf/0x740 [ 14.725764][ C3] ? __pfx_ref_tracker_free+0x10/0x10 [ 14.725767][ C3] ? __sk_destruct+0x383/0x780 [ 14.725773][ C3] ? rcu_do_batch+0x34c/0xf20 [ 14.725775][ C3] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 14.725779][ C3] ? smpboot_thread_fn+0x30a/0x960 [ 14.725783][ C3] ? kthread+0x37e/0x600 [ 14.725786][ C3] ? ret_from_fork+0x240/0x320 [ 14.725788][ C3] ? ret_from_fork_asm+0x1a/0x30 [ 14.725791][ C3] ? migrate_enable+0x1f2/0x270 [ 14.725795][ C3] ? __pfx_migrate_enable+0x10/0x10 [ 14.725800][ C3] __put_net+0x19/0x60 [ 14.725803][ C3] __sk_destruct+0x58a/0x780 [ 14.725808][ C3] ? rcu_do_batch+0x34a/0xf20 [ 14.725810][ C3] rcu_do_batch+0x34c/0xf20 [ 14.725814][ C3] ? __pfx_rcu_do_batch+0x10/0x10 [ 14.725818][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.725820][ C3] ? note_gp_changes+0x182/0x1e0 [ 14.725823][ C3] ? lockdep_hardirqs_on+0x7c/0x110 [ 14.725828][ C3] rcu_core+0x2bb/0x500 [ 14.725831][ C3] handle_softirqs+0x218/0x620 [ 14.725835][ C3] ? __pfx_run_ksoftirqd+0x10/0x10 [ 14.725839][ C3] run_ksoftirqd+0x3f/0x70 [ 14.725842][ C3] smpboot_thread_fn+0x30a/0x960 [ 14.725845][ C3] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 14.725849][ C3] kthread+0x37e/0x600 [ 14.725852][ C3] ? __pfx_kthread+0x10/0x10 [ 14.725854][ C3] ? ret_from_fork+0x1b/0x320 [ 14.725856][ C3] ? __lock_release+0x5d/0x170 [ 14.725859][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.725862][ C3] ? __pfx_kthread+0x10/0x10 [ 14.725865][ C3] ret_from_fork+0x240/0x320 [ 14.725868][ C3] ? __pfx_kthread+0x10/0x10 [ 14.725870][ C3] ret_from_fork_asm+0x1a/0x30 [ 14.725877][ C3] [ 14.735194][ C3] BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1576 [ 14.735460][ C3] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 32, name: ksoftirqd/3 [ 14.735730][ C3] preempt_count: 100, expected: 0 [ 14.735887][ C3] RCU nest depth: 0, expected: 0 [ 14.736046][ C3] INFO: lockdep is turned off. [ 14.736221][ C3] Preemption disabled at: [ 14.736223][ C3] [] handle_softirqs+0xe5/0x620 [ 14.736554][ C3] CPU: 3 UID: 0 PID: 32 Comm: ksoftirqd/3 Not tainted 6.15.0-virtme #1 PREEMPT(full) [ 14.736558][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 14.736560][ C3] Call Trace: [ 14.736561][ C3] [ 14.736563][ C3] dump_stack_lvl+0xb0/0xd0 [ 14.736568][ C3] __might_resched+0x360/0x5a0 [ 14.736574][ C3] down_write+0x72/0x210 [ 14.736578][ C3] ? __pfx_down_write+0x10/0x10 [ 14.736581][ C3] ? simple_recursive_removal+0x33/0x610 [ 14.736584][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.736591][ C3] ? do_raw_spin_unlock+0x58/0x220 [ 14.736596][ C3] simple_recursive_removal+0x6a/0x610 [ 14.736599][ C3] ? do_raw_spin_unlock+0x58/0x220 [ 14.736602][ C3] ? __pfx_remove_one+0x10/0x10 [ 14.736606][ C3] debugfs_remove+0x44/0x70 [ 14.736609][ C3] ref_tracker_dir_exit+0xcf/0x740 [ 14.736614][ C3] ? __pfx_ref_tracker_free+0x10/0x10 [ 14.736617][ C3] ? __sk_destruct+0x383/0x780 [ 14.736621][ C3] ? rcu_do_batch+0x34c/0xf20 [ 14.736624][ C3] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 14.736627][ C3] ? smpboot_thread_fn+0x30a/0x960 [ 14.736631][ C3] ? kthread+0x37e/0x600 [ 14.736633][ C3] ? ret_from_fork+0x240/0x320 [ 14.736636][ C3] ? ret_from_fork_asm+0x1a/0x30 [ 14.736640][ C3] ? migrate_enable+0x1f2/0x270 [ 14.736643][ C3] ? __pfx_migrate_enable+0x10/0x10 [ 14.736649][ C3] __put_net+0x19/0x60 [ 14.736652][ C3] __sk_destruct+0x58a/0x780 [ 14.736656][ C3] ? rcu_do_batch+0x34a/0xf20 [ 14.736658][ C3] rcu_do_batch+0x34c/0xf20 [ 14.736663][ C3] ? __pfx_rcu_do_batch+0x10/0x10 [ 14.736666][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.736669][ C3] ? note_gp_changes+0x182/0x1e0 [ 14.736671][ C3] ? lockdep_hardirqs_on+0x7c/0x110 [ 14.736675][ C3] rcu_core+0x2bb/0x500 [ 14.736679][ C3] handle_softirqs+0x218/0x620 [ 14.736683][ C3] ? __pfx_run_ksoftirqd+0x10/0x10 [ 14.736687][ C3] run_ksoftirqd+0x3f/0x70 [ 14.736690][ C3] smpboot_thread_fn+0x30a/0x960 [ 14.736693][ C3] ? __pfx_smpboot_thread_fn+0x10/0x10 [ 14.736697][ C3] kthread+0x37e/0x600 [ 14.736700][ C3] ? __pfx_kthread+0x10/0x10 [ 14.736702][ C3] ? ret_from_fork+0x1b/0x320 [ 14.736705][ C3] ? __lock_release+0x5d/0x170 [ 14.736708][ C3] ? rcu_is_watching+0x12/0xc0 [ 14.736711][ C3] ? __pfx_kthread+0x10/0x10 [ 14.736714][ C3] ret_from_fork+0x240/0x320 [ 14.736717][ C3] ? __pfx_kthread+0x10/0x10 [ 14.736727][ C3] ret_from_fork_asm+0x1a/0x30 [ 14.736734][ C3] [ 16.420364][ C2] BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1576 [ 16.420744][ C2] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 0, name: swapper/2 [ 16.421056][ C2] preempt_count: 101, expected: 0 [ 16.421237][ C2] RCU nest depth: 0, expected: 0 [ 16.421416][ C2] INFO: lockdep is turned off. [ 16.421601][ C2] Preemption disabled at: [ 16.421603][ C2] [<0000000000000000>] 0x0 [ 16.421930][ C2] CPU: 2 UID: 0 PID: 0 Comm: swapper/2 Tainted: G W 6.15.0-virtme #1 PREEMPT(full) [ 16.421936][ C2] Tainted: [W]=WARN [ 16.421938][ C2] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 16.421939][ C2] Call Trace: [ 16.421941][ C2] [ 16.421943][ C2] dump_stack_lvl+0xb0/0xd0 [ 16.421952][ C2] __might_resched+0x360/0x5a0 [ 16.421959][ C2] down_write+0x72/0x210 [ 16.421963][ C2] ? __pfx_down_write+0x10/0x10 [ 16.421966][ C2] ? simple_recursive_removal+0x33/0x610 [ 16.421970][ C2] ? rcu_is_watching+0x12/0xc0 [ 16.421975][ C2] ? do_raw_spin_unlock+0x58/0x220 [ 16.421981][ C2] simple_recursive_removal+0x6a/0x610 [ 16.421984][ C2] ? do_raw_spin_unlock+0x58/0x220 [ 16.421987][ C2] ? __pfx_remove_one+0x10/0x10 [ 16.421992][ C2] debugfs_remove+0x44/0x70 [ 16.421995][ C2] ref_tracker_dir_exit+0xcf/0x740 [ 16.422001][ C2] ? __pfx_ref_tracker_free+0x10/0x10 [ 16.422004][ C2] ? __sk_destruct+0x383/0x780 [ 16.422010][ C2] ? rcu_do_batch+0x34c/0xf20 [ 16.422013][ C2] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 16.422016][ C2] ? irq_exit_rcu+0xe/0x30 [ 16.422021][ C2] ? sysvec_apic_timer_interrupt+0xa8/0xc0 [ 16.422026][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 16.422030][ C2] ? pv_native_safe_halt+0xf/0x20 [ 16.422033][ C2] ? default_idle+0x9/0x10 [ 16.422036][ C2] ? default_idle_call+0x6d/0xb0 [ 16.422038][ C2] ? cpuidle_idle_call+0x26f/0x3a0 [ 16.422041][ C2] ? do_idle+0xf6/0x160 [ 16.422044][ C2] ? cpu_startup_entry+0x54/0x60 [ 16.422046][ C2] ? start_secondary+0x213/0x2a0 [ 16.422049][ C2] ? common_startup_64+0x13e/0x148 [ 16.422055][ C2] ? bpf_sk_storage_free+0x9f/0x1c0 [ 16.422059][ C2] ? rcu_is_watching+0x12/0xc0 [ 16.422063][ C2] __put_net+0x19/0x60 [ 16.422067][ C2] __sk_destruct+0x58a/0x780 [ 16.422071][ C2] ? rcu_do_batch+0x34a/0xf20 [ 16.422074][ C2] rcu_do_batch+0x34c/0xf20 [ 16.422078][ C2] ? __pfx_rcu_do_batch+0x10/0x10 [ 16.422082][ C2] ? trace_irq_enable.constprop.0+0xd4/0x130 [ 16.422087][ C2] ? _raw_spin_unlock_irqrestore+0x46/0x80 [ 16.422093][ C2] rcu_core+0x2bb/0x500 [ 16.422098][ C2] handle_softirqs+0x218/0x620 [ 16.422103][ C2] __irq_exit_rcu+0xfa/0x160 [ 16.422106][ C2] irq_exit_rcu+0xe/0x30 [ 16.422109][ C2] sysvec_apic_timer_interrupt+0xa8/0xc0 [ 16.422112][ C2] [ 16.422113][ C2] [ 16.422115][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 16.422118][ C2] RIP: 0010:pv_native_safe_halt+0xf/0x20 [ 16.422122][ C2] Code: a2 b5 00 c3 cc cc cc cc 0f 1f 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 83 47 10 00 fb f4 fc 54 02 00 66 2e 0f 1f 84 00 00 00 00 00 66 90 90 90 90 90 90 [ 16.422124][ C2] RSP: 0018:ffffc90000147de8 EFLAGS: 00000246 [ 16.422128][ C2] RAX: 0000000000000002 RBX: 1ffff92000028fc1 RCX: ffffffffba58f5d9 [ 16.422130][ C2] RDX: ffffed1005ea66fb RSI: ffffffffba853b60 RDI: ffffffffb7d8d18f [ 16.422132][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1005ea66fa [ 16.422133][ C2] R10: ffff88802f5337d3 R11: ffff888001ee2818 R12: 0000000000000000 [ 16.422135][ C2] R13: ffff888001bf2300 R14: dffffc0000000000 R15: 0000000000000000 [ 16.422139][ C2] ? ct_kernel_exit.constprop.0+0x109/0x160 [ 16.422142][ C2] ? cpuidle_idle_call+0x26f/0x3a0 [ 16.422145][ C2] default_idle+0x9/0x10 [ 16.422148][ C2] default_idle_call+0x6d/0xb0 [ 16.422150][ C2] cpuidle_idle_call+0x26f/0x3a0 [ 16.422153][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 16.422157][ C2] ? tsc_verify_tsc_adjust+0x98/0x310 [ 16.422161][ C2] do_idle+0xf6/0x160 [ 16.422164][ C2] cpu_startup_entry+0x54/0x60 [ 16.422167][ C2] start_secondary+0x213/0x2a0 [ 16.422170][ C2] ? __pfx_start_secondary+0x10/0x10 [ 16.422174][ C2] common_startup_64+0x13e/0x148 [ 16.422181][ C2]