[ 12.571762][ C2] [ 12.571934][ C2] ================================ [ 12.572143][ C2] WARNING: inconsistent lock state [ 12.572350][ C2] 6.15.0-rc5-virtme #1 Not tainted [ 12.572556][ C2] -------------------------------- [ 12.572761][ C2] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 12.573016][ C2] kworker/u16:1/67 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 12.573270][ C2] ffffffff9d1bf978 (pin_fs_lock){+.?.}-{3:3}, at: simple_pin_fs+0x24/0x150 [ 12.573635][ C2] {SOFTIRQ-ON-W} state was registered at: [ 12.573839][ C2] __lock_acquire+0x3eb/0x9d0 [ 12.574049][ C2] lock_acquire.part.0+0xb6/0x240 [ 12.574248][ C2] _raw_spin_lock+0x33/0x40 [ 12.574459][ C2] simple_pin_fs+0x24/0x150 [ 12.574661][ C2] start_creating.part.0+0x3f/0x2f0 [ 12.574866][ C2] debugfs_create_dir+0x6a/0x540 [ 12.575077][ C2] component_debug_init+0x17/0x30 [ 12.575286][ C2] do_one_initcall+0x8c/0x1e0 [ 12.575495][ C2] do_initcalls+0x176/0x280 [ 12.575698][ C2] kernel_init_freeable+0x22d/0x300 [ 12.575905][ C2] kernel_init+0x20/0x200 [ 12.576117][ C2] ret_from_fork+0x31/0x70 [ 12.576320][ C2] ret_from_fork_asm+0x1a/0x30 [ 12.576528][ C2] irq event stamp: 4130 [ 12.576681][ C2] hardirqs last enabled at (4130): [] _raw_spin_unlock_irqrestore+0x5d/0x80 [ 12.577083][ C2] hardirqs last disabled at (4129): [] _raw_spin_lock_irqsave+0x5b/0x60 [ 12.577440][ C2] softirqs last enabled at (2288): [] unregister_netdevice_many_notify+0xdd2/0x1bf0 [ 12.577845][ C2] softirqs last disabled at (2917): [] __irq_exit_rcu+0xfa/0x160 [ 12.578196][ C2] [ 12.578196][ C2] other info that might help us debug this: [ 12.578493][ C2] Possible unsafe locking scenario: [ 12.578493][ C2] [ 12.578788][ C2] CPU0 [ 12.578940][ C2] ---- [ 12.579094][ C2] lock(pin_fs_lock); [ 12.579245][ C2] [ 12.579394][ C2] lock(pin_fs_lock); [ 12.579543][ C2] [ 12.579543][ C2] *** DEADLOCK *** [ 12.579543][ C2] [ 12.579834][ C2] 6 locks held by kworker/u16:1/67: [ 12.580030][ C2] #0: ffff8880010ae548 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1690 [ 12.580430][ C2] #1: ffffc90000487d40 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xdf6/0x1690 [ 12.580810][ C2] #2: ffffffff9d821c90 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xae/0x810 [ 12.581166][ C2] #3: ffffffff9d83f108 (rtnl_mutex){+.+.}-{4:4}, at: ops_undo_list+0x636/0x8a0 [ 12.581524][ C2] #4: ffffffff9d61e2a8 (gdp_mutex){+.+.}-{4:4}, at: cleanup_glue_dir+0xb3/0x210 [ 12.581873][ C2] #5: ffffffff9cf74480 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x2e4/0xf20 [ 12.582232][ C2] [ 12.582232][ C2] stack backtrace: [ 12.582482][ C2] CPU: 2 UID: 0 PID: 67 Comm: kworker/u16:1 Not tainted 6.15.0-rc5-virtme #1 PREEMPT(full) [ 12.582487][ C2] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 12.582491][ C2] Workqueue: netns cleanup_net [ 12.582495][ C2] Call Trace: [ 12.582498][ C2] [ 12.582500][ C2] dump_stack_lvl+0x82/0xd0 [ 12.582508][ C2] print_usage_bug.part.0+0x25f/0x360 [ 12.582512][ C2] mark_lock_irq+0x343/0x400 [ 12.582516][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 12.582521][ C2] ? save_trace+0x52/0x170 [ 12.582527][ C2] mark_lock+0x174/0x2f0 [ 12.582530][ C2] mark_usage+0x46/0x150 [ 12.582533][ C2] __lock_acquire+0x3eb/0x9d0 [ 12.582538][ C2] lock_acquire.part.0+0xb6/0x240 [ 12.582540][ C2] ? simple_pin_fs+0x24/0x150 [ 12.582545][ C2] ? rcu_is_watching+0x12/0xc0 [ 12.582548][ C2] ? lock_acquire+0x10c/0x170 [ 12.582551][ C2] ? simple_pin_fs+0x24/0x150 [ 12.582554][ C2] _raw_spin_lock+0x33/0x40 [ 12.582558][ C2] ? simple_pin_fs+0x24/0x150 [ 12.582560][ C2] simple_pin_fs+0x24/0x150 [ 12.582563][ C2] debugfs_remove+0x35/0x70 [ 12.582568][ C2] ref_tracker_dir_exit+0xcf/0x740 [ 12.582575][ C2] ? __pfx_ref_tracker_free+0x10/0x10 [ 12.582578][ C2] ? __sk_destruct+0x383/0x780 [ 12.582585][ C2] ? rcu_do_batch+0x34c/0xf20 [ 12.582588][ C2] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 12.582592][ C2] ? irq_exit_rcu+0xe/0x30 [ 12.582595][ C2] ? sysvec_apic_timer_interrupt+0xa8/0xc0 [ 12.582599][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 12.582603][ C2] ? lock_acquire.part.0+0xf2/0x240 [ 12.582605][ C2] ? __mutex_lock+0x16b/0xcd0 [ 12.582610][ C2] ? cleanup_glue_dir+0xb3/0x210 [ 12.582613][ C2] ? device_del+0x5a3/0x8c0 [ 12.582617][ C2] ? unregister_netdevice_many_notify+0x44d/0x1bf0 [ 12.582621][ C2] ? ops_undo_list+0x723/0x8a0 [ 12.582623][ C2] ? cleanup_net+0x3a1/0x810 [ 12.582626][ C2] ? process_one_work+0xe40/0x1690 [ 12.582632][ C2] __put_net+0x19/0x60 [ 12.582634][ C2] __sk_destruct+0x58a/0x780 [ 12.582638][ C2] ? rcu_do_batch+0x34a/0xf20 [ 12.582641][ C2] rcu_do_batch+0x34c/0xf20 [ 12.582645][ C2] ? sched_balance_domains+0x273/0xc80 [ 12.582651][ C2] ? __pfx_rcu_do_batch+0x10/0x10 [ 12.582655][ C2] ? mark_held_locks+0x49/0x80 [ 12.582658][ C2] ? note_gp_changes+0x182/0x1e0 [ 12.582661][ C2] ? lockdep_hardirqs_on+0x7c/0x110 [ 12.582666][ C2] rcu_core+0x2bb/0x500 [ 12.582670][ C2] handle_softirqs+0x218/0x620 [ 12.582675][ C2] __irq_exit_rcu+0xfa/0x160 [ 12.582678][ C2] irq_exit_rcu+0xe/0x30 [ 12.582680][ C2] sysvec_apic_timer_interrupt+0xa8/0xc0 [ 12.582684][ C2] [ 12.582685][ C2] [ 12.582687][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 12.582689][ C2] RIP: 0010:lock_acquire.part.0+0xf2/0x240 [ 12.582693][ C2] Code: ff ff ff 65 0f c1 05 9d 53 13 05 83 f8 01 0f 85 3e 01 00 00 9c 58 f6 c4 02 0f 85 29 01 00 00 48 85 db 74 01 fb 48 8b 44 24 30 <65> 48 2b 05 0e 17 13 05 0f 85 3a 01 00 00 48 83 c4 38 5b 5d 41 5c [ 12.582695][ C2] RSP: 0018:ffffc900004876b8 EFLAGS: 00000206 [ 12.582699][ C2] RAX: 24d476ff7c811600 RBX: 0000000000000200 RCX: 0000000000000001 [ 12.582701][ C2] RDX: 0000000000000000 RSI: ffffffff9ca7168b RDI: ffffffff9c250e20 [ 12.582703][ C2] RBP: 0000000000000001 R08: 0000000000000001 R09: 0000000000000001 [ 12.582704][ C2] R10: ffffc90000487588 R11: ffffffff9d61e2a8 R12: 0000000000000000 [ 12.582706][ C2] R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff9d61e2a8 [ 12.582712][ C2] ? rcu_is_watching+0x12/0xc0 [ 12.582714][ C2] ? lock_acquire+0x10c/0x170 [ 12.582716][ C2] ? cleanup_glue_dir+0xb3/0x210 [ 12.582721][ C2] __mutex_lock+0x16b/0xcd0 [ 12.582724][ C2] ? cleanup_glue_dir+0xb3/0x210 [ 12.582727][ C2] ? __lock_acquire+0x591/0x9d0 [ 12.582730][ C2] ? cleanup_glue_dir+0xb3/0x210 [ 12.582733][ C2] ? __pfx___mutex_lock+0x10/0x10 [ 12.582738][ C2] ? find_held_lock+0x2b/0x80 [ 12.582742][ C2] ? class_to_subsys+0xd9/0x110 [ 12.582745][ C2] ? __lock_release+0x5d/0x170 [ 12.582749][ C2] ? do_raw_spin_unlock+0x58/0x220 [ 12.582753][ C2] ? cleanup_glue_dir+0xb3/0x210 [ 12.582756][ C2] cleanup_glue_dir+0xb3/0x210 [ 12.582760][ C2] device_del+0x5a3/0x8c0 [ 12.582764][ C2] ? __pfx_device_del+0x10/0x10 [ 12.582769][ C2] ? netdev_unregister_kobject+0x2d5/0x380 [ 12.582776][ C2] unregister_netdevice_many_notify+0x44d/0x1bf0 [ 12.582782][ C2] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 12.582785][ C2] ? rtnl_is_locked+0x15/0x20 [ 12.582791][ C2] ? unregister_netdevice_queue+0x6f/0x410 [ 12.582794][ C2] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 12.582799][ C2] ? lockdep_rtnl_is_held+0x1a/0x30 [ 12.582802][ C2] ? sit_exit_rtnl_net+0x2e1/0x3e0 [ 12.582808][ C2] ops_undo_list+0x723/0x8a0 [ 12.582813][ C2] ? __pfx_ops_undo_list+0x10/0x10 [ 12.582816][ C2] ? __local_bh_enable_ip+0xa9/0x130 [ 12.582820][ C2] cleanup_net+0x3a1/0x810 [ 12.582823][ C2] ? __pfx_cleanup_net+0x10/0x10 [ 12.582827][ C2] ? rcu_is_watching+0x12/0xc0 [ 12.582830][ C2] process_one_work+0xe40/0x1690 [ 12.582837][ C2] ? __pfx_process_one_work+0x10/0x10 [ 12.582843][ C2] ? assign_work+0x16c/0x240 [ 12.582848][ C2] worker_thread+0x591/0xcf0 [ 12.582854][ C2] ? __pfx_worker_thread+0x10/0x10 [ 12.582858][ C2] kthread+0x37b/0x600 [ 12.582864][ C2] ? __pfx_kthread+0x10/0x10 [ 12.582867][ C2] ? ret_from_fork+0x1b/0x70 [ 12.582871][ C2] ? __lock_release+0x5d/0x170 [ 12.582874][ C2] ? rcu_is_watching+0x12/0xc0 [ 12.582877][ C2] ? __pfx_kthread+0x10/0x10 [ 12.582880][ C2] ret_from_fork+0x31/0x70 [ 12.582883][ C2] ? __pfx_kthread+0x10/0x10 [ 12.582886][ C2] ret_from_fork_asm+0x1a/0x30 [ 12.582895][ C2] [ 12.605737][ C2] BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1576 [ 12.606093][ C2] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 67, name: kworker/u16:1 [ 12.606434][ C2] preempt_count: 101, expected: 0 [ 12.606646][ C2] RCU nest depth: 0, expected: 0 [ 12.606851][ C2] INFO: lockdep is turned off. [ 12.607053][ C2] Preemption disabled at: [ 12.607055][ C2] [] __mutex_lock+0x141/0xcd0 [ 12.607471][ C2] CPU: 2 UID: 0 PID: 67 Comm: kworker/u16:1 Not tainted 6.15.0-rc5-virtme #1 PREEMPT(full) [ 12.607476][ C2] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 12.607478][ C2] Workqueue: netns cleanup_net [ 12.607485][ C2] Call Trace: [ 12.607487][ C2] [ 12.607489][ C2] dump_stack_lvl+0xb0/0xd0 [ 12.607496][ C2] __might_resched+0x360/0x5a0 [ 12.607503][ C2] down_write+0x72/0x210 [ 12.607506][ C2] ? __pfx_down_write+0x10/0x10 [ 12.607509][ C2] ? simple_recursive_removal+0x3a/0x860 [ 12.607515][ C2] ? rcu_is_watching+0x12/0xc0 [ 12.607520][ C2] ? do_raw_spin_unlock+0x58/0x220 [ 12.607526][ C2] simple_recursive_removal+0x166/0x860 [ 12.607529][ C2] ? __pfx_remove_one+0x10/0x10 [ 12.607534][ C2] ? do_raw_spin_unlock+0x58/0x220 [ 12.607539][ C2] debugfs_remove+0x44/0x70 [ 12.607542][ C2] ref_tracker_dir_exit+0xcf/0x740 [ 12.607549][ C2] ? __pfx_ref_tracker_free+0x10/0x10 [ 12.607552][ C2] ? __sk_destruct+0x383/0x780 [ 12.607557][ C2] ? rcu_do_batch+0x34c/0xf20 [ 12.607563][ C2] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 12.607566][ C2] ? irq_exit_rcu+0xe/0x30 [ 12.607571][ C2] ? sysvec_apic_timer_interrupt+0xa8/0xc0 [ 12.607575][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 12.607579][ C2] ? lock_acquire.part.0+0xf2/0x240 [ 12.607582][ C2] ? __mutex_lock+0x16b/0xcd0 [ 12.607585][ C2] ? cleanup_glue_dir+0xb3/0x210 [ 12.607591][ C2] ? device_del+0x5a3/0x8c0 [ 12.607594][ C2] ? unregister_netdevice_many_notify+0x44d/0x1bf0 [ 12.607599][ C2] ? ops_undo_list+0x723/0x8a0 [ 12.607602][ C2] ? cleanup_net+0x3a1/0x810 [ 12.607604][ C2] ? process_one_work+0xe40/0x1690 [ 12.607613][ C2] __put_net+0x19/0x60 [ 12.607617][ C2] __sk_destruct+0x58a/0x780 [ 12.607621][ C2] ? rcu_do_batch+0x34a/0xf20 [ 12.607624][ C2] rcu_do_batch+0x34c/0xf20 [ 12.607628][ C2] ? sched_balance_domains+0x273/0xc80 [ 12.607633][ C2] ? __pfx_rcu_do_batch+0x10/0x10 [ 12.607637][ C2] ? mark_held_locks+0x49/0x80 [ 12.607640][ C2] ? note_gp_changes+0x182/0x1e0 [ 12.607644][ C2] ? lockdep_hardirqs_on+0x7c/0x110 [ 12.607648][ C2] rcu_core+0x2bb/0x500 [ 12.607652][ C2] handle_softirqs+0x218/0x620 [ 12.607657][ C2] __irq_exit_rcu+0xfa/0x160 [ 12.607660][ C2] irq_exit_rcu+0xe/0x30 [ 12.607662][ C2] sysvec_apic_timer_interrupt+0xa8/0xc0 [ 12.607666][ C2] [ 12.607667][ C2] [ 12.607668][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 12.607671][ C2] RIP: 0010:lock_acquire.part.0+0xf2/0x240 [ 12.607674][ C2] Code: ff ff ff 65 0f c1 05 9d 53 13 05 83 f8 01 0f 85 3e 01 00 00 9c 58 f6 c4 02 0f 85 29 01 00 00 48 85 db 74 01 fb 48 8b 44 24 30 <65> 48 2b 05 0e 17 13 05 0f 85 3a 01 00 00 48 83 c4 38 5b 5d 41 5c [ 12.607677][ C2] RSP: 0018:ffffc900004876b8 EFLAGS: 00000206 [ 12.607680][ C2] RAX: 24d476ff7c811600 RBX: 0000000000000200 RCX: 0000000000000001 [ 12.607682][ C2] RDX: 0000000000000000 RSI: ffffffff9ca7168b RDI: ffffffff9c250e20 [ 12.607684][ C2] RBP: 0000000000000001 R08: 0000000000000001 R09: 0000000000000001 [ 12.607685][ C2] R10: ffffc90000487588 R11: ffffffff9d61e2a8 R12: 0000000000000000 [ 12.607687][ C2] R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff9d61e2a8 [ 12.607692][ C2] ? rcu_is_watching+0x12/0xc0 [ 12.607695][ C2] ? lock_acquire+0x10c/0x170 [ 12.607697][ C2] ? cleanup_glue_dir+0xb3/0x210 [ 12.607702][ C2] __mutex_lock+0x16b/0xcd0 [ 12.607705][ C2] ? cleanup_glue_dir+0xb3/0x210 [ 12.607708][ C2] ? __lock_acquire+0x591/0x9d0 [ 12.607711][ C2] ? cleanup_glue_dir+0xb3/0x210 [ 12.607714][ C2] ? __pfx___mutex_lock+0x10/0x10 [ 12.607718][ C2] ? find_held_lock+0x2b/0x80 [ 12.607722][ C2] ? class_to_subsys+0xd9/0x110 [ 12.607726][ C2] ? __lock_release+0x5d/0x170 [ 12.607729][ C2] ? do_raw_spin_unlock+0x58/0x220 [ 12.607733][ C2] ? cleanup_glue_dir+0xb3/0x210 [ 12.607736][ C2] cleanup_glue_dir+0xb3/0x210 [ 12.607740][ C2] device_del+0x5a3/0x8c0 [ 12.607744][ C2] ? __pfx_device_del+0x10/0x10 [ 12.607749][ C2] ? netdev_unregister_kobject+0x2d5/0x380 [ 12.607755][ C2] unregister_netdevice_many_notify+0x44d/0x1bf0 [ 12.607761][ C2] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 12.607764][ C2] ? rtnl_is_locked+0x15/0x20 [ 12.607770][ C2] ? unregister_netdevice_queue+0x6f/0x410 [ 12.607773][ C2] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 12.607779][ C2] ? lockdep_rtnl_is_held+0x1a/0x30 [ 12.607781][ C2] ? sit_exit_rtnl_net+0x2e1/0x3e0 [ 12.607787][ C2] ops_undo_list+0x723/0x8a0 [ 12.607791][ C2] ? __pfx_ops_undo_list+0x10/0x10 [ 12.607795][ C2] ? __local_bh_enable_ip+0xa9/0x130 [ 12.607798][ C2] cleanup_net+0x3a1/0x810 [ 12.607802][ C2] ? __pfx_cleanup_net+0x10/0x10 [ 12.607805][ C2] ? rcu_is_watching+0x12/0xc0 [ 12.607809][ C2] process_one_work+0xe40/0x1690 [ 12.607815][ C2] ? __pfx_process_one_work+0x10/0x10 [ 12.607821][ C2] ? assign_work+0x16c/0x240 [ 12.607825][ C2] worker_thread+0x591/0xcf0 [ 12.607831][ C2] ? __pfx_worker_thread+0x10/0x10 [ 12.607835][ C2] kthread+0x37b/0x600 [ 12.607841][ C2] ? __pfx_kthread+0x10/0x10 [ 12.607843][ C2] ? ret_from_fork+0x1b/0x70 [ 12.607848][ C2] ? __lock_release+0x5d/0x170 [ 12.607850][ C2] ? rcu_is_watching+0x12/0xc0 [ 12.607853][ C2] ? __pfx_kthread+0x10/0x10 [ 12.607857][ C2] ret_from_fork+0x31/0x70 [ 12.607859][ C2] ? __pfx_kthread+0x10/0x10 [ 12.607862][ C2] ret_from_fork_asm+0x1a/0x30 [ 12.607871][ C2]