[ 12.704667][ C3] [ 12.704826][ C3] ================================ [ 12.705056][ C3] WARNING: inconsistent lock state [ 12.705282][ C3] 6.15.0-virtme #1 Not tainted [ 12.705509][ C3] -------------------------------- [ 12.705737][ C3] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 12.706010][ C3] kworker/u16:1/66 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 12.706293][ C3] ffffffff985c5af8 (pin_fs_lock){+.?.}-{3:3}, at: simple_pin_fs+0x24/0x150 [ 12.706695][ C3] {SOFTIRQ-ON-W} state was registered at: [ 12.706918][ C3] __lock_acquire+0x20b/0x7e0 [ 12.707146][ C3] lock_acquire.part.0+0xb6/0x240 [ 12.707369][ C3] _raw_spin_lock+0x33/0x40 [ 12.707596][ C3] simple_pin_fs+0x24/0x150 [ 12.707819][ C3] start_creating.part.0+0x52/0x310 [ 12.708047][ C3] debugfs_create_dir+0x6a/0x540 [ 12.708269][ C3] component_debug_init+0x17/0x30 [ 12.708495][ C3] do_one_initcall+0x8f/0x1e0 [ 12.708721][ C3] do_initcalls+0x176/0x280 [ 12.708948][ C3] kernel_init_freeable+0x22d/0x300 [ 12.709174][ C3] kernel_init+0x20/0x200 [ 12.709398][ C3] ret_from_fork+0x240/0x320 [ 12.709626][ C3] ret_from_fork_asm+0x1a/0x30 [ 12.709848][ C3] irq event stamp: 3608 [ 12.710021][ C3] hardirqs last enabled at (3608): [] _raw_spin_unlock_irqrestore+0x5d/0x80 [ 12.710466][ C3] hardirqs last disabled at (3607): [] _raw_spin_lock_irqsave+0x5b/0x60 [ 12.710858][ C3] softirqs last enabled at (2038): [] handle_softirqs+0x358/0x620 [ 12.711251][ C3] softirqs last disabled at (2283): [] __irq_exit_rcu+0xfa/0x160 [ 12.711652][ C3] [ 12.711652][ C3] other info that might help us debug this: [ 12.711988][ C3] Possible unsafe locking scenario: [ 12.711988][ C3] [ 12.712318][ C3] CPU0 [ 12.712487][ C3] ---- [ 12.712656][ C3] lock(pin_fs_lock); [ 12.712830][ C3] [ 12.713000][ C3] lock(pin_fs_lock); [ 12.713172][ C3] [ 12.713172][ C3] *** DEADLOCK *** [ 12.713172][ C3] [ 12.713500][ C3] 5 locks held by kworker/u16:1/66: [ 12.713729][ C3] #0: ffff8880010ae548 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7e5/0x1660 [ 12.714206][ C3] #1: ffffc90000477d40 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xdf6/0x1660 [ 12.714603][ C3] #2: ffffffff98c2de10 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xae/0x810 [ 12.715004][ C3] #3: ffffffff98c4b408 (rtnl_mutex){+.+.}-{4:4}, at: ops_undo_list+0x636/0x8a0 [ 12.715399][ C3] #4: ffffffff983774c0 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x2e4/0xf20 [ 12.715794][ C3] [ 12.715794][ C3] stack backtrace: [ 12.716075][ C3] CPU: 3 UID: 0 PID: 66 Comm: kworker/u16:1 Not tainted 6.15.0-virtme #1 PREEMPT(full) [ 12.716080][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 12.716083][ C3] Workqueue: netns cleanup_net [ 12.716087][ C3] Call Trace: [ 12.716089][ C3] [ 12.716091][ C3] dump_stack_lvl+0x82/0xd0 [ 12.716097][ C3] print_usage_bug.part.0+0x25f/0x360 [ 12.716102][ C3] mark_lock_irq+0x343/0x400 [ 12.716107][ C3] ? __pfx_unwind_next_frame+0x10/0x10 [ 12.716111][ C3] ? save_trace+0x52/0x170 [ 12.716115][ C3] mark_lock+0x174/0x2f0 [ 12.716119][ C3] mark_usage+0x46/0x150 [ 12.716123][ C3] __lock_acquire+0x20b/0x7e0 [ 12.716126][ C3] ? __lock_acquire+0x44d/0x7e0 [ 12.716131][ C3] lock_acquire.part.0+0xb6/0x240 [ 12.716134][ C3] ? simple_pin_fs+0x24/0x150 [ 12.716138][ C3] ? rcu_is_watching+0x12/0xc0 [ 12.716143][ C3] ? lock_acquire+0x10c/0x170 [ 12.716145][ C3] ? simple_pin_fs+0x24/0x150 [ 12.716149][ C3] _raw_spin_lock+0x33/0x40 [ 12.716153][ C3] ? simple_pin_fs+0x24/0x150 [ 12.716155][ C3] simple_pin_fs+0x24/0x150 [ 12.716158][ C3] debugfs_remove+0x35/0x70 [ 12.716162][ C3] ref_tracker_dir_exit+0xcf/0x740 [ 12.716166][ C3] ? __pfx_ref_tracker_free+0x10/0x10 [ 12.716169][ C3] ? __sk_destruct+0x383/0x780 [ 12.716174][ C3] ? rcu_do_batch+0x34c/0xf20 [ 12.716177][ C3] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 12.716179][ C3] ? irq_exit_rcu+0xe/0x30 [ 12.716182][ C3] ? sysvec_apic_timer_interrupt+0xa8/0xc0 [ 12.716187][ C3] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 12.716191][ C3] ? _raw_spin_unlock_irqrestore+0x41/0x80 [ 12.716194][ C3] ? try_to_wake_up+0x787/0xde0 [ 12.716199][ C3] ? wake_up_q+0xa8/0x160 [ 12.716201][ C3] ? rwsem_wake.isra.0+0xc7/0x110 [ 12.716205][ C3] ? __up_write+0x215/0x530 [ 12.716208][ C3] ? kernfs_remove_by_name_ns+0x77/0xc0 [ 12.716212][ C3] ? remove_files+0x8c/0x1a0 [ 12.716215][ C3] ? sysfs_remove_group+0x7b/0x160 [ 12.716221][ C3] __put_net+0x19/0x60 [ 12.716223][ C3] __sk_destruct+0x58a/0x780 [ 12.716227][ C3] ? rcu_do_batch+0x34a/0xf20 [ 12.716230][ C3] rcu_do_batch+0x34c/0xf20 [ 12.716235][ C3] ? __pfx_rcu_do_batch+0x10/0x10 [ 12.716239][ C3] ? mark_held_locks+0x49/0x80 [ 12.716242][ C3] ? note_gp_changes+0x182/0x1e0 [ 12.716245][ C3] ? lockdep_hardirqs_on+0x7c/0x110 [ 12.716250][ C3] rcu_core+0x2bb/0x500 [ 12.716254][ C3] handle_softirqs+0x218/0x620 [ 12.716260][ C3] __irq_exit_rcu+0xfa/0x160 [ 12.716263][ C3] irq_exit_rcu+0xe/0x30 [ 12.716266][ C3] sysvec_apic_timer_interrupt+0xa8/0xc0 [ 12.716270][ C3] [ 12.716271][ C3] [ 12.716273][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 12.716275][ C3] RIP: 0010:_raw_spin_unlock_irqrestore+0x41/0x80 [ 12.716279][ C3] Code: 74 24 10 e8 c1 fe 81 fd 48 89 ef e8 79 51 82 fd 81 e3 00 02 00 00 75 29 9c 58 f6 c4 02 75 35 48 85 db 74 01 fb bf 01 00 00 00 fa 4e 76 fd 65 8b 05 13 bd 96 02 85 c0 74 0e 5b 5d c3 cc cc cc [ 12.716282][ C3] RSP: 0018:ffffc90000477598 EFLAGS: 00000206 [ 12.716285][ C3] RAX: 0000000000000002 RBX: 0000000000000200 RCX: 0000000000000040 [ 12.716287][ C3] RDX: 0000000000000000 RSI: ffffffff97e9175c RDI: 0000000000000001 [ 12.716288][ C3] RBP: ffff888002744f28 R08: 0000000000000001 R09: 0000000000000001 [ 12.716290][ C3] R10: ffffffff98de7cd7 R11: ffffffff983775e0 R12: ffff88809c2f0000 [ 12.716292][ C3] R13: ffff8880027445d4 R14: ffff888002744f28 R15: 0000000000000000 [ 12.716298][ C3] try_to_wake_up+0x787/0xde0 [ 12.716302][ C3] ? __pfx_try_to_wake_up+0x10/0x10 [ 12.716305][ C3] ? find_held_lock+0x2b/0x80 [ 12.716310][ C3] wake_up_q+0xa8/0x160 [ 12.716313][ C3] ? lockdep_hardirqs_on+0x7c/0x110 [ 12.716317][ C3] rwsem_wake.isra.0+0xc7/0x110 [ 12.716321][ C3] ? __pfx_rwsem_wake.isra.0+0x10/0x10 [ 12.716325][ C3] ? find_held_lock+0x2b/0x80 [ 12.716329][ C3] __up_write+0x215/0x530 [ 12.716332][ C3] ? kernfs_remove_by_name_ns+0x77/0xc0 [ 12.716336][ C3] kernfs_remove_by_name_ns+0x77/0xc0 [ 12.716340][ C3] remove_files+0x8c/0x1a0 [ 12.716343][ C3] sysfs_remove_group+0x7b/0x160 [ 12.716346][ C3] sysfs_remove_groups+0x53/0xa0 [ 12.716350][ C3] device_remove_attrs+0x1da/0x260 [ 12.716355][ C3] ? __pfx_device_remove_attrs+0x10/0x10 [ 12.716358][ C3] ? __up_write+0x1ad/0x530 [ 12.716361][ C3] ? kernfs_remove_by_name_ns+0x77/0xc0 [ 12.716366][ C3] device_del+0x336/0x8c0 [ 12.716369][ C3] ? __pfx_device_del+0x10/0x10 [ 12.716373][ C3] ? netdev_unregister_kobject+0x2d5/0x380 [ 12.716377][ C3] unregister_netdevice_many_notify+0x44d/0x1bf0 [ 12.716384][ C3] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 12.716388][ C3] ? rtnl_is_locked+0x15/0x20 [ 12.716390][ C3] ? unregister_netdevice_queue+0x6f/0x410 [ 12.716394][ C3] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 12.716400][ C3] ? lockdep_rtnl_is_held+0x1a/0x30 [ 12.716402][ C3] ? sit_exit_rtnl_net+0x2e1/0x3e0 [ 12.716408][ C3] ops_undo_list+0x723/0x8a0 [ 12.716413][ C3] ? __pfx_ops_undo_list+0x10/0x10 [ 12.716416][ C3] ? __local_bh_enable_ip+0xa9/0x130 [ 12.716421][ C3] cleanup_net+0x3a1/0x810 [ 12.716425][ C3] ? __pfx_cleanup_net+0x10/0x10 [ 12.716429][ C3] ? rcu_is_watching+0x12/0xc0 [ 12.716433][ C3] process_one_work+0xe40/0x1660 [ 12.716439][ C3] ? __pfx_process_one_work+0x10/0x10 [ 12.716444][ C3] ? assign_work+0x16c/0x240 [ 12.716449][ C3] worker_thread+0x591/0xcf0 [ 12.716454][ C3] ? __pfx_worker_thread+0x10/0x10 [ 12.716457][ C3] kthread+0x37e/0x600 [ 12.716461][ C3] ? __pfx_kthread+0x10/0x10 [ 12.716464][ C3] ? ret_from_fork+0x1b/0x320 [ 12.716467][ C3] ? __lock_release+0x5d/0x170 [ 12.716471][ C3] ? rcu_is_watching+0x12/0xc0 [ 12.716474][ C3] ? __pfx_kthread+0x10/0x10 [ 12.716477][ C3] ret_from_fork+0x240/0x320 [ 12.716480][ C3] ? __pfx_kthread+0x10/0x10 [ 12.716483][ C3] ret_from_fork_asm+0x1a/0x30 [ 12.716490][ C3] [ 12.742800][ C3] BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1576 [ 12.743189][ C3] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 66, name: kworker/u16:1 [ 12.743560][ C3] preempt_count: 103, expected: 0 [ 12.743778][ C3] RCU nest depth: 0, expected: 0 [ 12.743989][ C3] INFO: lockdep is turned off. [ 12.744215][ C3] Preemption disabled at: [ 12.744216][ C3] [] __up_write+0x112/0x530 [ 12.744645][ C3] CPU: 3 UID: 0 PID: 66 Comm: kworker/u16:1 Not tainted 6.15.0-virtme #1 PREEMPT(full) [ 12.744650][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 12.744652][ C3] Workqueue: netns cleanup_net [ 12.744657][ C3] Call Trace: [ 12.744659][ C3] [ 12.744661][ C3] dump_stack_lvl+0xb0/0xd0 [ 12.744668][ C3] __might_resched+0x360/0x5a0 [ 12.744675][ C3] down_write+0x72/0x210 [ 12.744679][ C3] ? __pfx_down_write+0x10/0x10 [ 12.744682][ C3] ? simple_recursive_removal+0x33/0x610 [ 12.744686][ C3] ? rcu_is_watching+0x12/0xc0 [ 12.744691][ C3] ? do_raw_spin_unlock+0x58/0x220 [ 12.744695][ C3] simple_recursive_removal+0x6a/0x610 [ 12.744699][ C3] ? do_raw_spin_unlock+0x58/0x220 [ 12.744701][ C3] ? __pfx_remove_one+0x10/0x10 [ 12.744707][ C3] debugfs_remove+0x44/0x70 [ 12.744711][ C3] ref_tracker_dir_exit+0xcf/0x740 [ 12.744715][ C3] ? __pfx_ref_tracker_free+0x10/0x10 [ 12.744718][ C3] ? __sk_destruct+0x383/0x780 [ 12.744722][ C3] ? rcu_do_batch+0x34c/0xf20 [ 12.744726][ C3] ? __pfx_ref_tracker_dir_exit+0x10/0x10 [ 12.744728][ C3] ? irq_exit_rcu+0xe/0x30 [ 12.744733][ C3] ? sysvec_apic_timer_interrupt+0xa8/0xc0 [ 12.744738][ C3] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 12.744742][ C3] ? _raw_spin_unlock_irqrestore+0x41/0x80 [ 12.744746][ C3] ? try_to_wake_up+0x787/0xde0 [ 12.744749][ C3] ? wake_up_q+0xa8/0x160 [ 12.744752][ C3] ? rwsem_wake.isra.0+0xc7/0x110 [ 12.744755][ C3] ? __up_write+0x215/0x530 [ 12.744758][ C3] ? kernfs_remove_by_name_ns+0x77/0xc0 [ 12.744762][ C3] ? remove_files+0x8c/0x1a0 [ 12.744765][ C3] ? sysfs_remove_group+0x7b/0x160 [ 12.744770][ C3] __put_net+0x19/0x60 [ 12.744773][ C3] __sk_destruct+0x58a/0x780 [ 12.744777][ C3] ? rcu_do_batch+0x34a/0xf20 [ 12.744780][ C3] rcu_do_batch+0x34c/0xf20 [ 12.744784][ C3] ? __pfx_rcu_do_batch+0x10/0x10 [ 12.744788][ C3] ? mark_held_locks+0x49/0x80 [ 12.744792][ C3] ? note_gp_changes+0x182/0x1e0 [ 12.744795][ C3] ? lockdep_hardirqs_on+0x7c/0x110 [ 12.744800][ C3] rcu_core+0x2bb/0x500 [ 12.744805][ C3] handle_softirqs+0x218/0x620 [ 12.744810][ C3] __irq_exit_rcu+0xfa/0x160 [ 12.744814][ C3] irq_exit_rcu+0xe/0x30 [ 12.744817][ C3] sysvec_apic_timer_interrupt+0xa8/0xc0 [ 12.744821][ C3] [ 12.744822][ C3] [ 12.744823][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 12.744826][ C3] RIP: 0010:_raw_spin_unlock_irqrestore+0x41/0x80 [ 12.744830][ C3] Code: 74 24 10 e8 c1 fe 81 fd 48 89 ef e8 79 51 82 fd 81 e3 00 02 00 00 75 29 9c 58 f6 c4 02 75 35 48 85 db 74 01 fb bf 01 00 00 00 fa 4e 76 fd 65 8b 05 13 bd 96 02 85 c0 74 0e 5b 5d c3 cc cc cc [ 12.744832][ C3] RSP: 0018:ffffc90000477598 EFLAGS: 00000206 [ 12.744835][ C3] RAX: 0000000000000002 RBX: 0000000000000200 RCX: 0000000000000040 [ 12.744837][ C3] RDX: 0000000000000000 RSI: ffffffff97e9175c RDI: 0000000000000001 [ 12.744838][ C3] RBP: ffff888002744f28 R08: 0000000000000001 R09: 0000000000000001 [ 12.744840][ C3] R10: ffffffff98de7cd7 R11: ffffffff983775e0 R12: ffff88809c2f0000 [ 12.744842][ C3] R13: ffff8880027445d4 R14: ffff888002744f28 R15: 0000000000000000 [ 12.744848][ C3] try_to_wake_up+0x787/0xde0 [ 12.744852][ C3] ? __pfx_try_to_wake_up+0x10/0x10 [ 12.744855][ C3] ? find_held_lock+0x2b/0x80 [ 12.744860][ C3] wake_up_q+0xa8/0x160 [ 12.744863][ C3] ? lockdep_hardirqs_on+0x7c/0x110 [ 12.744867][ C3] rwsem_wake.isra.0+0xc7/0x110 [ 12.744870][ C3] ? __pfx_rwsem_wake.isra.0+0x10/0x10 [ 12.744874][ C3] ? find_held_lock+0x2b/0x80 [ 12.744878][ C3] __up_write+0x215/0x530 [ 12.744881][ C3] ? kernfs_remove_by_name_ns+0x77/0xc0 [ 12.744885][ C3] kernfs_remove_by_name_ns+0x77/0xc0 [ 12.744889][ C3] remove_files+0x8c/0x1a0 [ 12.744892][ C3] sysfs_remove_group+0x7b/0x160 [ 12.744896][ C3] sysfs_remove_groups+0x53/0xa0 [ 12.744899][ C3] device_remove_attrs+0x1da/0x260 [ 12.744904][ C3] ? __pfx_device_remove_attrs+0x10/0x10 [ 12.744907][ C3] ? __up_write+0x1ad/0x530 [ 12.744910][ C3] ? kernfs_remove_by_name_ns+0x77/0xc0 [ 12.744915][ C3] device_del+0x336/0x8c0 [ 12.744919][ C3] ? __pfx_device_del+0x10/0x10 [ 12.744922][ C3] ? netdev_unregister_kobject+0x2d5/0x380 [ 12.744927][ C3] unregister_netdevice_many_notify+0x44d/0x1bf0 [ 12.744934][ C3] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 12.744937][ C3] ? rtnl_is_locked+0x15/0x20 [ 12.744940][ C3] ? unregister_netdevice_queue+0x6f/0x410 [ 12.744944][ C3] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 12.744950][ C3] ? lockdep_rtnl_is_held+0x1a/0x30 [ 12.744952][ C3] ? sit_exit_rtnl_net+0x2e1/0x3e0 [ 12.744958][ C3] ops_undo_list+0x723/0x8a0 [ 12.744962][ C3] ? __pfx_ops_undo_list+0x10/0x10 [ 12.744966][ C3] ? __local_bh_enable_ip+0xa9/0x130 [ 12.744971][ C3] cleanup_net+0x3a1/0x810 [ 12.744975][ C3] ? __pfx_cleanup_net+0x10/0x10 [ 12.744979][ C3] ? rcu_is_watching+0x12/0xc0 [ 12.744983][ C3] process_one_work+0xe40/0x1660 [ 12.744990][ C3] ? __pfx_process_one_work+0x10/0x10 [ 12.744996][ C3] ? assign_work+0x16c/0x240 [ 12.745000][ C3] worker_thread+0x591/0xcf0 [ 12.745005][ C3] ? __pfx_worker_thread+0x10/0x10 [ 12.745009][ C3] kthread+0x37e/0x600 [ 12.745012][ C3] ? __pfx_kthread+0x10/0x10 [ 12.745015][ C3] ? ret_from_fork+0x1b/0x320 [ 12.745019][ C3] ? __lock_release+0x5d/0x170 [ 12.745022][ C3] ? rcu_is_watching+0x12/0xc0 [ 12.745026][ C3] ? __pfx_kthread+0x10/0x10 [ 12.745029][ C3] ret_from_fork+0x240/0x320 [ 12.745032][ C3] ? __pfx_kthread+0x10/0x10 [ 12.745035][ C3] ret_from_fork_asm+0x1a/0x30 [ 12.745043][ C3]