[ 3922.785237][ T2093] pktgen: Packet Generator for packet performance testing. Version: 2.75 [ 3938.959413][ T12] ------------[ cut here ]------------ [ 3938.960015][ T12] conntrack cleanup blocked for 60s [ 3938.960019][ T12] WARNING: net/netfilter/nf_conntrack_core.c:2511 at 0x0, CPU#0: kworker/u16:0/12 [ 3938.960833][ T12] Modules linked in: pktgen(+) xt_conntrack cls_bpf nft_chain_nat xt_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 unix_diag act_gact cls_matchall sch_ingress ipt_REJECT nf_reject_ipv4 ip6t_rpfilter nft_compat nf_tables vxlan mpls_gso mpls_iptunnel mpls_router [last unloaded: ila] [ 3938.962381][ T12] CPU: 0 UID: 0 PID: 12 Comm: kworker/u16:0 Not tainted 6.18.0-virtme #1 PREEMPT(full) [ 3938.962858][ T12] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 3938.963215][ T12] Workqueue: netns cleanup_net [ 3938.963528][ T12] RIP: 0010:nf_conntrack_cleanup_net_list+0x4a0/0x540 [nf_conntrack] [ 3938.963968][ T12] Code: 00 00 00 65 48 2b 05 ff 41 bd f7 0f 85 a0 00 00 00 48 81 c4 c0 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 48 8d 3d 00 d2 0c 00 <67> 48 0f b9 3a e9 0f ff ff ff 48 c7 c7 bc df 80 c0 e8 0a 7f 7b f3 [ 3938.964979][ T12] RSP: 0018:ffffc900000c7988 EFLAGS: 00010297 [ 3938.965329][ T12] RAX: 0000000100378422 RBX: ffffc900000c7ae8 RCX: ffffffffc0733b0a [ 3938.965756][ T12] RDX: 0000000100378421 RSI: 0000000000000004 RDI: ffffffffc0801030 [ 3938.966191][ T12] RBP: ffff88801210de60 R08: 0000000000000000 R09: ffffed1002421bcc [ 3938.966606][ T12] R10: ffff88801210de63 R11: ffff888001abd090 R12: 0000000000000001 [ 3938.967036][ T12] R13: ffff8880150cca00 R14: dffffc0000000000 R15: ffffc900000c79e8 [ 3938.967485][ T12] FS: 0000000000000000(0000) GS:ffff8880b4d18000(0000) knlGS:0000000000000000 [ 3938.967982][ T12] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3938.968336][ T12] CR2: 00005564a7be1a78 CR3: 0000000027145004 CR4: 0000000000772ef0 [ 3938.969270][ T12] PKRU: 55555554 [ 3938.969507][ T12] Call Trace: [ 3938.969714][ T12] [ 3938.969859][ T12] ? nf_conntrack_cleanup_net_list+0x137/0x540 [nf_conntrack] [ 3938.970300][ T12] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 3938.970680][ T12] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 3938.971035][ T12] ? nf_conntrack_pernet_exit+0xa5/0x140 [nf_conntrack] [ 3938.971410][ T12] ? _raw_spin_unlock+0x2d/0x50 [ 3938.971706][ T12] ops_undo_list+0x2bf/0x890 [ 3938.972015][ T12] ? netns_install+0x280/0x280 [ 3938.972300][ T12] ? cleanup_net+0x2d6/0x8e0 [ 3938.972611][ T12] cleanup_net+0x3b2/0x8e0 [ 3938.972907][ T12] ? net_passive_dec+0x190/0x190 [ 3938.973185][ T12] ? rcu_is_watching+0x12/0xb0 [ 3938.973476][ T12] ? lock_acquire+0x104/0x140 [ 3938.973765][ T12] process_one_work+0x880/0x1810 [ 3938.974067][ T12] ? pwq_dec_nr_in_flight+0x550/0x550 [ 3938.974380][ T12] ? assign_work+0x168/0x240 [ 3938.974660][ T12] worker_thread+0x591/0xcf0 [ 3938.974950][ T12] ? bh_worker+0x6f0/0x6f0 [ 3938.975231][ T12] kthread+0x37b/0x5f0 [ 3938.975457][ T12] ? kthread_is_per_cpu+0xc0/0xc0 [ 3938.975733][ T12] ? ret_from_fork+0x71/0x540 [ 3938.976014][ T12] ? __lock_release+0x5d/0x160 [ 3938.976313][ T12] ? lock_acquire+0x104/0x140 [ 3938.976595][ T12] ? rcu_is_watching+0x12/0xb0 [ 3938.976895][ T12] ? kthread_is_per_cpu+0xc0/0xc0 [ 3938.977175][ T12] ret_from_fork+0x42f/0x540 [ 3938.977467][ T12] ? arch_exit_to_user_mode_prepare.constprop.0+0x140/0x140 [ 3938.977909][ T12] ? kthread_is_per_cpu+0xc0/0xc0 [ 3938.978197][ T12] ? __switch_to+0x5c8/0xd50 [ 3938.978523][ T12] ? kthread_is_per_cpu+0xc0/0xc0 [ 3938.978808][ T12] ret_from_fork_asm+0x11/0x20 [ 3938.979103][ T12] [ 3938.979328][ T12] irq event stamp: 9927357 [ 3938.979620][ T12] hardirqs last enabled at (9927367): [] __up_console_sem+0x67/0x70 [ 3938.980093][ T12] hardirqs last disabled at (9927374): [] __up_console_sem+0x4c/0x70 [ 3938.980607][ T12] softirqs last enabled at (9926926): [] handle_softirqs+0x524/0x820 [ 3938.981099][ T12] softirqs last disabled at (9926921): [] __irq_exit_rcu+0x6c/0xe0 [ 3938.981605][ T12] ---[ end trace 0000000000000000 ]--- [ 4056.685455][ T44] INFO: task modprobe:2093 blocked for more than 122 seconds. [ 4056.686111][ T44] Tainted: G W 6.18.0-virtme #1 [ 4056.686487][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4056.686919][ T44] task:modprobe state:D stack:25208 pid:2093 tgid:2093 ppid:1 task_flags:0x400100 flags:0x00080002 [ 4056.687450][ T44] Call Trace: [ 4056.687643][ T44] [ 4056.687798][ T44] __schedule+0x90a/0x1930 [ 4056.688058][ T44] ? io_schedule_timeout+0x150/0x150 [ 4056.688306][ T44] ? __lock_release+0x5d/0x160 [ 4056.688568][ T44] schedule+0xe2/0x270 [ 4056.688770][ T44] schedule_preempt_disabled+0x18/0x30 [ 4056.689021][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4056.689265][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4056.689524][ T44] ? rcu_is_watching+0x12/0xb0 [ 4056.689785][ T44] ? lock_acquire+0x104/0x140 [ 4056.690037][ T44] down_write+0x1d6/0x200 [ 4056.690226][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4056.690560][ T44] ? __lock_release+0x5d/0x160 [ 4056.690825][ T44] register_pernet_subsys+0x1a/0x40 [ 4056.691071][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4056.691319][ T44] pg_init+0x2c/0x1000 [pktgen] [ 4056.691584][ T44] do_one_initcall+0xc5/0x3d0 [ 4056.691842][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4056.692138][ T44] ? rcu_is_watching+0x12/0xb0 [ 4056.692391][ T44] ? trace_kmalloc+0x24/0xb0 [ 4056.692639][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4056.693227][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4056.693490][ T44] ? kasan_unpoison+0x27/0x50 [ 4056.693748][ T44] do_init_module+0x27a/0x860 [ 4056.693997][ T44] ? free_module+0x3f0/0x3f0 [ 4056.694236][ T44] ? kfree+0x2bb/0x5f0 [ 4056.694457][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4056.694720][ T44] ? load_module+0x20c5/0x2dd0 [ 4056.694968][ T44] load_module+0x1f40/0x2dd0 [ 4056.695220][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4056.695526][ T44] ? kernel_read_file+0x3ed/0x550 [ 4056.695780][ T44] ? kernel_read_file+0x3c8/0x550 [ 4056.696024][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4056.696284][ T44] ? init_module_from_file+0x159/0x180 [ 4056.696543][ T44] init_module_from_file+0x159/0x180 [ 4056.696792][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4056.697036][ T44] ? __lock_acquire+0x664/0xca0 [ 4056.697286][ T44] ? idempotent_init_module+0x316/0x610 [ 4056.697542][ T44] ? __lock_release+0x5d/0x160 [ 4056.697796][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4056.698038][ T44] idempotent_init_module+0x331/0x610 [ 4056.698288][ T44] ? init_module_from_file+0x180/0x180 [ 4056.698567][ T44] ? rcu_is_watching+0x12/0xb0 [ 4056.698822][ T44] ? cap_capable+0x17b/0x340 [ 4056.699068][ T44] __x64_sys_finit_module+0xca/0x150 [ 4056.699306][ T44] ? do_syscall_64+0x85/0xfc0 [ 4056.699557][ T44] do_syscall_64+0xc1/0xfc0 [ 4056.699833][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4056.700132][ T44] RIP: 0033:0x7fd7eca3092d [ 4056.700397][ T44] RSP: 002b:00007ffe0d3447a8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4056.700766][ T44] RAX: ffffffffffffffda RBX: 000055af9c6ebac0 RCX: 00007fd7eca3092d [ 4056.701118][ T44] RDX: 0000000000000000 RSI: 000055af98bb2a2a RDI: 0000000000000005 [ 4056.701481][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe0d3448e0 [ 4056.701845][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055af98bb2a2a [ 4056.702194][ T44] R13: 000055af9c6eba50 R14: 000055af9c6ebd90 R15: 0000000000000000 [ 4056.702590][ T44] [ 4056.702794][ T44] INFO: task modprobe:2093 is blocked on an rw-semaphore, but the owner is not found. [ 4056.703190][ T44] [ 4056.703190][ T44] Showing all locks held in the system: [ 4056.703630][ T44] 4 locks held by kworker/u16:0/12: [ 4056.703882][ T44] 1 lock held by khungtaskd/44: [ 4056.704112][ T44] #0: ffffffffb6f7fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4056.704532][ T44] 1 lock held by modprobe/2093: [ 4056.704770][ T44] #0: ffffffffb7668cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4056.705217][ T44] [ 4056.705347][ T44] ============================================= [ 4056.705347][ T44] [ 4179.565443][ T44] INFO: task modprobe:2093 blocked for more than 245 seconds. [ 4179.565896][ T44] Tainted: G W 6.18.0-virtme #1 [ 4179.566176][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4179.566631][ T44] task:modprobe state:D stack:25208 pid:2093 tgid:2093 ppid:1 task_flags:0x400100 flags:0x00080002 [ 4179.567131][ T44] Call Trace: [ 4179.567317][ T44] [ 4179.567474][ T44] __schedule+0x90a/0x1930 [ 4179.567735][ T44] ? io_schedule_timeout+0x150/0x150 [ 4179.567978][ T44] ? __lock_release+0x5d/0x160 [ 4179.568226][ T44] schedule+0xe2/0x270 [ 4179.568427][ T44] schedule_preempt_disabled+0x18/0x30 [ 4179.568670][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4179.568914][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4179.569162][ T44] ? rcu_is_watching+0x12/0xb0 [ 4179.569425][ T44] ? lock_acquire+0x104/0x140 [ 4179.569674][ T44] down_write+0x1d6/0x200 [ 4179.569861][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4179.570162][ T44] ? __lock_release+0x5d/0x160 [ 4179.570440][ T44] register_pernet_subsys+0x1a/0x40 [ 4179.570689][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4179.570932][ T44] pg_init+0x2c/0x1000 [pktgen] [ 4179.571186][ T44] do_one_initcall+0xc5/0x3d0 [ 4179.571443][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4179.571736][ T44] ? rcu_is_watching+0x12/0xb0 [ 4179.571980][ T44] ? trace_kmalloc+0x24/0xb0 [ 4179.572220][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4179.572472][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4179.572716][ T44] ? kasan_unpoison+0x27/0x50 [ 4179.572969][ T44] do_init_module+0x27a/0x860 [ 4179.573219][ T44] ? free_module+0x3f0/0x3f0 [ 4179.573468][ T44] ? kfree+0x2bb/0x5f0 [ 4179.573663][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4179.573904][ T44] ? load_module+0x20c5/0x2dd0 [ 4179.574146][ T44] load_module+0x1f40/0x2dd0 [ 4179.574428][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4179.574724][ T44] ? kernel_read_file+0x3ed/0x550 [ 4179.574976][ T44] ? kernel_read_file+0x3c8/0x550 [ 4179.575218][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4179.575476][ T44] ? init_module_from_file+0x159/0x180 [ 4179.575716][ T44] init_module_from_file+0x159/0x180 [ 4179.575957][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4179.576198][ T44] ? __lock_acquire+0x664/0xca0 [ 4179.576465][ T44] ? idempotent_init_module+0x316/0x610 [ 4179.576711][ T44] ? __lock_release+0x5d/0x160 [ 4179.576955][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4179.577195][ T44] idempotent_init_module+0x331/0x610 [ 4179.577450][ T44] ? init_module_from_file+0x180/0x180 [ 4179.577697][ T44] ? rcu_is_watching+0x12/0xb0 [ 4179.577938][ T44] ? cap_capable+0x17b/0x340 [ 4179.578182][ T44] __x64_sys_finit_module+0xca/0x150 [ 4179.578455][ T44] ? do_syscall_64+0x85/0xfc0 [ 4179.578697][ T44] do_syscall_64+0xc1/0xfc0 [ 4179.578940][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4179.579234][ T44] RIP: 0033:0x7fd7eca3092d [ 4179.579493][ T44] RSP: 002b:00007ffe0d3447a8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4179.579844][ T44] RAX: ffffffffffffffda RBX: 000055af9c6ebac0 RCX: 00007fd7eca3092d [ 4179.580201][ T44] RDX: 0000000000000000 RSI: 000055af98bb2a2a RDI: 0000000000000005 [ 4179.580560][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe0d3448e0 [ 4179.580905][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055af98bb2a2a [ 4179.581255][ T44] R13: 000055af9c6eba50 R14: 000055af9c6ebd90 R15: 0000000000000000 [ 4179.581638][ T44] [ 4179.581826][ T44] INFO: task modprobe:2093 is blocked on an rw-semaphore, but the owner is not found. [ 4179.582221][ T44] [ 4179.582221][ T44] Showing all locks held in the system: [ 4179.582704][ T44] 4 locks held by kworker/u16:0/12: [ 4179.582938][ T44] 1 lock held by khungtaskd/44: [ 4179.583161][ T44] #0: ffffffffb6f7fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4179.583592][ T44] 1 lock held by modprobe/2093: [ 4179.583818][ T44] #0: ffffffffb7668cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4179.584257][ T44] [ 4179.584391][ T44] ============================================= [ 4179.584391][ T44] [ 4302.445438][ T44] INFO: task modprobe:2093 blocked for more than 368 seconds. [ 4302.445943][ T44] Tainted: G W 6.18.0-virtme #1 [ 4302.446229][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4302.446705][ T44] task:modprobe state:D stack:25208 pid:2093 tgid:2093 ppid:1 task_flags:0x400100 flags:0x00080002 [ 4302.447205][ T44] Call Trace: [ 4302.447408][ T44] [ 4302.447548][ T44] __schedule+0x90a/0x1930 [ 4302.447802][ T44] ? io_schedule_timeout+0x150/0x150 [ 4302.448048][ T44] ? __lock_release+0x5d/0x160 [ 4302.448294][ T44] schedule+0xe2/0x270 [ 4302.448507][ T44] schedule_preempt_disabled+0x18/0x30 [ 4302.448746][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4302.448991][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4302.449240][ T44] ? rcu_is_watching+0x12/0xb0 [ 4302.449494][ T44] ? lock_acquire+0x104/0x140 [ 4302.449747][ T44] down_write+0x1d6/0x200 [ 4302.449936][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4302.450241][ T44] ? __lock_release+0x5d/0x160 [ 4302.450517][ T44] register_pernet_subsys+0x1a/0x40 [ 4302.450762][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4302.451007][ T44] pg_init+0x2c/0x1000 [pktgen] [ 4302.451252][ T44] do_one_initcall+0xc5/0x3d0 [ 4302.451509][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4302.451803][ T44] ? rcu_is_watching+0x12/0xb0 [ 4302.452051][ T44] ? trace_kmalloc+0x24/0xb0 [ 4302.452290][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4302.452541][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4302.452782][ T44] ? kasan_unpoison+0x27/0x50 [ 4302.453027][ T44] do_init_module+0x27a/0x860 [ 4302.453275][ T44] ? free_module+0x3f0/0x3f0 [ 4302.453523][ T44] ? kfree+0x2bb/0x5f0 [ 4302.453709][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4302.453957][ T44] ? load_module+0x20c5/0x2dd0 [ 4302.454203][ T44] load_module+0x1f40/0x2dd0 [ 4302.454482][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4302.454773][ T44] ? kernel_read_file+0x3ed/0x550 [ 4302.455018][ T44] ? kernel_read_file+0x3c8/0x550 [ 4302.455260][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4302.455517][ T44] ? init_module_from_file+0x159/0x180 [ 4302.455763][ T44] init_module_from_file+0x159/0x180 [ 4302.456004][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4302.456245][ T44] ? __lock_acquire+0x664/0xca0 [ 4302.456520][ T44] ? idempotent_init_module+0x316/0x610 [ 4302.456759][ T44] ? __lock_release+0x5d/0x160 [ 4302.457003][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4302.457244][ T44] idempotent_init_module+0x331/0x610 [ 4302.457507][ T44] ? init_module_from_file+0x180/0x180 [ 4302.457759][ T44] ? rcu_is_watching+0x12/0xb0 [ 4302.458000][ T44] ? cap_capable+0x17b/0x340 [ 4302.458248][ T44] __x64_sys_finit_module+0xca/0x150 [ 4302.458515][ T44] ? do_syscall_64+0x85/0xfc0 [ 4302.458758][ T44] do_syscall_64+0xc1/0xfc0 [ 4302.459001][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4302.459302][ T44] RIP: 0033:0x7fd7eca3092d [ 4302.459562][ T44] RSP: 002b:00007ffe0d3447a8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4302.459914][ T44] RAX: ffffffffffffffda RBX: 000055af9c6ebac0 RCX: 00007fd7eca3092d [ 4302.460262][ T44] RDX: 0000000000000000 RSI: 000055af98bb2a2a RDI: 0000000000000005 [ 4302.460622][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe0d3448e0 [ 4302.460977][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055af98bb2a2a [ 4302.461324][ T44] R13: 000055af9c6eba50 R14: 000055af9c6ebd90 R15: 0000000000000000 [ 4302.461696][ T44] [ 4302.461884][ T44] INFO: task modprobe:2093 is blocked on an rw-semaphore, but the owner is not found. [ 4302.462276][ T44] [ 4302.462276][ T44] Showing all locks held in the system: [ 4302.462761][ T44] 4 locks held by kworker/u16:0/12: [ 4302.462994][ T44] 1 lock held by khungtaskd/44: [ 4302.463219][ T44] #0: ffffffffb6f7fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4302.463634][ T44] 1 lock held by modprobe/2093: [ 4302.463859][ T44] #0: ffffffffb7668cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4302.464314][ T44] [ 4302.464448][ T44] ============================================= [ 4302.464448][ T44] [ 4425.325430][ T44] INFO: task modprobe:2093 blocked for more than 491 seconds. [ 4425.325929][ T44] Tainted: G W 6.18.0-virtme #1 [ 4425.326204][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4425.326614][ T44] task:modprobe state:D stack:25208 pid:2093 tgid:2093 ppid:1 task_flags:0x400100 flags:0x00080002 [ 4425.327112][ T44] Call Trace: [ 4425.327310][ T44] [ 4425.327461][ T44] __schedule+0x90a/0x1930 [ 4425.327713][ T44] ? io_schedule_timeout+0x150/0x150 [ 4425.327958][ T44] ? __lock_release+0x5d/0x160 [ 4425.328204][ T44] schedule+0xe2/0x270 [ 4425.328429][ T44] schedule_preempt_disabled+0x18/0x30 [ 4425.328667][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4425.328911][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4425.329166][ T44] ? rcu_is_watching+0x12/0xb0 [ 4425.329422][ T44] ? lock_acquire+0x104/0x140 [ 4425.329667][ T44] down_write+0x1d6/0x200 [ 4425.329857][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4425.330150][ T44] ? __lock_release+0x5d/0x160 [ 4425.330398][ T44] register_pernet_subsys+0x1a/0x40 [ 4425.330639][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4425.330893][ T44] pg_init+0x2c/0x1000 [pktgen] [ 4425.331136][ T44] do_one_initcall+0xc5/0x3d0 [ 4425.331392][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4425.331686][ T44] ? rcu_is_watching+0x12/0xb0 [ 4425.331924][ T44] ? trace_kmalloc+0x24/0xb0 [ 4425.332163][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4425.332418][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4425.332667][ T44] ? kasan_unpoison+0x27/0x50 [ 4425.332912][ T44] do_init_module+0x27a/0x860 [ 4425.333159][ T44] ? free_module+0x3f0/0x3f0 [ 4425.333408][ T44] ? kfree+0x2bb/0x5f0 [ 4425.333597][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4425.333843][ T44] ? load_module+0x20c5/0x2dd0 [ 4425.334090][ T44] load_module+0x1f40/0x2dd0 [ 4425.334343][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4425.334655][ T44] ? kernel_read_file+0x3ed/0x550 [ 4425.334897][ T44] ? kernel_read_file+0x3c8/0x550 [ 4425.335140][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4425.335396][ T44] ? init_module_from_file+0x159/0x180 [ 4425.335638][ T44] init_module_from_file+0x159/0x180 [ 4425.335879][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4425.336130][ T44] ? __lock_acquire+0x664/0xca0 [ 4425.336389][ T44] ? idempotent_init_module+0x316/0x610 [ 4425.336639][ T44] ? __lock_release+0x5d/0x160 [ 4425.336881][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4425.337121][ T44] idempotent_init_module+0x331/0x610 [ 4425.337373][ T44] ? init_module_from_file+0x180/0x180 [ 4425.337622][ T44] ? rcu_is_watching+0x12/0xb0 [ 4425.337870][ T44] ? cap_capable+0x17b/0x340 [ 4425.338117][ T44] __x64_sys_finit_module+0xca/0x150 [ 4425.338365][ T44] ? do_syscall_64+0x85/0xfc0 [ 4425.338606][ T44] do_syscall_64+0xc1/0xfc0 [ 4425.338847][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4425.339136][ T44] RIP: 0033:0x7fd7eca3092d [ 4425.339394][ T44] RSP: 002b:00007ffe0d3447a8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4425.339753][ T44] RAX: ffffffffffffffda RBX: 000055af9c6ebac0 RCX: 00007fd7eca3092d [ 4425.340103][ T44] RDX: 0000000000000000 RSI: 000055af98bb2a2a RDI: 0000000000000005 [ 4425.340462][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe0d3448e0 [ 4425.340815][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055af98bb2a2a [ 4425.341174][ T44] R13: 000055af9c6eba50 R14: 000055af9c6ebd90 R15: 0000000000000000 [ 4425.341549][ T44] [ 4425.341736][ T44] INFO: task modprobe:2093 is blocked on an rw-semaphore, but the owner is not found. [ 4425.342118][ T44] [ 4425.342118][ T44] Showing all locks held in the system: [ 4425.342596][ T44] 4 locks held by kworker/u16:0/12: [ 4425.342834][ T44] 1 lock held by khungtaskd/44: [ 4425.343072][ T44] #0: ffffffffb6f7fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4425.343481][ T44] 1 lock held by modprobe/2093: [ 4425.343705][ T44] #0: ffffffffb7668cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4425.344142][ T44] [ 4425.344269][ T44] ============================================= [ 4425.344269][ T44] [ 4548.205466][ T44] INFO: task modprobe:2093 blocked for more than 614 seconds. [ 4548.206149][ T44] Tainted: G W 6.18.0-virtme #1 [ 4548.206619][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4548.207234][ T44] task:modprobe state:D stack:25208 pid:2093 tgid:2093 ppid:1 task_flags:0x400100 flags:0x00080002 [ 4548.208039][ T44] Call Trace: [ 4548.208318][ T44] [ 4548.208538][ T44] __schedule+0x90a/0x1930 [ 4548.208908][ T44] ? io_schedule_timeout+0x150/0x150 [ 4548.209267][ T44] ? __lock_release+0x5d/0x160 [ 4548.209643][ T44] schedule+0xe2/0x270 [ 4548.209923][ T44] schedule_preempt_disabled+0x18/0x30 [ 4548.210281][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4548.210651][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4548.211011][ T44] ? rcu_is_watching+0x12/0xb0 [ 4548.211376][ T44] ? lock_acquire+0x104/0x140 [ 4548.211737][ T44] down_write+0x1d6/0x200 [ 4548.212008][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4548.212450][ T44] ? __lock_release+0x5d/0x160 [ 4548.212815][ T44] register_pernet_subsys+0x1a/0x40 [ 4548.213163][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4548.213538][ T44] pg_init+0x2c/0x1000 [pktgen] [ 4548.213896][ T44] do_one_initcall+0xc5/0x3d0 [ 4548.214247][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4548.214687][ T44] ? rcu_is_watching+0x12/0xb0 [ 4548.215089][ T44] ? trace_kmalloc+0x24/0xb0 [ 4548.215513][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4548.215860][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4548.216205][ T44] ? kasan_unpoison+0x27/0x50 [ 4548.216596][ T44] do_init_module+0x27a/0x860 [ 4548.216990][ T44] ? free_module+0x3f0/0x3f0 [ 4548.217378][ T44] ? kfree+0x2bb/0x5f0 [ 4548.217668][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4548.218057][ T44] ? load_module+0x20c5/0x2dd0 [ 4548.218463][ T44] load_module+0x1f40/0x2dd0 [ 4548.218871][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4548.219379][ T44] ? kernel_read_file+0x3ed/0x550 [ 4548.219765][ T44] ? kernel_read_file+0x3c8/0x550 [ 4548.220151][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4548.220548][ T44] ? init_module_from_file+0x159/0x180 [ 4548.220921][ T44] init_module_from_file+0x159/0x180 [ 4548.221305][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4548.221704][ T44] ? __lock_acquire+0x664/0xca0 [ 4548.222099][ T44] ? idempotent_init_module+0x316/0x610 [ 4548.222484][ T44] ? __lock_release+0x5d/0x160 [ 4548.222863][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4548.223248][ T44] idempotent_init_module+0x331/0x610 [ 4548.223652][ T44] ? init_module_from_file+0x180/0x180 [ 4548.224037][ T44] ? rcu_is_watching+0x12/0xb0 [ 4548.224433][ T44] ? cap_capable+0x17b/0x340 [ 4548.224829][ T44] __x64_sys_finit_module+0xca/0x150 [ 4548.225221][ T44] ? do_syscall_64+0x85/0xfc0 [ 4548.225619][ T44] do_syscall_64+0xc1/0xfc0 [ 4548.225994][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4548.226468][ T44] RIP: 0033:0x7fd7eca3092d [ 4548.226879][ T44] RSP: 002b:00007ffe0d3447a8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4548.227439][ T44] RAX: ffffffffffffffda RBX: 000055af9c6ebac0 RCX: 00007fd7eca3092d [ 4548.228020][ T44] RDX: 0000000000000000 RSI: 000055af98bb2a2a RDI: 0000000000000005 [ 4548.228544][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe0d3448e0 [ 4548.229124][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055af98bb2a2a [ 4548.229659][ T44] R13: 000055af9c6eba50 R14: 000055af9c6ebd90 R15: 0000000000000000 [ 4548.230188][ T44] [ 4548.230472][ T44] INFO: task modprobe:2093 is blocked on an rw-semaphore, but the owner is not found. [ 4548.231020][ T44] [ 4548.231020][ T44] Showing all locks held in the system: [ 4548.231654][ T44] 4 locks held by kworker/u16:0/12: [ 4548.231990][ T44] 1 lock held by khungtaskd/44: [ 4548.232314][ T44] #0: ffffffffb6f7fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4548.232936][ T44] 1 lock held by modprobe/2093: [ 4548.233261][ T44] #0: ffffffffb7668cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4548.233918][ T44] [ 4548.234097][ T44] ============================================= [ 4548.234097][ T44] [ 4671.085443][ T44] INFO: task modprobe:2093 blocked for more than 737 seconds. [ 4671.085952][ T44] Tainted: G W 6.18.0-virtme #1 [ 4671.086237][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4671.086684][ T44] task:modprobe state:D stack:25208 pid:2093 tgid:2093 ppid:1 task_flags:0x400100 flags:0x00080002 [ 4671.087208][ T44] Call Trace: [ 4671.087416][ T44] [ 4671.087556][ T44] __schedule+0x90a/0x1930 [ 4671.087837][ T44] ? io_schedule_timeout+0x150/0x150 [ 4671.088083][ T44] ? __lock_release+0x5d/0x160 [ 4671.088342][ T44] schedule+0xe2/0x270 [ 4671.088548][ T44] schedule_preempt_disabled+0x18/0x30 [ 4671.088799][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4671.089047][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4671.089294][ T44] ? rcu_is_watching+0x12/0xb0 [ 4671.089550][ T44] ? lock_acquire+0x104/0x140 [ 4671.089809][ T44] down_write+0x1d6/0x200 [ 4671.090007][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4671.090301][ T44] ? __lock_release+0x5d/0x160 [ 4671.090577][ T44] register_pernet_subsys+0x1a/0x40 [ 4671.090835][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4671.091081][ T44] pg_init+0x2c/0x1000 [pktgen] [ 4671.091325][ T44] do_one_initcall+0xc5/0x3d0 [ 4671.091584][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4671.091912][ T44] ? rcu_is_watching+0x12/0xb0 [ 4671.092154][ T44] ? trace_kmalloc+0x24/0xb0 [ 4671.092411][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4671.092653][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4671.092906][ T44] ? kasan_unpoison+0x27/0x50 [ 4671.093161][ T44] do_init_module+0x27a/0x860 [ 4671.093431][ T44] ? free_module+0x3f0/0x3f0 [ 4671.093682][ T44] ? kfree+0x2bb/0x5f0 [ 4671.093880][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4671.094125][ T44] ? load_module+0x20c5/0x2dd0 [ 4671.094407][ T44] load_module+0x1f40/0x2dd0 [ 4671.094660][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4671.094969][ T44] ? kernel_read_file+0x3ed/0x550 [ 4671.095213][ T44] ? kernel_read_file+0x3c8/0x550 [ 4671.095471][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4671.095744][ T44] ? init_module_from_file+0x159/0x180 [ 4671.095988][ T44] init_module_from_file+0x159/0x180 [ 4671.096228][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4671.096490][ T44] ? __lock_acquire+0x664/0xca0 [ 4671.096756][ T44] ? idempotent_init_module+0x316/0x610 [ 4671.097019][ T44] ? __lock_release+0x5d/0x160 [ 4671.097263][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4671.097529][ T44] idempotent_init_module+0x331/0x610 [ 4671.097786][ T44] ? init_module_from_file+0x180/0x180 [ 4671.098038][ T44] ? rcu_is_watching+0x12/0xb0 [ 4671.098278][ T44] ? cap_capable+0x17b/0x340 [ 4671.098558][ T44] __x64_sys_finit_module+0xca/0x150 [ 4671.098813][ T44] ? do_syscall_64+0x85/0xfc0 [ 4671.099058][ T44] do_syscall_64+0xc1/0xfc0 [ 4671.099319][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4671.099630][ T44] RIP: 0033:0x7fd7eca3092d [ 4671.099909][ T44] RSP: 002b:00007ffe0d3447a8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4671.100263][ T44] RAX: ffffffffffffffda RBX: 000055af9c6ebac0 RCX: 00007fd7eca3092d [ 4671.100626][ T44] RDX: 0000000000000000 RSI: 000055af98bb2a2a RDI: 0000000000000005 [ 4671.100995][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe0d3448e0 [ 4671.101341][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055af98bb2a2a [ 4671.101712][ T44] R13: 000055af9c6eba50 R14: 000055af9c6ebd90 R15: 0000000000000000 [ 4671.102075][ T44] [ 4671.102260][ T44] INFO: task modprobe:2093 is blocked on an rw-semaphore, but the owner is not found. [ 4671.102693][ T44] [ 4671.102693][ T44] Showing all locks held in the system: [ 4671.103033][ T44] 4 locks held by kworker/u16:0/12: [ 4671.103268][ T44] 1 lock held by khungtaskd/44: [ 4671.103654][ T44] #0: ffffffffb6f7fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4671.104079][ T44] 1 lock held by modprobe/2093: [ 4671.104310][ T44] #0: ffffffffb7668cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4671.104789][ T44] [ 4671.104919][ T44] ============================================= [ 4671.104919][ T44] [ 4793.965427][ T44] INFO: task modprobe:2093 blocked for more than 860 seconds. [ 4793.965831][ T44] Tainted: G W 6.18.0-virtme #1 [ 4793.966110][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4793.966515][ T44] task:modprobe state:D stack:25208 pid:2093 tgid:2093 ppid:1 task_flags:0x400100 flags:0x00080002 [ 4793.967043][ T44] Call Trace: [ 4793.967231][ T44] [ 4793.967392][ T44] __schedule+0x90a/0x1930 [ 4793.967646][ T44] ? io_schedule_timeout+0x150/0x150 [ 4793.967904][ T44] ? __lock_release+0x5d/0x160 [ 4793.968154][ T44] schedule+0xe2/0x270 [ 4793.968395][ T44] schedule_preempt_disabled+0x18/0x30 [ 4793.968639][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4793.968899][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4793.969172][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.969439][ T44] ? lock_acquire+0x104/0x140 [ 4793.969696][ T44] down_write+0x1d6/0x200 [ 4793.969890][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4793.970195][ T44] ? __lock_release+0x5d/0x160 [ 4793.970453][ T44] register_pernet_subsys+0x1a/0x40 [ 4793.970724][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4793.970977][ T44] pg_init+0x2c/0x1000 [pktgen] [ 4793.971225][ T44] do_one_initcall+0xc5/0x3d0 [ 4793.971484][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4793.971796][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.972040][ T44] ? trace_kmalloc+0x24/0xb0 [ 4793.972281][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4793.972533][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4793.972786][ T44] ? kasan_unpoison+0x27/0x50 [ 4793.973038][ T44] do_init_module+0x27a/0x860 [ 4793.973288][ T44] ? free_module+0x3f0/0x3f0 [ 4793.973548][ T44] ? kfree+0x2bb/0x5f0 [ 4793.973751][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4793.973998][ T44] ? load_module+0x20c5/0x2dd0 [ 4793.974250][ T44] load_module+0x1f40/0x2dd0 [ 4793.974514][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4793.974826][ T44] ? kernel_read_file+0x3ed/0x550 [ 4793.975073][ T44] ? kernel_read_file+0x3c8/0x550 [ 4793.975322][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4793.975582][ T44] ? init_module_from_file+0x159/0x180 [ 4793.975833][ T44] init_module_from_file+0x159/0x180 [ 4793.976075][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4793.976319][ T44] ? __lock_acquire+0x664/0xca0 [ 4793.976584][ T44] ? idempotent_init_module+0x316/0x610 [ 4793.976841][ T44] ? __lock_release+0x5d/0x160 [ 4793.977106][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4793.977362][ T44] idempotent_init_module+0x331/0x610 [ 4793.977610][ T44] ? init_module_from_file+0x180/0x180 [ 4793.977873][ T44] ? rcu_is_watching+0x12/0xb0 [ 4793.978120][ T44] ? cap_capable+0x17b/0x340 [ 4793.978379][ T44] __x64_sys_finit_module+0xca/0x150 [ 4793.978630][ T44] ? do_syscall_64+0x85/0xfc0 [ 4793.978886][ T44] do_syscall_64+0xc1/0xfc0 [ 4793.979130][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4793.979433][ T44] RIP: 0033:0x7fd7eca3092d [ 4793.979684][ T44] RSP: 002b:00007ffe0d3447a8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4793.980048][ T44] RAX: ffffffffffffffda RBX: 000055af9c6ebac0 RCX: 00007fd7eca3092d [ 4793.980417][ T44] RDX: 0000000000000000 RSI: 000055af98bb2a2a RDI: 0000000000000005 [ 4793.980783][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe0d3448e0 [ 4793.981140][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055af98bb2a2a [ 4793.981501][ T44] R13: 000055af9c6eba50 R14: 000055af9c6ebd90 R15: 0000000000000000 [ 4793.981884][ T44] [ 4793.982071][ T44] INFO: task modprobe:2093 is blocked on an rw-semaphore, but the owner is not found. [ 4793.982468][ T44] [ 4793.982468][ T44] Showing all locks held in the system: [ 4793.982810][ T44] 4 locks held by kworker/u16:0/12: [ 4793.983046][ T44] 1 lock held by khungtaskd/44: [ 4793.983275][ T44] #0: ffffffffb6f7fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4793.983844][ T44] 1 lock held by modprobe/2093: [ 4793.984075][ T44] #0: ffffffffb7668cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4793.984531][ T44] 1 lock held by modprobe/2183: [ 4793.984770][ T44] [ 4793.984897][ T44] ============================================= [ 4793.984897][ T44] [ 4916.845419][ T44] INFO: task modprobe:2093 blocked for more than 983 seconds. [ 4916.845877][ T44] Tainted: G W 6.18.0-virtme #1 [ 4916.846154][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 4916.846552][ T44] task:modprobe state:D stack:25208 pid:2093 tgid:2093 ppid:1 task_flags:0x400100 flags:0x00080002 [ 4916.847062][ T44] Call Trace: [ 4916.847253][ T44] [ 4916.847404][ T44] __schedule+0x90a/0x1930 [ 4916.847660][ T44] ? io_schedule_timeout+0x150/0x150 [ 4916.847909][ T44] ? __lock_release+0x5d/0x160 [ 4916.848164][ T44] schedule+0xe2/0x270 [ 4916.848399][ T44] schedule_preempt_disabled+0x18/0x30 [ 4916.848640][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 4916.848884][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 4916.849131][ T44] ? rcu_is_watching+0x12/0xb0 [ 4916.849389][ T44] ? lock_acquire+0x104/0x140 [ 4916.849637][ T44] down_write+0x1d6/0x200 [ 4916.849824][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 4916.850122][ T44] ? __lock_release+0x5d/0x160 [ 4916.850376][ T44] register_pernet_subsys+0x1a/0x40 [ 4916.850618][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4916.850862][ T44] pg_init+0x2c/0x1000 [pktgen] [ 4916.851113][ T44] do_one_initcall+0xc5/0x3d0 [ 4916.851367][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 4916.851666][ T44] ? rcu_is_watching+0x12/0xb0 [ 4916.851908][ T44] ? trace_kmalloc+0x24/0xb0 [ 4916.852145][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 4916.852393][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 4916.852634][ T44] ? kasan_unpoison+0x27/0x50 [ 4916.852884][ T44] do_init_module+0x27a/0x860 [ 4916.853131][ T44] ? free_module+0x3f0/0x3f0 [ 4916.853380][ T44] ? kfree+0x2bb/0x5f0 [ 4916.853567][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 4916.853807][ T44] ? load_module+0x20c5/0x2dd0 [ 4916.854051][ T44] load_module+0x1f40/0x2dd0 [ 4916.854301][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 4916.854604][ T44] ? kernel_read_file+0x3ed/0x550 [ 4916.854851][ T44] ? kernel_read_file+0x3c8/0x550 [ 4916.855092][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 4916.855337][ T44] ? init_module_from_file+0x159/0x180 [ 4916.855586][ T44] init_module_from_file+0x159/0x180 [ 4916.855825][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 4916.856065][ T44] ? __lock_acquire+0x664/0xca0 [ 4916.856315][ T44] ? idempotent_init_module+0x316/0x610 [ 4916.856566][ T44] ? __lock_release+0x5d/0x160 [ 4916.856808][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 4916.857054][ T44] idempotent_init_module+0x331/0x610 [ 4916.857295][ T44] ? init_module_from_file+0x180/0x180 [ 4916.857556][ T44] ? rcu_is_watching+0x12/0xb0 [ 4916.857794][ T44] ? cap_capable+0x17b/0x340 [ 4916.858040][ T44] __x64_sys_finit_module+0xca/0x150 [ 4916.858281][ T44] ? do_syscall_64+0x85/0xfc0 [ 4916.858533][ T44] do_syscall_64+0xc1/0xfc0 [ 4916.858773][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4916.859061][ T44] RIP: 0033:0x7fd7eca3092d [ 4916.859307][ T44] RSP: 002b:00007ffe0d3447a8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 4916.859664][ T44] RAX: ffffffffffffffda RBX: 000055af9c6ebac0 RCX: 00007fd7eca3092d [ 4916.860016][ T44] RDX: 0000000000000000 RSI: 000055af98bb2a2a RDI: 0000000000000005 [ 4916.860373][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe0d3448e0 [ 4916.860719][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055af98bb2a2a [ 4916.861064][ T44] R13: 000055af9c6eba50 R14: 000055af9c6ebd90 R15: 0000000000000000 [ 4916.861438][ T44] [ 4916.861623][ T44] INFO: task modprobe:2093 is blocked on an rw-semaphore, but the owner is not found. [ 4916.862009][ T44] [ 4916.862009][ T44] Showing all locks held in the system: [ 4916.862332][ T44] 4 locks held by kworker/u16:0/12: [ 4916.862717][ T44] 1 lock held by khungtaskd/44: [ 4916.862940][ T44] #0: ffffffffb6f7fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 4916.863344][ T44] 1 lock held by modprobe/2093: [ 4916.863578][ T44] #0: ffffffffb7668cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 4916.864020][ T44] [ 4916.864145][ T44] ============================================= [ 4916.864145][ T44] [ 5039.725415][ T44] INFO: task modprobe:2093 blocked for more than 1105 seconds. [ 5039.725903][ T44] Tainted: G W 6.18.0-virtme #1 [ 5039.726179][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5039.726572][ T44] task:modprobe state:D stack:25208 pid:2093 tgid:2093 ppid:1 task_flags:0x400100 flags:0x00080002 [ 5039.727075][ T44] Call Trace: [ 5039.727271][ T44] [ 5039.727431][ T44] __schedule+0x90a/0x1930 [ 5039.727685][ T44] ? io_schedule_timeout+0x150/0x150 [ 5039.727931][ T44] ? __lock_release+0x5d/0x160 [ 5039.728180][ T44] schedule+0xe2/0x270 [ 5039.728405][ T44] schedule_preempt_disabled+0x18/0x30 [ 5039.728656][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 5039.728901][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 5039.729148][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.729402][ T44] ? lock_acquire+0x104/0x140 [ 5039.729651][ T44] down_write+0x1d6/0x200 [ 5039.729838][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 5039.730131][ T44] ? __lock_release+0x5d/0x160 [ 5039.730393][ T44] register_pernet_subsys+0x1a/0x40 [ 5039.730636][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 5039.730882][ T44] pg_init+0x2c/0x1000 [pktgen] [ 5039.731126][ T44] do_one_initcall+0xc5/0x3d0 [ 5039.731381][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 5039.731674][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.731916][ T44] ? trace_kmalloc+0x24/0xb0 [ 5039.732159][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 5039.732413][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 5039.732654][ T44] ? kasan_unpoison+0x27/0x50 [ 5039.732900][ T44] do_init_module+0x27a/0x860 [ 5039.733145][ T44] ? free_module+0x3f0/0x3f0 [ 5039.733393][ T44] ? kfree+0x2bb/0x5f0 [ 5039.733579][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 5039.733827][ T44] ? load_module+0x20c5/0x2dd0 [ 5039.734071][ T44] load_module+0x1f40/0x2dd0 [ 5039.734321][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 5039.734623][ T44] ? kernel_read_file+0x3ed/0x550 [ 5039.734865][ T44] ? kernel_read_file+0x3c8/0x550 [ 5039.735106][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 5039.735361][ T44] ? init_module_from_file+0x159/0x180 [ 5039.735606][ T44] init_module_from_file+0x159/0x180 [ 5039.735846][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 5039.736087][ T44] ? __lock_acquire+0x664/0xca0 [ 5039.736337][ T44] ? idempotent_init_module+0x316/0x610 [ 5039.736586][ T44] ? __lock_release+0x5d/0x160 [ 5039.736828][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 5039.737068][ T44] idempotent_init_module+0x331/0x610 [ 5039.737333][ T44] ? init_module_from_file+0x180/0x180 [ 5039.737597][ T44] ? rcu_is_watching+0x12/0xb0 [ 5039.737838][ T44] ? cap_capable+0x17b/0x340 [ 5039.738083][ T44] __x64_sys_finit_module+0xca/0x150 [ 5039.738323][ T44] ? do_syscall_64+0x85/0xfc0 [ 5039.738574][ T44] do_syscall_64+0xc1/0xfc0 [ 5039.738815][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5039.739110][ T44] RIP: 0033:0x7fd7eca3092d [ 5039.739365][ T44] RSP: 002b:00007ffe0d3447a8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 5039.739714][ T44] RAX: ffffffffffffffda RBX: 000055af9c6ebac0 RCX: 00007fd7eca3092d [ 5039.740060][ T44] RDX: 0000000000000000 RSI: 000055af98bb2a2a RDI: 0000000000000005 [ 5039.740416][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe0d3448e0 [ 5039.740769][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055af98bb2a2a [ 5039.741117][ T44] R13: 000055af9c6eba50 R14: 000055af9c6ebd90 R15: 0000000000000000 [ 5039.741492][ T44] [ 5039.741679][ T44] INFO: task modprobe:2093 is blocked on an rw-semaphore, but the owner is not found. [ 5039.742066][ T44] [ 5039.742066][ T44] Showing all locks held in the system: [ 5039.742545][ T44] 4 locks held by kworker/u16:0/12: [ 5039.742780][ T44] 1 lock held by khungtaskd/44: [ 5039.743003][ T44] #0: ffffffffb6f7fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 5039.743409][ T44] 1 lock held by modprobe/2093: [ 5039.743633][ T44] #0: ffffffffb7668cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 5039.744081][ T44] [ 5039.744206][ T44] ============================================= [ 5039.744206][ T44] [ 5162.605414][ T44] INFO: task modprobe:2093 blocked for more than 1228 seconds. [ 5162.605873][ T44] Tainted: G W 6.18.0-virtme #1 [ 5162.606156][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 5162.606552][ T44] task:modprobe state:D stack:25208 pid:2093 tgid:2093 ppid:1 task_flags:0x400100 flags:0x00080002 [ 5162.607043][ T44] Call Trace: [ 5162.607233][ T44] [ 5162.607397][ T44] __schedule+0x90a/0x1930 [ 5162.607660][ T44] ? io_schedule_timeout+0x150/0x150 [ 5162.607908][ T44] ? __lock_release+0x5d/0x160 [ 5162.608157][ T44] schedule+0xe2/0x270 [ 5162.608385][ T44] schedule_preempt_disabled+0x18/0x30 [ 5162.608629][ T44] rwsem_down_write_slowpath+0x3c5/0xc60 [ 5162.608880][ T44] ? rwsem_down_read_slowpath+0xd80/0xd80 [ 5162.609128][ T44] ? rcu_is_watching+0x12/0xb0 [ 5162.609379][ T44] ? lock_acquire+0x104/0x140 [ 5162.609625][ T44] down_write+0x1d6/0x200 [ 5162.609812][ T44] ? rwsem_down_write_slowpath+0xc60/0xc60 [ 5162.610103][ T44] ? __lock_release+0x5d/0x160 [ 5162.610342][ T44] register_pernet_subsys+0x1a/0x40 [ 5162.610606][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 5162.610850][ T44] pg_init+0x2c/0x1000 [pktgen] [ 5162.611091][ T44] do_one_initcall+0xc5/0x3d0 [ 5162.611332][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 5162.611634][ T44] ? rcu_is_watching+0x12/0xb0 [ 5162.611872][ T44] ? trace_kmalloc+0x24/0xb0 [ 5162.612110][ T44] ? __kmalloc_cache_noprof+0x2e4/0x710 [ 5162.612360][ T44] ? debug_objects_fill_pool+0x3e0/0x3e0 [ 5162.612601][ T44] ? kasan_unpoison+0x27/0x50 [ 5162.612844][ T44] do_init_module+0x27a/0x860 [ 5162.613089][ T44] ? free_module+0x3f0/0x3f0 [ 5162.613325][ T44] ? kfree+0x2bb/0x5f0 [ 5162.613521][ T44] ? pg_cleanup+0x380/0x380 [pktgen] [ 5162.613761][ T44] ? load_module+0x20c5/0x2dd0 [ 5162.614004][ T44] load_module+0x1f40/0x2dd0 [ 5162.614258][ T44] ? layout_and_allocate.constprop.0+0x630/0x630 [ 5162.614559][ T44] ? kernel_read_file+0x3ed/0x550 [ 5162.614803][ T44] ? kernel_read_file+0x3c8/0x550 [ 5162.615044][ T44] ? __ia32_sys_fsconfig+0x150/0x150 [ 5162.615289][ T44] ? init_module_from_file+0x159/0x180 [ 5162.615538][ T44] init_module_from_file+0x159/0x180 [ 5162.615778][ T44] ? __do_sys_init_module+0x1e0/0x1e0 [ 5162.616022][ T44] ? __lock_acquire+0x664/0xca0 [ 5162.616270][ T44] ? idempotent_init_module+0x316/0x610 [ 5162.616519][ T44] ? __lock_release+0x5d/0x160 [ 5162.616759][ T44] ? do_raw_spin_unlock+0x58/0x220 [ 5162.617001][ T44] idempotent_init_module+0x331/0x610 [ 5162.617242][ T44] ? init_module_from_file+0x180/0x180 [ 5162.617507][ T44] ? rcu_is_watching+0x12/0xb0 [ 5162.617751][ T44] ? cap_capable+0x17b/0x340 [ 5162.617995][ T44] __x64_sys_finit_module+0xca/0x150 [ 5162.618231][ T44] ? do_syscall_64+0x85/0xfc0 [ 5162.618481][ T44] do_syscall_64+0xc1/0xfc0 [ 5162.618719][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5162.619006][ T44] RIP: 0033:0x7fd7eca3092d [ 5162.619252][ T44] RSP: 002b:00007ffe0d3447a8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 5162.619612][ T44] RAX: ffffffffffffffda RBX: 000055af9c6ebac0 RCX: 00007fd7eca3092d [ 5162.619958][ T44] RDX: 0000000000000000 RSI: 000055af98bb2a2a RDI: 0000000000000005 [ 5162.620306][ T44] RBP: 0000000000040000 R08: 0000000000000000 R09: 00007ffe0d3448e0 [ 5162.620661][ T44] R10: 0000000000000005 R11: 0000000000000246 R12: 000055af98bb2a2a [ 5162.621010][ T44] R13: 000055af9c6eba50 R14: 000055af9c6ebd90 R15: 0000000000000000 [ 5162.621378][ T44] [ 5162.621563][ T44] INFO: task modprobe:2093 is blocked on an rw-semaphore, but the owner is not found. [ 5162.621925][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings [ 5162.622317][ T44] [ 5162.622317][ T44] Showing all locks held in the system: [ 5162.622797][ T44] 4 locks held by kworker/u16:0/12: [ 5162.623032][ T44] 1 lock held by khungtaskd/44: [ 5162.623256][ T44] #0: ffffffffb6f7fe20 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x36/0x260 [ 5162.623664][ T44] 1 lock held by modprobe/2093: [ 5162.623886][ T44] #0: ffffffffb7668cd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x1a/0x40 [ 5162.624332][ T44] [ 5162.624467][ T44] ============================================= [ 5162.624467][ T44] WAIT TIMEOUT stderr Ctrl-C stderr Ctrl-C stderr